Nov 29 05:41:49 user nova-compute[75083]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75083) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75083) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75083) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 05:41:49 user nova-compute[75083]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:41:49 user nova-compute[75083]: INFO nova.virt.driver [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 29 05:41:49 user nova-compute[75083]: INFO nova.compute.provider_config [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] Acquiring lock "singleton_lock" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] Acquired lock "singleton_lock" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] Releasing lock "singleton_lock" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] Full set of CONF: {{(pid=75083) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ******************************************************************************** {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] Configuration options gathered from: {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ================================================================================ {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] allow_resize_to_same_host      = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] arq_binding_timeout            = 300 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] backdoor_port                  = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] backdoor_socket                = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] block_device_allocate_retries  = 300 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] block_device_allocate_retries_interval = 5 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cert                           = self.pem {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] compute_monitors               = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] config_dir                     = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] config_drive_format            = iso9660 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] config_source                  = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] console_host                   = user {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] control_exchange               = nova {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cpu_allocation_ratio           = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] daemon                         = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] debug                          = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] default_access_ip_network_name = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] default_availability_zone      = nova {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] default_ephemeral_format       = ext4 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] default_green_pool_size        = 1000 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] default_schedule_zone          = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] disk_allocation_ratio          = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] enable_new_services            = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] enabled_ssl_apis               = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] flat_injected                  = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] force_config_drive             = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] force_raw_images               = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] graceful_shutdown_timeout      = 5 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] heal_instance_info_cache_interval = 60 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] host                           = user {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] instance_build_timeout         = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] instance_delete_interval       = 300 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] instance_name_template         = instance-%08x {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] instance_usage_audit           = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] instance_usage_audit_period    = month {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] internal_service_availability_zone = internal {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] key                            = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] live_migration_retry_count     = 30 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] log_config_append              = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] log_dir                        = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] log_file                       = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] log_options                    = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] log_rotate_interval            = 1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] log_rotate_interval_type       = days {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] log_rotation_type              = none {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] long_rpc_timeout               = 1800 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] max_concurrent_builds          = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] max_concurrent_live_migrations = 1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] max_concurrent_snapshots       = 5 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] max_local_block_devices        = 3 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] max_logfile_count              = 30 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] max_logfile_size_mb            = 200 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] maximum_instance_delete_attempts = 5 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] metadata_listen                = 0.0.0.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] metadata_listen_port           = 8775 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] metadata_workers               = 3 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] migrate_max_retries            = -1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] mkisofs_cmd                    = genisoimage {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] my_ip                          = 10.0.0.210 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] network_allocate_retries       = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] osapi_compute_listen_port      = 8774 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] osapi_compute_unique_server_name_scope =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] osapi_compute_workers          = 3 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] password_length                = 12 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] periodic_enable                = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] periodic_fuzzy_delay           = 60 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] pointer_model                  = ps2mouse {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] preallocate_images             = none {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] publish_errors                 = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] pybasedir                      = /opt/stack/nova {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ram_allocation_ratio           = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] rate_limit_burst               = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] rate_limit_except_level        = CRITICAL {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] rate_limit_interval            = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] reboot_timeout                 = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] reclaim_instance_interval      = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] record                         = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] reimage_timeout_per_gb         = 60 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] report_interval                = 120 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] rescue_timeout                 = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] reserved_host_cpus             = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] reserved_host_disk_mb          = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] reserved_host_memory_mb        = 512 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] reserved_huge_pages            = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] resize_confirm_window          = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] resize_fs_using_block_device   = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] resume_guests_state_on_host_boot = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] rpc_response_timeout           = 60 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] run_external_periodic_tasks    = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] running_deleted_instance_action = reap {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] running_deleted_instance_timeout = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] scheduler_instance_sync_interval = 120 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] service_down_time              = 720 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] servicegroup_driver            = db {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] shelved_offload_time           = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] shelved_poll_interval          = 3600 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] shutdown_timeout               = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] source_is_ipv6                 = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ssl_only                       = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] state_path                     = /opt/stack/data/nova {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] sync_power_state_interval      = 600 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] sync_power_state_pool_size     = 1000 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] syslog_log_facility            = LOG_USER {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] tempdir                        = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] timeout_nbd                    = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] transport_url                  = **** {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] update_resources_interval      = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] use_cow_images                 = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] use_eventlog                   = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] use_journal                    = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] use_json                       = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] use_rootwrap_daemon            = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] use_stderr                     = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] use_syslog                     = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vcpu_pin_set                   = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vif_plugging_is_fatal          = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vif_plugging_timeout           = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] virt_mkfs                      = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] volume_usage_poll_interval     = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] watch_log_file                 = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] web                            = /usr/share/spice-html5 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_concurrency.disable_process_locking = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.auth_strategy              = keystone {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.compute_link_prefix        = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.dhcp_domain                = novalocal {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.enable_instance_password   = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.glance_link_prefix         = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.instance_list_per_project_cells = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.list_records_by_skipping_down_cells = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.local_metadata_per_cell    = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.max_limit                  = 1000 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.metadata_cache_expiration  = 15 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.neutron_default_tenant_id  = default {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.use_forwarded_for          = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.use_neutron_default_nets   = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.vendordata_dynamic_targets = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.vendordata_jsonfile_path   = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.backend_argument         = **** {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.config_prefix            = cache.oslo {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.dead_timeout             = 60.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.debug_cache_backend      = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.enable_retry_client      = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.enable_socket_keepalive  = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.enabled                  = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.expiration_time          = 600 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.hashclient_retry_attempts = 2 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.memcache_dead_retry      = 300 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.memcache_password        =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.memcache_sasl_enabled    = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.memcache_username        =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.proxies                  = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.retry_attempts           = 2 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.retry_delay              = 0.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.socket_keepalive_count   = 1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.socket_keepalive_idle    = 1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.socket_keepalive_interval = 1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.tls_allowed_ciphers      = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.tls_cafile               = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.tls_certfile             = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.tls_enabled              = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cache.tls_keyfile              = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cinder.auth_section            = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cinder.auth_type               = password {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cinder.cafile                  = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cinder.certfile                = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cinder.collect_timing          = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cinder.cross_az_attach         = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cinder.debug                   = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cinder.endpoint_template       = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cinder.http_retries            = 3 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cinder.insecure                = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cinder.keyfile                 = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cinder.os_region_name          = RegionOne {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cinder.split_loggers           = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cinder.timeout                 = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] compute.cpu_dedicated_set      = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] compute.cpu_shared_set         = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] compute.image_type_exclude_list = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] compute.resource_provider_association_refresh = 300 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] compute.shutdown_retry_interval = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] conductor.workers              = 3 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] console.allowed_origins        = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] console.ssl_ciphers            = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] console.ssl_minimum_version    = default {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] consoleauth.token_ttl          = 600 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cyborg.cafile                  = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cyborg.certfile                = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cyborg.collect_timing          = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cyborg.connect_retries         = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cyborg.connect_retry_delay     = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cyborg.endpoint_override       = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cyborg.insecure                = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cyborg.keyfile                 = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cyborg.max_version             = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cyborg.min_version             = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cyborg.region_name             = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cyborg.service_name            = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cyborg.service_type            = accelerator {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cyborg.split_loggers           = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cyborg.status_code_retries     = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cyborg.status_code_retry_delay = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cyborg.timeout                 = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] cyborg.version                 = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] database.backend               = sqlalchemy {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] database.connection            = **** {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] database.connection_debug      = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] database.connection_parameters =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] database.connection_recycle_time = 3600 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] database.connection_trace      = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] database.db_inc_retry_interval = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] database.db_max_retries        = 20 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] database.db_max_retry_interval = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] database.db_retry_interval     = 1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] database.max_overflow          = 50 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] database.max_pool_size         = 5 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] database.max_retries           = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] database.mysql_wsrep_sync_wait = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] database.pool_timeout          = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] database.retry_interval        = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] database.slave_connection      = **** {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] database.sqlite_synchronous    = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api_database.backend           = sqlalchemy {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api_database.connection        = **** {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api_database.connection_debug  = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api_database.connection_parameters =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api_database.connection_recycle_time = 3600 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api_database.connection_trace  = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api_database.db_inc_retry_interval = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api_database.db_max_retries    = 20 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api_database.db_max_retry_interval = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api_database.db_retry_interval = 1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api_database.max_overflow      = 50 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api_database.max_pool_size     = 5 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api_database.max_retries       = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api_database.pool_timeout      = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api_database.retry_interval    = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api_database.slave_connection  = **** {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] api_database.sqlite_synchronous = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] devices.enabled_mdev_types     = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ephemeral_storage_encryption.enabled = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.api_servers             = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.cafile                  = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.certfile                = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.collect_timing          = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.connect_retries         = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.connect_retry_delay     = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.debug                   = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.default_trusted_certificate_ids = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.enable_certificate_validation = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.enable_rbd_download     = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.endpoint_override       = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.insecure                = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.keyfile                 = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.max_version             = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.min_version             = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.num_retries             = 3 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.rbd_ceph_conf           =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:49 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.rbd_connect_timeout     = 5 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.rbd_pool                =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.rbd_user                =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.region_name             = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.service_name            = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.service_type            = image {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.split_loggers           = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.status_code_retries     = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.status_code_retry_delay = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.timeout                 = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.verify_glance_signatures = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] glance.version                 = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] guestfs.debug                  = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] hyperv.config_drive_cdrom      = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] hyperv.config_drive_inject_password = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] hyperv.enable_remotefx         = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] hyperv.instances_path_share    =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] hyperv.limit_cpu_features      = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] hyperv.use_multipath_io        = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] hyperv.vswitch_name            = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] mks.enabled                    = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] image_cache.manager_interval   = 2400 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] image_cache.precache_concurrency = 1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] image_cache.remove_unused_base_images = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] image_cache.subdirectory_name  = _base {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.api_max_retries         = 60 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.api_retry_interval      = 2 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.auth_section            = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.auth_type               = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.cafile                  = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.certfile                = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.collect_timing          = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.conductor_group         = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.connect_retries         = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.connect_retry_delay     = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.endpoint_override       = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.insecure                = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.keyfile                 = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.max_version             = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.min_version             = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.peer_list               = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.region_name             = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.serial_console_state_timeout = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.service_name            = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.service_type            = baremetal {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.split_loggers           = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.status_code_retries     = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.status_code_retry_delay = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.timeout                 = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ironic.version                 = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] key_manager.fixed_key          = **** {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican.barbican_api_version  = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican.barbican_endpoint     = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican.barbican_endpoint_type = public {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican.barbican_region_name  = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican.cafile                = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican.certfile              = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican.collect_timing        = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican.insecure              = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican.keyfile               = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican.number_of_retries     = 60 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican.retry_delay           = 1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican.send_service_user_token = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican.split_loggers         = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican.timeout               = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican.verify_ssl            = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican.verify_ssl_path       = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican_service_user.auth_section = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican_service_user.auth_type = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican_service_user.cafile   = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican_service_user.certfile = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican_service_user.collect_timing = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican_service_user.insecure = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican_service_user.keyfile  = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican_service_user.split_loggers = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] barbican_service_user.timeout  = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vault.approle_role_id          = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vault.approle_secret_id        = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vault.cafile                   = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vault.certfile                 = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vault.collect_timing           = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vault.insecure                 = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vault.keyfile                  = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vault.kv_mountpoint            = secret {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vault.kv_path                  = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vault.kv_version               = 2 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vault.namespace                = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vault.root_token_id            = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vault.split_loggers            = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vault.ssl_ca_crt_file          = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vault.timeout                  = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vault.use_ssl                  = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.auth_section          = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.auth_type             = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.cafile                = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.certfile              = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.collect_timing        = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.connect_retries       = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.connect_retry_delay   = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.endpoint_override     = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.insecure              = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.keyfile               = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.max_version           = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.min_version           = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.region_name           = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.service_name          = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.service_type          = identity {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.split_loggers         = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.status_code_retries   = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.status_code_retry_delay = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.timeout               = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] keystone.version               = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.connection_uri         =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.cpu_mode               = custom {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: WARNING oslo_config.cfg [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.cpu_power_governor_high = performance {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.cpu_power_management   = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.device_detach_attempts = 8 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.device_detach_timeout  = 20 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.disk_cachemodes        = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.disk_prefix            = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.enabled_perf_events    = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.file_backed_memory     = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.gid_maps               = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.hw_disk_discard        = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.hw_machine_type        = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.images_rbd_pool        = rbd {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.images_type            = default {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.images_volume_group    = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.inject_key             = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.inject_partition       = -2 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.inject_password        = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.iscsi_iface            = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.iser_use_multipath     = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.live_migration_downtime = 500 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.live_migration_inbound_addr = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.live_migration_scheme  = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.live_migration_timeout_action = abort {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.live_migration_tunnelled = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: WARNING oslo_config.cfg [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 29 05:41:50 user nova-compute[75083]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 29 05:41:50 user nova-compute[75083]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 29 05:41:50 user nova-compute[75083]: and ``live_migration_inbound_addr`` respectively.
Nov 29 05:41:50 user nova-compute[75083]: ).  Its value may be silently ignored in the future.
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.live_migration_with_native_tls = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.max_queues             = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.nfs_mount_options      = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.num_pcie_ports         = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.pmem_namespaces        = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.quobyte_client_cfg     = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.rbd_secret_uuid        = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.rbd_user               = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.rescue_image_id        = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.rescue_kernel_id       = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.rx_queue_size          = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.smbfs_mount_options    =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.snapshot_compression   = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.snapshot_image_format  = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.sparse_logical_volumes = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.swtpm_enabled          = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.swtpm_group            = tss {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.swtpm_user             = tss {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.sysinfo_serial         = unique {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.tb_cache_size          = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.tx_queue_size          = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.uid_maps               = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.use_virtio_for_bridges = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.virt_type              = kvm {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.volume_clear           = zero {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.volume_clear_size      = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.volume_use_multipath   = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.vzstorage_cache_path   = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.auth_section           = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.auth_type              = password {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.cafile                 = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.certfile               = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.collect_timing         = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.connect_retries        = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.connect_retry_delay    = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.default_floating_pool  = public {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.endpoint_override      = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.extension_sync_interval = 600 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.http_retries           = 3 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.insecure               = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.keyfile                = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.max_version            = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.min_version            = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.ovs_bridge             = br-int {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.physnets               = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.region_name            = RegionOne {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.service_metadata_proxy = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.service_name           = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.service_type           = network {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.split_loggers          = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.status_code_retries    = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.status_code_retry_delay = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.timeout                = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] neutron.version                = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] notifications.bdms_in_notifications = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] notifications.default_level    = INFO {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] notifications.notification_format = unversioned {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] notifications.notify_on_state_change = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] pci.alias                      = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] pci.device_spec                = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] pci.report_in_placement        = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.auth_section         = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.auth_type            = password {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.cafile               = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.certfile             = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.collect_timing       = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.connect_retries      = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.connect_retry_delay  = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.default_domain_id    = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.default_domain_name  = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.domain_id            = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.domain_name          = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.endpoint_override    = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.insecure             = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.keyfile              = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.max_version          = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.min_version          = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.password             = **** {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.project_domain_id    = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.project_domain_name  = Default {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.project_id           = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.project_name         = service {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.region_name          = RegionOne {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.service_name         = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.service_type         = placement {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.split_loggers        = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.status_code_retries  = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.status_code_retry_delay = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.system_scope         = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.timeout              = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.trust_id             = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.user_domain_id       = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.user_domain_name     = Default {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.user_id              = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.username             = placement {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] placement.version              = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] quota.cores                    = 20 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] quota.count_usage_from_placement = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] quota.injected_file_content_bytes = 10240 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] quota.injected_file_path_length = 255 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] quota.injected_files           = 5 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] quota.instances                = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] quota.key_pairs                = 100 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] quota.metadata_items           = 128 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] quota.ram                      = 51200 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] quota.recheck_quota            = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] quota.server_group_members     = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] quota.server_groups            = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] rdp.enabled                    = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] scheduler.image_metadata_prefilter = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] scheduler.max_attempts         = 3 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] scheduler.max_placement_results = 1000 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] scheduler.workers              = 3 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.host_subset_size = 1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.isolated_hosts = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.isolated_images = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.pci_in_placement = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.track_instance_changes = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] metrics.required               = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] metrics.weight_multiplier      = 1.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] metrics.weight_setting         = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] serial_console.enabled         = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] serial_console.port_range      = 10000:20000 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] serial_console.serialproxy_port = 6083 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] service_user.auth_section      = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] service_user.auth_type         = password {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] service_user.cafile            = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] service_user.certfile          = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] service_user.collect_timing    = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] service_user.insecure          = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] service_user.keyfile           = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] service_user.send_service_user_token = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] service_user.split_loggers     = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] service_user.timeout           = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] spice.agent_enabled            = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] spice.enabled                  = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] spice.html5proxy_port          = 6082 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] spice.image_compression        = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] spice.jpeg_compression         = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] spice.playback_compression     = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] spice.server_listen            = 127.0.0.1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] spice.streaming_mode           = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] spice.zlib_compression         = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] upgrade_levels.baseapi         = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] upgrade_levels.compute         = auto {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] upgrade_levels.conductor       = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] upgrade_levels.scheduler       = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vendordata_dynamic_auth.cafile = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vendordata_dynamic_auth.certfile = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vendordata_dynamic_auth.insecure = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vendordata_dynamic_auth.timeout = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.api_retry_count         = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.ca_file                 = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.cache_prefix            = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.cluster_name            = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.connection_pool_size    = 10 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.console_delay_seconds   = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.datastore_regex         = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.host_ip                 = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.host_password           = **** {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.host_port               = 443 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.host_username           = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.insecure                = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.integration_bridge      = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.maximum_objects         = 100 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.pbm_default_policy      = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.pbm_enabled             = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.pbm_wsdl_location       = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.serial_port_proxy_uri   = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.serial_port_service_uri = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.task_poll_interval      = 0.5 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.use_linked_clone        = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.vnc_keymap              = en-us {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.vnc_port                = 5900 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vmware.vnc_port_total          = 10000 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vnc.auth_schemes               = ['none'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vnc.enabled                    = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vnc.novncproxy_port            = 6080 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vnc.vencrypt_ca_certs          = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vnc.vencrypt_client_cert       = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vnc.vencrypt_client_key        = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] workarounds.disable_rootwrap   = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] workarounds.enable_numa_live_migration = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] workarounds.libvirt_disable_apic = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] wsgi.client_socket_timeout     = 900 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] wsgi.default_pool_size         = 1000 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] wsgi.keep_alive                = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] wsgi.max_header_line           = 16384 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] wsgi.ssl_ca_file               = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] wsgi.ssl_cert_file             = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] wsgi.ssl_key_file              = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] wsgi.tcp_keepidle              = 600 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] zvm.ca_file                    = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] zvm.cloud_connector_url        = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] zvm.reachable_timeout          = 300 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_policy.enforce_new_defaults = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_policy.enforce_scope      = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_policy.policy_default_rule = default {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] profiler.connection_string     = messaging:// {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] profiler.enabled               = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] profiler.es_doc_type           = notification {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] profiler.es_scroll_size        = 10000 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] profiler.es_scroll_time        = 2m {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] profiler.filter_error_trace    = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] profiler.hmac_keys             = **** {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] profiler.sentinel_service_name = mymaster {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] profiler.socket_timeout        = 0.1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] profiler.trace_requests        = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] profiler.trace_sqlalchemy      = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] profiler_jaeger.process_tags   = {} {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] profiler_jaeger.service_name_prefix = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] profiler_otlp.service_name_prefix = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] remote_debug.host              = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] remote_debug.port              = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_notifications.retry = -1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.auth_section        = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.auth_type           = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.cafile              = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.certfile            = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.collect_timing      = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.connect_retries     = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.connect_retry_delay = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.endpoint_id         = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.endpoint_override   = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.insecure            = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.keyfile             = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.max_version         = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.min_version         = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.region_name         = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.service_name        = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.service_type        = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.split_loggers       = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.status_code_retries = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.status_code_retry_delay = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.timeout             = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.valid_interfaces    = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_limit.version             = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_reports.file_event_handler = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] oslo_reports.log_dir           = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vif_plug_ovs_privileged.group  = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] vif_plug_ovs_privileged.user   = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] os_vif_ovs.isolate_vif         = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] os_brick.lock_path             = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] privsep_osbrick.capabilities   = [21] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] privsep_osbrick.group          = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] privsep_osbrick.helper_command = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] privsep_osbrick.user           = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] nova_sys_admin.group           = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] nova_sys_admin.helper_command  = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] nova_sys_admin.user            = None {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG oslo_service.service [None req-b1a3261c-761a-467e-a065-6b36ca8cc0c2 None None] ******************************************************************************** {{(pid=75083) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 29 05:41:50 user nova-compute[75083]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 29 05:41:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Connecting to libvirt: qemu:///system {{(pid=75083) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fd0dc8de440> {{(pid=75083) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 29 05:41:50 user nova-compute[75083]: libvirt:  error : internal error: could not initialize domain event timer
Nov 29 05:41:50 user nova-compute[75083]: WARNING nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 29 05:41:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fd0dc8de440> {{(pid=75083) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Starting native event thread {{(pid=75083) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Starting green dispatch thread {{(pid=75083) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 29 05:41:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Starting connection event dispatch thread {{(pid=75083) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 29 05:41:50 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Connection event '1' reason 'None'
Nov 29 05:41:50 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 05:41:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.mount [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Initialising _HostMountState generation 0 {{(pid=75083) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 29 05:41:57 user nova-compute[75083]: INFO nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Libvirt host capabilities <capabilities>
Nov 29 05:41:57 user nova-compute[75083]:   <host>
Nov 29 05:41:57 user nova-compute[75083]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 29 05:41:57 user nova-compute[75083]:     <cpu>
Nov 29 05:41:57 user nova-compute[75083]:       <arch>x86_64</arch>
Nov 29 05:41:57 user nova-compute[75083]:       <model>IvyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <vendor>Intel</vendor>
Nov 29 05:41:57 user nova-compute[75083]:       <microcode version='1070'/>
Nov 29 05:41:57 user nova-compute[75083]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 29 05:41:57 user nova-compute[75083]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature name='ss'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature name='vmx'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature name='pcid'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature name='osxsave'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature name='hypervisor'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature name='arat'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature name='tsc_adjust'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature name='md-clear'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature name='stibp'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature name='arch-capabilities'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature name='ssbd'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature name='invtsc'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature name='rsba'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature name='skip-l1dfl-vmentry'/>
Nov 29 05:41:57 user nova-compute[75083]:       <pages unit='KiB' size='4'/>
Nov 29 05:41:57 user nova-compute[75083]:       <pages unit='KiB' size='2048'/>
Nov 29 05:41:57 user nova-compute[75083]:     </cpu>
Nov 29 05:41:57 user nova-compute[75083]:     <power_management>
Nov 29 05:41:57 user nova-compute[75083]:       <suspend_mem/>
Nov 29 05:41:57 user nova-compute[75083]:       <suspend_disk/>
Nov 29 05:41:57 user nova-compute[75083]:       <suspend_hybrid/>
Nov 29 05:41:57 user nova-compute[75083]:     </power_management>
Nov 29 05:41:57 user nova-compute[75083]:     <iommu support='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     <migration_features>
Nov 29 05:41:57 user nova-compute[75083]:       <live/>
Nov 29 05:41:57 user nova-compute[75083]:       <uri_transports>
Nov 29 05:41:57 user nova-compute[75083]:         <uri_transport>tcp</uri_transport>
Nov 29 05:41:57 user nova-compute[75083]:         <uri_transport>rdma</uri_transport>
Nov 29 05:41:57 user nova-compute[75083]:       </uri_transports>
Nov 29 05:41:57 user nova-compute[75083]:     </migration_features>
Nov 29 05:41:57 user nova-compute[75083]:     <topology>
Nov 29 05:41:57 user nova-compute[75083]:       <cells num='2'>
Nov 29 05:41:57 user nova-compute[75083]:         <cell id='0'>
Nov 29 05:41:57 user nova-compute[75083]:           <memory unit='KiB'>8140616</memory>
Nov 29 05:41:57 user nova-compute[75083]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 29 05:41:57 user nova-compute[75083]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 05:41:57 user nova-compute[75083]:           <distances>
Nov 29 05:41:57 user nova-compute[75083]:             <sibling id='0' value='10'/>
Nov 29 05:41:57 user nova-compute[75083]:             <sibling id='1' value='20'/>
Nov 29 05:41:57 user nova-compute[75083]:           </distances>
Nov 29 05:41:57 user nova-compute[75083]:           <cpus num='6'>
Nov 29 05:41:57 user nova-compute[75083]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 29 05:41:57 user nova-compute[75083]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 29 05:41:57 user nova-compute[75083]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 29 05:41:57 user nova-compute[75083]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 29 05:41:57 user nova-compute[75083]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 29 05:41:57 user nova-compute[75083]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 29 05:41:57 user nova-compute[75083]:           </cpus>
Nov 29 05:41:57 user nova-compute[75083]:         </cell>
Nov 29 05:41:57 user nova-compute[75083]:         <cell id='1'>
Nov 29 05:41:57 user nova-compute[75083]:           <memory unit='KiB'>8255068</memory>
Nov 29 05:41:57 user nova-compute[75083]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 29 05:41:57 user nova-compute[75083]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 05:41:57 user nova-compute[75083]:           <distances>
Nov 29 05:41:57 user nova-compute[75083]:             <sibling id='0' value='20'/>
Nov 29 05:41:57 user nova-compute[75083]:             <sibling id='1' value='10'/>
Nov 29 05:41:57 user nova-compute[75083]:           </distances>
Nov 29 05:41:57 user nova-compute[75083]:           <cpus num='6'>
Nov 29 05:41:57 user nova-compute[75083]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 29 05:41:57 user nova-compute[75083]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 29 05:41:57 user nova-compute[75083]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 29 05:41:57 user nova-compute[75083]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 29 05:41:57 user nova-compute[75083]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 29 05:41:57 user nova-compute[75083]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 29 05:41:57 user nova-compute[75083]:           </cpus>
Nov 29 05:41:57 user nova-compute[75083]:         </cell>
Nov 29 05:41:57 user nova-compute[75083]:       </cells>
Nov 29 05:41:57 user nova-compute[75083]:     </topology>
Nov 29 05:41:57 user nova-compute[75083]:     <cache>
Nov 29 05:41:57 user nova-compute[75083]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 29 05:41:57 user nova-compute[75083]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 29 05:41:57 user nova-compute[75083]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 29 05:41:57 user nova-compute[75083]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 29 05:41:57 user nova-compute[75083]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 29 05:41:57 user nova-compute[75083]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 29 05:41:57 user nova-compute[75083]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 29 05:41:57 user nova-compute[75083]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 29 05:41:57 user nova-compute[75083]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 29 05:41:57 user nova-compute[75083]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 29 05:41:57 user nova-compute[75083]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 29 05:41:57 user nova-compute[75083]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 29 05:41:57 user nova-compute[75083]:     </cache>
Nov 29 05:41:57 user nova-compute[75083]:     <secmodel>
Nov 29 05:41:57 user nova-compute[75083]:       <model>apparmor</model>
Nov 29 05:41:57 user nova-compute[75083]:       <doi>0</doi>
Nov 29 05:41:57 user nova-compute[75083]:     </secmodel>
Nov 29 05:41:57 user nova-compute[75083]:     <secmodel>
Nov 29 05:41:57 user nova-compute[75083]:       <model>dac</model>
Nov 29 05:41:57 user nova-compute[75083]:       <doi>0</doi>
Nov 29 05:41:57 user nova-compute[75083]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 29 05:41:57 user nova-compute[75083]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 29 05:41:57 user nova-compute[75083]:     </secmodel>
Nov 29 05:41:57 user nova-compute[75083]:   </host>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='alpha'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>64</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>clipper</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='armv6l'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>32</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>spitz</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>nuri</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>kzm</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>sx1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>z2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>tosa</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>n810</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>n800</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>terrier</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>midway</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>microbit</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>verdex</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>highbank</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>akita</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>connex</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>collie</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='armv7l'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>32</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>spitz</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>nuri</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>kzm</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>sx1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>z2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>tosa</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>n810</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>n800</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>terrier</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>midway</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>microbit</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>verdex</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>highbank</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>akita</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>connex</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>collie</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='aarch64'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>64</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>spitz</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>nuri</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>kzm</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>sx1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>z2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>tosa</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>n810</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>n800</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>terrier</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>midway</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>microbit</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>verdex</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>raspi3b</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>highbank</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>akita</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>connex</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>collie</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <acpi default='on' toggle='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='cris'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>32</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='i686'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>32</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>isapc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>microvm</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='kvm'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <pae/>
Nov 29 05:41:57 user nova-compute[75083]:       <nonpae/>
Nov 29 05:41:57 user nova-compute[75083]:       <acpi default='on' toggle='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:       <apic default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='m68k'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>32</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>an5206</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>q800</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>next-cube</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='microblaze'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>32</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='microblazeel'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>32</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='mips'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>32</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='16'>malta</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='mipsel'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>32</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='16'>malta</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='mips64'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>64</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='16'>malta</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>pica61</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>magnum</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='mips64el'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>64</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='16'>malta</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>pica61</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>magnum</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='16'>boston</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='ppc'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>32</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mac99</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>40p</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>taihu</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='ppc64'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>64</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>taihu</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>40p</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mac99</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='ppc64le'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>64</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>taihu</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>40p</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>mac99</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='riscv32'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>32</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='8'>spike</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>opentitan</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='8'>virt</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='riscv64'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>64</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='8'>spike</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>shakti_c</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='8'>virt</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='s390x'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>64</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='sh4'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>32</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>shix</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>r2d</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='sh4eb'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>64</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>shix</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>r2d</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='sparc'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>32</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>SS-5</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>SS-20</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>LX</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>SS-4</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>SS-10</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>Voyager</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='sparc64'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>64</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>sun4u</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>niagara</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>sun4v</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='x86_64'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>64</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='1'>isapc</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>microvm</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='kvm'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <acpi default='on' toggle='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:       <apic default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='xtensa'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>32</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>sim</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>kc705</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>ml605</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>virt</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>lx200</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>lx60</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]:   <guest>
Nov 29 05:41:57 user nova-compute[75083]:     <os_type>hvm</os_type>
Nov 29 05:41:57 user nova-compute[75083]:     <arch name='xtensaeb'>
Nov 29 05:41:57 user nova-compute[75083]:       <wordsize>32</wordsize>
Nov 29 05:41:57 user nova-compute[75083]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='4'>sim</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>kc705</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>ml605</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>virt</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>lx200</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>lx60</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 05:41:57 user nova-compute[75083]:       <domain type='qemu'/>
Nov 29 05:41:57 user nova-compute[75083]:     </arch>
Nov 29 05:41:57 user nova-compute[75083]:     <features>
Nov 29 05:41:57 user nova-compute[75083]:       <cpuselection/>
Nov 29 05:41:57 user nova-compute[75083]:       <deviceboot/>
Nov 29 05:41:57 user nova-compute[75083]:       <disksnapshot default='on' toggle='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     </features>
Nov 29 05:41:57 user nova-compute[75083]:   </guest>
Nov 29 05:41:57 user nova-compute[75083]: </capabilities>
Nov 29 05:41:57 user nova-compute[75083]: 
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 29 05:41:57 user nova-compute[75083]: <domainCapabilities>
Nov 29 05:41:57 user nova-compute[75083]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 05:41:57 user nova-compute[75083]:   <domain>kvm</domain>
Nov 29 05:41:57 user nova-compute[75083]:   <machine>pc-q35-6.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:   <arch>i686</arch>
Nov 29 05:41:57 user nova-compute[75083]:   <vcpu max='288'/>
Nov 29 05:41:57 user nova-compute[75083]:   <iothreads supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:   <os supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:     <enum name='firmware'/>
Nov 29 05:41:57 user nova-compute[75083]:     <loader supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='type'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>rom</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>pflash</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='readonly'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>yes</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>no</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='secure'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>no</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </loader>
Nov 29 05:41:57 user nova-compute[75083]:   </os>
Nov 29 05:41:57 user nova-compute[75083]:   <cpu>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='host-passthrough' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='hostPassthroughMigratable'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>off</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='maximum' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='maximumMigratable'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>on</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>off</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='host-model' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <vendor>Intel</vendor>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ss'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='vmx'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='pcid'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='hypervisor'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='arat'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='umip'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='md-clear'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='stibp'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ssbd'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ibpb'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ibrs'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='amd-stibp'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='disable' name='erms'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='disable' name='lm'/>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='custom' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>qemu64</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>qemu32</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>phenom</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium3</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium2</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>n270</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>kvm64</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>kvm32</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>coreduo</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>core2duo</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>athlon</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Westmere</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Snowridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>SandyBridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Penryn</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G5</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G4</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G3</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G2</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G1</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Nehalem</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>IvyBridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Icelake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-Rome</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-Milan</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Dhyana</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cooperlake</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Conroe</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>486</model>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:   </cpu>
Nov 29 05:41:57 user nova-compute[75083]:   <memoryBacking supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:     <enum name='sourceType'>
Nov 29 05:41:57 user nova-compute[75083]:       <value>file</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>anonymous</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>memfd</value>
Nov 29 05:41:57 user nova-compute[75083]:     </enum>
Nov 29 05:41:57 user nova-compute[75083]:   </memoryBacking>
Nov 29 05:41:57 user nova-compute[75083]:   <devices>
Nov 29 05:41:57 user nova-compute[75083]:     <disk supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='diskDevice'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>disk</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>cdrom</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>floppy</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>lun</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='bus'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>fdc</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>scsi</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>usb</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>sata</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-non-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </disk>
Nov 29 05:41:57 user nova-compute[75083]:     <graphics supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='type'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>sdl</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vnc</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>spice</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>egl-headless</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </graphics>
Nov 29 05:41:57 user nova-compute[75083]:     <video supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='modelType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vga</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>cirrus</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vmvga</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>qxl</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>none</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>bochs</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>ramfb</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </video>
Nov 29 05:41:57 user nova-compute[75083]:     <hostdev supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='mode'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>subsystem</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='startupPolicy'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>default</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>mandatory</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>requisite</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>optional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='subsysType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>usb</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>pci</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>scsi</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='capsType'/>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='pciBackend'/>
Nov 29 05:41:57 user nova-compute[75083]:     </hostdev>
Nov 29 05:41:57 user nova-compute[75083]:     <rng supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-non-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='backendModel'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>random</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>egd</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>builtin</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </rng>
Nov 29 05:41:57 user nova-compute[75083]:     <filesystem supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='driverType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>path</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>handle</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtiofs</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </filesystem>
Nov 29 05:41:57 user nova-compute[75083]:     <tpm supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>tpm-tis</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>tpm-crb</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='backendModel'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>passthrough</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>emulator</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </tpm>
Nov 29 05:41:57 user nova-compute[75083]:   </devices>
Nov 29 05:41:57 user nova-compute[75083]:   <features>
Nov 29 05:41:57 user nova-compute[75083]:     <gic supported='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     <vmcoreinfo supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <genid supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <backingStoreInput supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <backup supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <sev supported='no'/>
Nov 29 05:41:57 user nova-compute[75083]:   </features>
Nov 29 05:41:57 user nova-compute[75083]: </domainCapabilities>
Nov 29 05:41:57 user nova-compute[75083]:  {{(pid=75083) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 29 05:41:57 user nova-compute[75083]: <domainCapabilities>
Nov 29 05:41:57 user nova-compute[75083]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 05:41:57 user nova-compute[75083]:   <domain>kvm</domain>
Nov 29 05:41:57 user nova-compute[75083]:   <machine>pc-i440fx-jammy</machine>
Nov 29 05:41:57 user nova-compute[75083]:   <arch>i686</arch>
Nov 29 05:41:57 user nova-compute[75083]:   <vcpu max='255'/>
Nov 29 05:41:57 user nova-compute[75083]:   <iothreads supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:   <os supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:     <enum name='firmware'/>
Nov 29 05:41:57 user nova-compute[75083]:     <loader supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='type'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>rom</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>pflash</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='readonly'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>yes</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>no</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='secure'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>no</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </loader>
Nov 29 05:41:57 user nova-compute[75083]:   </os>
Nov 29 05:41:57 user nova-compute[75083]:   <cpu>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='host-passthrough' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='hostPassthroughMigratable'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>off</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='maximum' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='maximumMigratable'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>on</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>off</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='host-model' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <vendor>Intel</vendor>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ss'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='vmx'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='pcid'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='hypervisor'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='arat'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='umip'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='md-clear'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='stibp'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ssbd'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ibpb'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ibrs'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='amd-stibp'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='disable' name='erms'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='disable' name='lm'/>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='custom' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>qemu64</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>qemu32</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>phenom</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium3</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium2</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>n270</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>kvm64</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>kvm32</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>coreduo</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>core2duo</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>athlon</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Westmere</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Snowridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>SandyBridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Penryn</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G5</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G4</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G3</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G2</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G1</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Nehalem</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>IvyBridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Icelake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-Rome</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-Milan</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Dhyana</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cooperlake</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Conroe</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>486</model>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:   </cpu>
Nov 29 05:41:57 user nova-compute[75083]:   <memoryBacking supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:     <enum name='sourceType'>
Nov 29 05:41:57 user nova-compute[75083]:       <value>file</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>anonymous</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>memfd</value>
Nov 29 05:41:57 user nova-compute[75083]:     </enum>
Nov 29 05:41:57 user nova-compute[75083]:   </memoryBacking>
Nov 29 05:41:57 user nova-compute[75083]:   <devices>
Nov 29 05:41:57 user nova-compute[75083]:     <disk supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='diskDevice'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>disk</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>cdrom</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>floppy</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>lun</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='bus'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>ide</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>fdc</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>scsi</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>usb</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>sata</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-non-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </disk>
Nov 29 05:41:57 user nova-compute[75083]:     <graphics supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='type'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>sdl</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vnc</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>spice</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>egl-headless</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </graphics>
Nov 29 05:41:57 user nova-compute[75083]:     <video supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='modelType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vga</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>cirrus</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vmvga</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>qxl</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>none</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>bochs</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>ramfb</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </video>
Nov 29 05:41:57 user nova-compute[75083]:     <hostdev supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='mode'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>subsystem</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='startupPolicy'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>default</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>mandatory</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>requisite</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>optional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='subsysType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>usb</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>pci</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>scsi</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='capsType'/>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='pciBackend'/>
Nov 29 05:41:57 user nova-compute[75083]:     </hostdev>
Nov 29 05:41:57 user nova-compute[75083]:     <rng supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-non-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='backendModel'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>random</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>egd</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>builtin</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </rng>
Nov 29 05:41:57 user nova-compute[75083]:     <filesystem supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='driverType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>path</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>handle</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtiofs</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </filesystem>
Nov 29 05:41:57 user nova-compute[75083]:     <tpm supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>tpm-tis</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>tpm-crb</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='backendModel'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>passthrough</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>emulator</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </tpm>
Nov 29 05:41:57 user nova-compute[75083]:   </devices>
Nov 29 05:41:57 user nova-compute[75083]:   <features>
Nov 29 05:41:57 user nova-compute[75083]:     <gic supported='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     <vmcoreinfo supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <genid supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <backingStoreInput supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <backup supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <sev supported='no'/>
Nov 29 05:41:57 user nova-compute[75083]:   </features>
Nov 29 05:41:57 user nova-compute[75083]: </domainCapabilities>
Nov 29 05:41:57 user nova-compute[75083]:  {{(pid=75083) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 29 05:41:57 user nova-compute[75083]: <domainCapabilities>
Nov 29 05:41:57 user nova-compute[75083]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 05:41:57 user nova-compute[75083]:   <domain>kvm</domain>
Nov 29 05:41:57 user nova-compute[75083]:   <machine>pc-q35-jammy</machine>
Nov 29 05:41:57 user nova-compute[75083]:   <arch>i686</arch>
Nov 29 05:41:57 user nova-compute[75083]:   <vcpu max='288'/>
Nov 29 05:41:57 user nova-compute[75083]:   <iothreads supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:   <os supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:     <enum name='firmware'/>
Nov 29 05:41:57 user nova-compute[75083]:     <loader supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='type'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>rom</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>pflash</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='readonly'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>yes</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>no</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='secure'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>no</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </loader>
Nov 29 05:41:57 user nova-compute[75083]:   </os>
Nov 29 05:41:57 user nova-compute[75083]:   <cpu>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='host-passthrough' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='hostPassthroughMigratable'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>off</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='maximum' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='maximumMigratable'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>on</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>off</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='host-model' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <vendor>Intel</vendor>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ss'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='vmx'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='pcid'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='hypervisor'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='arat'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='umip'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='md-clear'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='stibp'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ssbd'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ibpb'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ibrs'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='amd-stibp'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='disable' name='erms'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='disable' name='lm'/>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='custom' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>qemu64</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>qemu32</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>phenom</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium3</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium2</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>n270</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>kvm64</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>kvm32</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>coreduo</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>core2duo</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>athlon</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Westmere</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Snowridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>SandyBridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Penryn</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G5</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G4</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G3</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G2</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G1</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Nehalem</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>IvyBridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Icelake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-Rome</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-Milan</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Dhyana</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cooperlake</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Conroe</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>486</model>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:   </cpu>
Nov 29 05:41:57 user nova-compute[75083]:   <memoryBacking supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:     <enum name='sourceType'>
Nov 29 05:41:57 user nova-compute[75083]:       <value>file</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>anonymous</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>memfd</value>
Nov 29 05:41:57 user nova-compute[75083]:     </enum>
Nov 29 05:41:57 user nova-compute[75083]:   </memoryBacking>
Nov 29 05:41:57 user nova-compute[75083]:   <devices>
Nov 29 05:41:57 user nova-compute[75083]:     <disk supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='diskDevice'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>disk</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>cdrom</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>floppy</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>lun</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='bus'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>fdc</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>scsi</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>usb</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>sata</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-non-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </disk>
Nov 29 05:41:57 user nova-compute[75083]:     <graphics supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='type'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>sdl</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vnc</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>spice</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>egl-headless</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </graphics>
Nov 29 05:41:57 user nova-compute[75083]:     <video supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='modelType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vga</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>cirrus</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vmvga</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>qxl</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>none</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>bochs</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>ramfb</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </video>
Nov 29 05:41:57 user nova-compute[75083]:     <hostdev supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='mode'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>subsystem</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='startupPolicy'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>default</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>mandatory</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>requisite</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>optional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='subsysType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>usb</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>pci</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>scsi</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='capsType'/>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='pciBackend'/>
Nov 29 05:41:57 user nova-compute[75083]:     </hostdev>
Nov 29 05:41:57 user nova-compute[75083]:     <rng supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-non-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='backendModel'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>random</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>egd</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>builtin</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </rng>
Nov 29 05:41:57 user nova-compute[75083]:     <filesystem supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='driverType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>path</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>handle</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtiofs</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </filesystem>
Nov 29 05:41:57 user nova-compute[75083]:     <tpm supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>tpm-tis</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>tpm-crb</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='backendModel'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>passthrough</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>emulator</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </tpm>
Nov 29 05:41:57 user nova-compute[75083]:   </devices>
Nov 29 05:41:57 user nova-compute[75083]:   <features>
Nov 29 05:41:57 user nova-compute[75083]:     <gic supported='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     <vmcoreinfo supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <genid supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <backingStoreInput supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <backup supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <sev supported='no'/>
Nov 29 05:41:57 user nova-compute[75083]:   </features>
Nov 29 05:41:57 user nova-compute[75083]: </domainCapabilities>
Nov 29 05:41:57 user nova-compute[75083]:  {{(pid=75083) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 29 05:41:57 user nova-compute[75083]: <domainCapabilities>
Nov 29 05:41:57 user nova-compute[75083]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 05:41:57 user nova-compute[75083]:   <domain>kvm</domain>
Nov 29 05:41:57 user nova-compute[75083]:   <machine>pc-i440fx-6.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:   <arch>i686</arch>
Nov 29 05:41:57 user nova-compute[75083]:   <vcpu max='255'/>
Nov 29 05:41:57 user nova-compute[75083]:   <iothreads supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:   <os supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:     <enum name='firmware'/>
Nov 29 05:41:57 user nova-compute[75083]:     <loader supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='type'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>rom</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>pflash</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='readonly'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>yes</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>no</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='secure'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>no</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </loader>
Nov 29 05:41:57 user nova-compute[75083]:   </os>
Nov 29 05:41:57 user nova-compute[75083]:   <cpu>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='host-passthrough' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='hostPassthroughMigratable'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>off</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='maximum' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='maximumMigratable'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>on</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>off</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='host-model' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <vendor>Intel</vendor>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ss'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='vmx'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='pcid'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='hypervisor'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='arat'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='umip'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='md-clear'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='stibp'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ssbd'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ibpb'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ibrs'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='amd-stibp'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='disable' name='erms'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='disable' name='lm'/>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='custom' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>qemu64</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>qemu32</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>phenom</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium3</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium2</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>n270</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>kvm64</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>kvm32</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>coreduo</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>core2duo</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>athlon</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Westmere</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Snowridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>SandyBridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Penryn</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G5</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G4</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G3</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G2</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G1</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Nehalem</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>IvyBridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Icelake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-Rome</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-Milan</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Dhyana</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cooperlake</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Conroe</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>486</model>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:   </cpu>
Nov 29 05:41:57 user nova-compute[75083]:   <memoryBacking supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:     <enum name='sourceType'>
Nov 29 05:41:57 user nova-compute[75083]:       <value>file</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>anonymous</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>memfd</value>
Nov 29 05:41:57 user nova-compute[75083]:     </enum>
Nov 29 05:41:57 user nova-compute[75083]:   </memoryBacking>
Nov 29 05:41:57 user nova-compute[75083]:   <devices>
Nov 29 05:41:57 user nova-compute[75083]:     <disk supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='diskDevice'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>disk</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>cdrom</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>floppy</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>lun</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='bus'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>ide</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>fdc</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>scsi</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>usb</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>sata</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-non-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </disk>
Nov 29 05:41:57 user nova-compute[75083]:     <graphics supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='type'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>sdl</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vnc</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>spice</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>egl-headless</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </graphics>
Nov 29 05:41:57 user nova-compute[75083]:     <video supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='modelType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vga</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>cirrus</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vmvga</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>qxl</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>none</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>bochs</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>ramfb</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </video>
Nov 29 05:41:57 user nova-compute[75083]:     <hostdev supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='mode'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>subsystem</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='startupPolicy'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>default</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>mandatory</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>requisite</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>optional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='subsysType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>usb</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>pci</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>scsi</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='capsType'/>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='pciBackend'/>
Nov 29 05:41:57 user nova-compute[75083]:     </hostdev>
Nov 29 05:41:57 user nova-compute[75083]:     <rng supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-non-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='backendModel'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>random</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>egd</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>builtin</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </rng>
Nov 29 05:41:57 user nova-compute[75083]:     <filesystem supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='driverType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>path</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>handle</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtiofs</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </filesystem>
Nov 29 05:41:57 user nova-compute[75083]:     <tpm supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>tpm-tis</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>tpm-crb</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='backendModel'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>passthrough</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>emulator</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </tpm>
Nov 29 05:41:57 user nova-compute[75083]:   </devices>
Nov 29 05:41:57 user nova-compute[75083]:   <features>
Nov 29 05:41:57 user nova-compute[75083]:     <gic supported='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     <vmcoreinfo supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <genid supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <backingStoreInput supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <backup supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <sev supported='no'/>
Nov 29 05:41:57 user nova-compute[75083]:   </features>
Nov 29 05:41:57 user nova-compute[75083]: </domainCapabilities>
Nov 29 05:41:57 user nova-compute[75083]:  {{(pid=75083) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 29 05:41:57 user nova-compute[75083]: <domainCapabilities>
Nov 29 05:41:57 user nova-compute[75083]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 05:41:57 user nova-compute[75083]:   <domain>kvm</domain>
Nov 29 05:41:57 user nova-compute[75083]:   <machine>pc-q35-6.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:   <arch>x86_64</arch>
Nov 29 05:41:57 user nova-compute[75083]:   <vcpu max='288'/>
Nov 29 05:41:57 user nova-compute[75083]:   <iothreads supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:   <os supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:     <enum name='firmware'>
Nov 29 05:41:57 user nova-compute[75083]:       <value>efi</value>
Nov 29 05:41:57 user nova-compute[75083]:     </enum>
Nov 29 05:41:57 user nova-compute[75083]:     <loader supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='type'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>rom</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>pflash</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='readonly'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>yes</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>no</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='secure'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>yes</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>no</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </loader>
Nov 29 05:41:57 user nova-compute[75083]:   </os>
Nov 29 05:41:57 user nova-compute[75083]:   <cpu>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='host-passthrough' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='hostPassthroughMigratable'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>on</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>off</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='maximum' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='maximumMigratable'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>on</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>off</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='host-model' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <vendor>Intel</vendor>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ss'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='vmx'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='pcid'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='hypervisor'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='arat'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='umip'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='md-clear'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='stibp'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ssbd'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='invtsc'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ibpb'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ibrs'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='amd-stibp'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='rsba'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='disable' name='erms'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='custom' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>qemu64</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>qemu32</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>phenom</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium3</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium2</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>n270</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>kvm64</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>kvm32</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>coreduo</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>core2duo</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>athlon</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Westmere</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Snowridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>SandyBridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Penryn</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G5</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G4</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G3</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G2</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Opteron_G1</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Nehalem</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>IvyBridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Icelake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-Rome</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-Milan</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Dhyana</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cooperlake</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Conroe</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>486</model>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:   </cpu>
Nov 29 05:41:57 user nova-compute[75083]:   <memoryBacking supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:     <enum name='sourceType'>
Nov 29 05:41:57 user nova-compute[75083]:       <value>file</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>anonymous</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>memfd</value>
Nov 29 05:41:57 user nova-compute[75083]:     </enum>
Nov 29 05:41:57 user nova-compute[75083]:   </memoryBacking>
Nov 29 05:41:57 user nova-compute[75083]:   <devices>
Nov 29 05:41:57 user nova-compute[75083]:     <disk supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='diskDevice'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>disk</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>cdrom</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>floppy</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>lun</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='bus'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>fdc</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>scsi</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>usb</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>sata</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-non-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </disk>
Nov 29 05:41:57 user nova-compute[75083]:     <graphics supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='type'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>sdl</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vnc</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>spice</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>egl-headless</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </graphics>
Nov 29 05:41:57 user nova-compute[75083]:     <video supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='modelType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vga</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>cirrus</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vmvga</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>qxl</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>none</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>bochs</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>ramfb</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </video>
Nov 29 05:41:57 user nova-compute[75083]:     <hostdev supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='mode'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>subsystem</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='startupPolicy'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>default</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>mandatory</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>requisite</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>optional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='subsysType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>usb</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>pci</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>scsi</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='capsType'/>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='pciBackend'/>
Nov 29 05:41:57 user nova-compute[75083]:     </hostdev>
Nov 29 05:41:57 user nova-compute[75083]:     <rng supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-non-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='backendModel'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>random</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>egd</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>builtin</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </rng>
Nov 29 05:41:57 user nova-compute[75083]:     <filesystem supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='driverType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>path</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>handle</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtiofs</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </filesystem>
Nov 29 05:41:57 user nova-compute[75083]:     <tpm supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>tpm-tis</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>tpm-crb</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='backendModel'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>passthrough</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>emulator</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </tpm>
Nov 29 05:41:57 user nova-compute[75083]:   </devices>
Nov 29 05:41:57 user nova-compute[75083]:   <features>
Nov 29 05:41:57 user nova-compute[75083]:     <gic supported='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     <vmcoreinfo supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <genid supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <backingStoreInput supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <backup supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <sev supported='no'/>
Nov 29 05:41:57 user nova-compute[75083]:   </features>
Nov 29 05:41:57 user nova-compute[75083]: </domainCapabilities>
Nov 29 05:41:57 user nova-compute[75083]:  {{(pid=75083) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 29 05:41:57 user nova-compute[75083]: <domainCapabilities>
Nov 29 05:41:57 user nova-compute[75083]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 05:41:57 user nova-compute[75083]:   <domain>kvm</domain>
Nov 29 05:41:57 user nova-compute[75083]:   <machine>pc-i440fx-jammy</machine>
Nov 29 05:41:57 user nova-compute[75083]:   <arch>x86_64</arch>
Nov 29 05:41:57 user nova-compute[75083]:   <vcpu max='255'/>
Nov 29 05:41:57 user nova-compute[75083]:   <iothreads supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:   <os supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:     <enum name='firmware'>
Nov 29 05:41:57 user nova-compute[75083]:       <value>efi</value>
Nov 29 05:41:57 user nova-compute[75083]:     </enum>
Nov 29 05:41:57 user nova-compute[75083]:     <loader supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='type'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>rom</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>pflash</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='readonly'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>yes</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>no</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='secure'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>no</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </loader>
Nov 29 05:41:57 user nova-compute[75083]:   </os>
Nov 29 05:41:57 user nova-compute[75083]:   <cpu>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='host-passthrough' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='hostPassthroughMigratable'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>on</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>off</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='maximum' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='maximumMigratable'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>on</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>off</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='host-model' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <vendor>Intel</vendor>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ss'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='vmx'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='pcid'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='hypervisor'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='arat'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='umip'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='md-clear'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='stibp'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ssbd'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='invtsc'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ibpb'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ibrs'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='amd-stibp'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='rsba'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='disable' name='erms'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='custom' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>qemu64</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>qemu32</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>phenom</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium3</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium2</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>n270</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>kvm64</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>kvm32</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>coreduo</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>core2duo</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>athlon</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Westmere</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Snowridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>SandyBridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Penryn</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G5</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G4</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G3</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G2</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Opteron_G1</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Nehalem</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>IvyBridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Icelake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-Rome</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-Milan</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Dhyana</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cooperlake</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Conroe</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>486</model>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:   </cpu>
Nov 29 05:41:57 user nova-compute[75083]:   <memoryBacking supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:     <enum name='sourceType'>
Nov 29 05:41:57 user nova-compute[75083]:       <value>file</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>anonymous</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>memfd</value>
Nov 29 05:41:57 user nova-compute[75083]:     </enum>
Nov 29 05:41:57 user nova-compute[75083]:   </memoryBacking>
Nov 29 05:41:57 user nova-compute[75083]:   <devices>
Nov 29 05:41:57 user nova-compute[75083]:     <disk supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='diskDevice'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>disk</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>cdrom</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>floppy</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>lun</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='bus'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>ide</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>fdc</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>scsi</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>usb</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>sata</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-non-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </disk>
Nov 29 05:41:57 user nova-compute[75083]:     <graphics supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='type'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>sdl</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vnc</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>spice</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>egl-headless</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </graphics>
Nov 29 05:41:57 user nova-compute[75083]:     <video supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='modelType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vga</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>cirrus</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vmvga</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>qxl</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>none</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>bochs</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>ramfb</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </video>
Nov 29 05:41:57 user nova-compute[75083]:     <hostdev supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='mode'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>subsystem</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='startupPolicy'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>default</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>mandatory</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>requisite</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>optional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='subsysType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>usb</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>pci</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>scsi</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='capsType'/>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='pciBackend'/>
Nov 29 05:41:57 user nova-compute[75083]:     </hostdev>
Nov 29 05:41:57 user nova-compute[75083]:     <rng supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-non-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='backendModel'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>random</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>egd</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>builtin</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </rng>
Nov 29 05:41:57 user nova-compute[75083]:     <filesystem supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='driverType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>path</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>handle</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtiofs</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </filesystem>
Nov 29 05:41:57 user nova-compute[75083]:     <tpm supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>tpm-tis</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>tpm-crb</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='backendModel'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>passthrough</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>emulator</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </tpm>
Nov 29 05:41:57 user nova-compute[75083]:   </devices>
Nov 29 05:41:57 user nova-compute[75083]:   <features>
Nov 29 05:41:57 user nova-compute[75083]:     <gic supported='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     <vmcoreinfo supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <genid supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <backingStoreInput supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <backup supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <sev supported='no'/>
Nov 29 05:41:57 user nova-compute[75083]:   </features>
Nov 29 05:41:57 user nova-compute[75083]: </domainCapabilities>
Nov 29 05:41:57 user nova-compute[75083]:  {{(pid=75083) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 29 05:41:57 user nova-compute[75083]: <domainCapabilities>
Nov 29 05:41:57 user nova-compute[75083]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 05:41:57 user nova-compute[75083]:   <domain>kvm</domain>
Nov 29 05:41:57 user nova-compute[75083]:   <machine>pc-q35-jammy</machine>
Nov 29 05:41:57 user nova-compute[75083]:   <arch>x86_64</arch>
Nov 29 05:41:57 user nova-compute[75083]:   <vcpu max='288'/>
Nov 29 05:41:57 user nova-compute[75083]:   <iothreads supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:   <os supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:     <enum name='firmware'>
Nov 29 05:41:57 user nova-compute[75083]:       <value>efi</value>
Nov 29 05:41:57 user nova-compute[75083]:     </enum>
Nov 29 05:41:57 user nova-compute[75083]:     <loader supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='type'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>rom</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>pflash</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='readonly'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>yes</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>no</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='secure'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>yes</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>no</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </loader>
Nov 29 05:41:57 user nova-compute[75083]:   </os>
Nov 29 05:41:57 user nova-compute[75083]:   <cpu>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='host-passthrough' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='hostPassthroughMigratable'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>on</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>off</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='maximum' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='maximumMigratable'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>on</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>off</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='host-model' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <vendor>Intel</vendor>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ss'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='vmx'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='pcid'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='hypervisor'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='arat'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='umip'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='md-clear'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='stibp'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ssbd'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='invtsc'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ibpb'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ibrs'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='amd-stibp'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='rsba'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='disable' name='erms'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='custom' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>qemu64</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>qemu32</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>phenom</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium3</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium2</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>n270</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>kvm64</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>kvm32</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>coreduo</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>core2duo</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>athlon</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Westmere</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Snowridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>SandyBridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Penryn</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G5</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G4</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G3</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G2</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Opteron_G1</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Nehalem</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>IvyBridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Icelake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-Rome</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-Milan</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Dhyana</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cooperlake</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Conroe</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>486</model>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:   </cpu>
Nov 29 05:41:57 user nova-compute[75083]:   <memoryBacking supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:     <enum name='sourceType'>
Nov 29 05:41:57 user nova-compute[75083]:       <value>file</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>anonymous</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>memfd</value>
Nov 29 05:41:57 user nova-compute[75083]:     </enum>
Nov 29 05:41:57 user nova-compute[75083]:   </memoryBacking>
Nov 29 05:41:57 user nova-compute[75083]:   <devices>
Nov 29 05:41:57 user nova-compute[75083]:     <disk supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='diskDevice'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>disk</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>cdrom</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>floppy</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>lun</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='bus'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>fdc</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>scsi</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>usb</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>sata</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-non-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </disk>
Nov 29 05:41:57 user nova-compute[75083]:     <graphics supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='type'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>sdl</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vnc</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>spice</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>egl-headless</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </graphics>
Nov 29 05:41:57 user nova-compute[75083]:     <video supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='modelType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vga</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>cirrus</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vmvga</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>qxl</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>none</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>bochs</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>ramfb</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </video>
Nov 29 05:41:57 user nova-compute[75083]:     <hostdev supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='mode'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>subsystem</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='startupPolicy'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>default</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>mandatory</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>requisite</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>optional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='subsysType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>usb</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>pci</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>scsi</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='capsType'/>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='pciBackend'/>
Nov 29 05:41:57 user nova-compute[75083]:     </hostdev>
Nov 29 05:41:57 user nova-compute[75083]:     <rng supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-non-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='backendModel'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>random</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>egd</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>builtin</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </rng>
Nov 29 05:41:57 user nova-compute[75083]:     <filesystem supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='driverType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>path</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>handle</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtiofs</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </filesystem>
Nov 29 05:41:57 user nova-compute[75083]:     <tpm supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>tpm-tis</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>tpm-crb</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='backendModel'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>passthrough</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>emulator</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </tpm>
Nov 29 05:41:57 user nova-compute[75083]:   </devices>
Nov 29 05:41:57 user nova-compute[75083]:   <features>
Nov 29 05:41:57 user nova-compute[75083]:     <gic supported='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     <vmcoreinfo supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <genid supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <backingStoreInput supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <backup supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <sev supported='no'/>
Nov 29 05:41:57 user nova-compute[75083]:   </features>
Nov 29 05:41:57 user nova-compute[75083]: </domainCapabilities>
Nov 29 05:41:57 user nova-compute[75083]:  {{(pid=75083) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 29 05:41:57 user nova-compute[75083]: <domainCapabilities>
Nov 29 05:41:57 user nova-compute[75083]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 05:41:57 user nova-compute[75083]:   <domain>kvm</domain>
Nov 29 05:41:57 user nova-compute[75083]:   <machine>pc-i440fx-6.2</machine>
Nov 29 05:41:57 user nova-compute[75083]:   <arch>x86_64</arch>
Nov 29 05:41:57 user nova-compute[75083]:   <vcpu max='255'/>
Nov 29 05:41:57 user nova-compute[75083]:   <iothreads supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:   <os supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:     <enum name='firmware'>
Nov 29 05:41:57 user nova-compute[75083]:       <value>efi</value>
Nov 29 05:41:57 user nova-compute[75083]:     </enum>
Nov 29 05:41:57 user nova-compute[75083]:     <loader supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='type'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>rom</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>pflash</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='readonly'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>yes</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>no</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='secure'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>no</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </loader>
Nov 29 05:41:57 user nova-compute[75083]:   </os>
Nov 29 05:41:57 user nova-compute[75083]:   <cpu>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='host-passthrough' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='hostPassthroughMigratable'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>on</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>off</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='maximum' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='maximumMigratable'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>on</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>off</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='host-model' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <vendor>Intel</vendor>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ss'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='vmx'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='pcid'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='hypervisor'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='arat'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='umip'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='md-clear'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='stibp'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ssbd'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='invtsc'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ibpb'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='ibrs'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='amd-stibp'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='rsba'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='disable' name='erms'/>
Nov 29 05:41:57 user nova-compute[75083]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:     <mode name='custom' supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>qemu64</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>qemu32</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>phenom</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium3</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium2</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>pentium</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>n270</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>kvm64</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>kvm32</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>coreduo</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>core2duo</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>athlon</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Westmere</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Snowridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Skylake-Client</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>SandyBridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Penryn</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G5</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G4</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G3</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Opteron_G2</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Opteron_G1</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Nehalem</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>IvyBridge</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Icelake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Haswell</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-Rome</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-Milan</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>EPYC</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Dhyana</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cooperlake</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>Conroe</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='no'>Broadwell</model>
Nov 29 05:41:57 user nova-compute[75083]:       <model usable='yes'>486</model>
Nov 29 05:41:57 user nova-compute[75083]:     </mode>
Nov 29 05:41:57 user nova-compute[75083]:   </cpu>
Nov 29 05:41:57 user nova-compute[75083]:   <memoryBacking supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:     <enum name='sourceType'>
Nov 29 05:41:57 user nova-compute[75083]:       <value>file</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>anonymous</value>
Nov 29 05:41:57 user nova-compute[75083]:       <value>memfd</value>
Nov 29 05:41:57 user nova-compute[75083]:     </enum>
Nov 29 05:41:57 user nova-compute[75083]:   </memoryBacking>
Nov 29 05:41:57 user nova-compute[75083]:   <devices>
Nov 29 05:41:57 user nova-compute[75083]:     <disk supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='diskDevice'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>disk</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>cdrom</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>floppy</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>lun</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='bus'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>ide</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>fdc</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>scsi</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>usb</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>sata</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-non-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </disk>
Nov 29 05:41:57 user nova-compute[75083]:     <graphics supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='type'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>sdl</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vnc</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>spice</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>egl-headless</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </graphics>
Nov 29 05:41:57 user nova-compute[75083]:     <video supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='modelType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vga</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>cirrus</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>vmvga</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>qxl</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>none</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>bochs</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>ramfb</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </video>
Nov 29 05:41:57 user nova-compute[75083]:     <hostdev supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='mode'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>subsystem</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='startupPolicy'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>default</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>mandatory</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>requisite</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>optional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='subsysType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>usb</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>pci</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>scsi</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='capsType'/>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='pciBackend'/>
Nov 29 05:41:57 user nova-compute[75083]:     </hostdev>
Nov 29 05:41:57 user nova-compute[75083]:     <rng supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtio-non-transitional</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='backendModel'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>random</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>egd</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>builtin</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </rng>
Nov 29 05:41:57 user nova-compute[75083]:     <filesystem supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='driverType'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>path</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>handle</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>virtiofs</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </filesystem>
Nov 29 05:41:57 user nova-compute[75083]:     <tpm supported='yes'>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='model'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>tpm-tis</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>tpm-crb</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:       <enum name='backendModel'>
Nov 29 05:41:57 user nova-compute[75083]:         <value>passthrough</value>
Nov 29 05:41:57 user nova-compute[75083]:         <value>emulator</value>
Nov 29 05:41:57 user nova-compute[75083]:       </enum>
Nov 29 05:41:57 user nova-compute[75083]:     </tpm>
Nov 29 05:41:57 user nova-compute[75083]:   </devices>
Nov 29 05:41:57 user nova-compute[75083]:   <features>
Nov 29 05:41:57 user nova-compute[75083]:     <gic supported='no'/>
Nov 29 05:41:57 user nova-compute[75083]:     <vmcoreinfo supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <genid supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <backingStoreInput supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <backup supported='yes'/>
Nov 29 05:41:57 user nova-compute[75083]:     <sev supported='no'/>
Nov 29 05:41:57 user nova-compute[75083]:   </features>
Nov 29 05:41:57 user nova-compute[75083]: </domainCapabilities>
Nov 29 05:41:57 user nova-compute[75083]:  {{(pid=75083) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75083) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75083) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Checking secure boot support for host arch (x86_64) {{(pid=75083) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 05:41:57 user nova-compute[75083]: INFO nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Secure Boot support detected
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] cpu compare xml: <cpu match="exact">
Nov 29 05:41:57 user nova-compute[75083]:   <model>Nehalem</model>
Nov 29 05:41:57 user nova-compute[75083]: </cpu>
Nov 29 05:41:57 user nova-compute[75083]:  {{(pid=75083) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 29 05:41:57 user nova-compute[75083]: INFO nova.virt.node [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Generated node identity 8aaf783a-f9f1-4872-9f20-91f33ff1e95c
Nov 29 05:41:57 user nova-compute[75083]: INFO nova.virt.node [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Wrote node identity 8aaf783a-f9f1-4872-9f20-91f33ff1e95c to /opt/stack/data/nova/compute_id
Nov 29 05:41:57 user nova-compute[75083]: WARNING nova.compute.manager [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Compute nodes ['8aaf783a-f9f1-4872-9f20-91f33ff1e95c'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 29 05:41:57 user nova-compute[75083]: INFO nova.compute.manager [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 29 05:41:57 user nova-compute[75083]: WARNING nova.compute.manager [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 05:41:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:41:57 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 05:41:58 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:41:58 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:41:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Hypervisor/Node resource view: name=user free_ram=10926MB free_disk=26.1744384765625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 05:41:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:41:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:41:58 user nova-compute[75083]: WARNING nova.compute.resource_tracker [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] No compute node record for user:8aaf783a-f9f1-4872-9f20-91f33ff1e95c: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 8aaf783a-f9f1-4872-9f20-91f33ff1e95c could not be found.
Nov 29 05:41:58 user nova-compute[75083]: INFO nova.compute.resource_tracker [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Compute node record created for user:user with uuid: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c
Nov 29 05:41:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 05:41:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 05:41:58 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] [req-44e3ea68-4dd4-4fe8-bf04-42f473a10382] Created resource provider record via placement API for resource provider with UUID 8aaf783a-f9f1-4872-9f20-91f33ff1e95c and name user.
Nov 29 05:41:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75083) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 29 05:41:58 user nova-compute[75083]: INFO nova.virt.libvirt.host [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] kernel doesn't support AMD SEV
Nov 29 05:41:58 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Updating inventory in ProviderTree for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 05:41:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:41:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Libvirt baseline CPU <cpu>
Nov 29 05:41:58 user nova-compute[75083]:   <arch>x86_64</arch>
Nov 29 05:41:58 user nova-compute[75083]:   <model>Nehalem</model>
Nov 29 05:41:58 user nova-compute[75083]:   <vendor>Intel</vendor>
Nov 29 05:41:58 user nova-compute[75083]:   <topology sockets="6" cores="1" threads="1"/>
Nov 29 05:41:58 user nova-compute[75083]: </cpu>
Nov 29 05:41:58 user nova-compute[75083]:  {{(pid=75083) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 29 05:41:58 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Updated inventory for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 29 05:41:58 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Updating resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c generation from 0 to 1 during operation: update_inventory {{(pid=75083) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 05:41:58 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Updating inventory in ProviderTree for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 05:41:58 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Updating resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c generation from 1 to 2 during operation: update_traits {{(pid=75083) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 05:41:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 05:41:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.685s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:41:58 user nova-compute[75083]: DEBUG nova.service [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Creating RPC server for service compute {{(pid=75083) start /opt/stack/nova/nova/service.py:182}}
Nov 29 05:41:58 user nova-compute[75083]: DEBUG nova.service [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] Join ServiceGroup membership for this service compute {{(pid=75083) start /opt/stack/nova/nova/service.py:199}}
Nov 29 05:41:58 user nova-compute[75083]: DEBUG nova.servicegroup.drivers.db [None req-8e2dcb31-080f-42e5-8921-854dbd7acec5 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75083) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 29 05:42:35 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:42:35 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 05:42:49 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:42:49 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:42:49 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=10370MB free_disk=26.07811737060547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 05:42:49 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 05:42:50 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:42:50 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:42:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 05:42:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:43:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:43:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:43:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:43:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:43:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:43:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:43:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 05:43:50 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:43:50 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:43:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=10316MB free_disk=26.14311981201172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 05:43:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:43:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:43:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 05:43:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 05:43:50 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:43:50 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:43:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 05:43:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:43:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:43:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:43:50 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 05:43:50 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 05:43:50 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 05:43:51 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:43:51 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:43:51 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:43:51 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:43:51 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:43:51 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 05:44:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:44:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:44:50 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 05:44:50 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 05:44:50 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 05:44:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:44:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:44:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:44:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:44:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:44:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 05:44:50 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:44:50 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:44:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=10315MB free_disk=25.895050048828125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 05:44:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:44:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:44:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 05:44:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 05:44:51 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:44:51 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:44:51 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 05:44:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:44:52 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:44:52 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:44:52 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:44:52 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:44:52 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:44:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 05:45:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:45:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:45:50 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 05:45:50 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 05:45:50 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 05:45:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:45:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:45:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:45:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:45:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:45:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 05:45:50 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:45:50 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:45:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=9624MB free_disk=25.924121856689453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 05:45:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:45:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:45:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 05:45:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 05:45:51 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:45:51 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:45:51 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 05:45:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:45:53 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:45:53 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:45:53 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:45:53 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:45:54 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:45:54 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:45:54 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 05:46:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "e6d49806-cecd-473a-b92f-9255868d35c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:01 user nova-compute[75083]: DEBUG nova.compute.manager [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:46:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:02 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:46:02 user nova-compute[75083]: INFO nova.compute.claims [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Claim successful on node user
Nov 29 05:46:02 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:46:02 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:46:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:02 user nova-compute[75083]: DEBUG nova.compute.manager [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:46:02 user nova-compute[75083]: DEBUG nova.compute.manager [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:46:02 user nova-compute[75083]: DEBUG nova.network.neutron [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:46:02 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:46:02 user nova-compute[75083]: DEBUG nova.compute.manager [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:46:02 user nova-compute[75083]: DEBUG nova.compute.manager [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:46:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:46:02 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Creating image(s)
Nov 29 05:46:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "/opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "/opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a.part --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:03 user nova-compute[75083]: DEBUG nova.policy [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25f2d92aba5c4069b94b8a5cd8b72a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c1cb7a503b446f945f12b3b998035b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:46:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a.part --force-share --output=json" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:03 user nova-compute[75083]: DEBUG nova.virt.images [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] 0c1e50f1-5043-4598-be6f-f50133dc7439 was qcow2, converting to raw {{(pid=75083) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 05:46:03 user nova-compute[75083]: DEBUG nova.privsep.utils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75083) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 05:46:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a.part /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a.converted {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a.part /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a.converted" returned: 0 in 0.352s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a.converted --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.478s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:04 user nova-compute[75083]: INFO oslo.privsep.daemon [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6eartxf_/privsep.sock']
Nov 29 05:46:04 user sudo[84362]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6eartxf_/privsep.sock
Nov 29 05:46:04 user sudo[84362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 05:46:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Acquiring lock "303f0c67-e197-4d49-b131-8c99d50d7fe1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "303f0c67-e197-4d49-b131-8c99d50d7fe1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:04 user nova-compute[75083]: DEBUG nova.compute.manager [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:46:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:04 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:46:04 user nova-compute[75083]: INFO nova.compute.claims [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Claim successful on node user
Nov 29 05:46:05 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:46:05 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:46:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:05 user nova-compute[75083]: DEBUG nova.compute.manager [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:46:05 user nova-compute[75083]: DEBUG nova.compute.manager [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:46:05 user nova-compute[75083]: DEBUG nova.network.neutron [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:46:05 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:46:05 user nova-compute[75083]: DEBUG nova.compute.manager [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:46:05 user nova-compute[75083]: DEBUG nova.policy [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58f6a378692741b0a63926ada864137c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e318e045fa44629111941384871983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:46:05 user nova-compute[75083]: DEBUG nova.compute.manager [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:46:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:46:05 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Creating image(s)
Nov 29 05:46:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Acquiring lock "/opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "/opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "/opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:05 user nova-compute[75083]: DEBUG nova.network.neutron [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Successfully created port: 1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:46:05 user sudo[84362]: pam_unix(sudo:session): session closed for user root
Nov 29 05:46:05 user nova-compute[75083]: INFO oslo.privsep.daemon [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Spawned new privsep daemon via rootwrap
Nov 29 05:46:05 user nova-compute[75083]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 05:46:05 user nova-compute[75083]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 05:46:05 user nova-compute[75083]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 29 05:46:05 user nova-compute[75083]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84365
Nov 29 05:46:05 user nova-compute[75083]: WARNING oslo_privsep.priv_context [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] privsep daemon already running
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.166s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.167s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.168s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1/disk 1073741824" returned: 0 in 0.045s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.218s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.164s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Checking if we can resize image /opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.413s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Cannot resize image /opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Ensure instance console log exists: /opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk 1073741824" returned: 0 in 0.070s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.492s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.156s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG nova.compute.manager [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Cannot resize image /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Ensure instance console log exists: /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:46:07 user nova-compute[75083]: INFO nova.compute.claims [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Claim successful on node user
Nov 29 05:46:07 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG nova.network.neutron [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Successfully created port: 344d545f-7d42-4750-ae3d-30a3ad813148 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.291s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG nova.compute.manager [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG nova.compute.manager [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG nova.network.neutron [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:46:07 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:46:07 user nova-compute[75083]: DEBUG nova.compute.manager [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG nova.compute.manager [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:46:07 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Creating image(s)
Nov 29 05:46:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "/opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "/opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG nova.policy [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28d78f6409074549a9353312300b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd625d0d60faf4a4f9073df250039f58b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:46:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.168s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk 1073741824" returned: 0 in 0.042s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.162s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:08 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:46:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:08 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Cannot resize image /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:46:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:46:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Ensure instance console log exists: /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:46:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:09 user nova-compute[75083]: DEBUG nova.network.neutron [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Successfully updated port: 1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:46:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:46:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquired lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:46:09 user nova-compute[75083]: DEBUG nova.network.neutron [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:46:09 user nova-compute[75083]: DEBUG nova.network.neutron [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:46:09 user nova-compute[75083]: DEBUG nova.compute.manager [req-603f43a2-0806-459f-a943-84182d46ff2f req-02f62506-58a0-439a-8c16-f193f4ede9be service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received event network-changed-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:09 user nova-compute[75083]: DEBUG nova.compute.manager [req-603f43a2-0806-459f-a943-84182d46ff2f req-02f62506-58a0-439a-8c16-f193f4ede9be service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Refreshing instance network info cache due to event network-changed-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:46:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-603f43a2-0806-459f-a943-84182d46ff2f req-02f62506-58a0-439a-8c16-f193f4ede9be service nova] Acquiring lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.network.neutron [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Updating instance_info_cache with network_info: [{"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Releasing lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.compute.manager [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Instance network_info: |[{"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-603f43a2-0806-459f-a943-84182d46ff2f req-02f62506-58a0-439a-8c16-f193f4ede9be service nova] Acquired lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.network.neutron [req-603f43a2-0806-459f-a943-84182d46ff2f req-02f62506-58a0-439a-8c16-f193f4ede9be service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Refreshing network info cache for port 1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Start _get_guest_xml network_info=[{"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:46:10 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:46:10 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.privsep.utils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75083) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1653680976',display_name='tempest-AttachVolumeTestJSON-server-1653680976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1653680976',id=1,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOJP1hrn9YscfxvgIeV/wzeq3iJtsHPsw4UYwsBDpY8QrDAnobm8WRbnfZio9s2zPze+QLzStURV3KhLmNcFlFIYVxh1xHzL9FnGoRwL1BjeWphRTOqz9jLnn2TEGffsg==',key_name='tempest-keypair-1515818350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4c1cb7a503b446f945f12b3b998035b',ramdisk_id='',reservation_id='r-50iyzeul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1539985865',owner_user_name='tempest-AttachVolumeTestJSON-1539985865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f2d92aba5c4069b94b8a5cd8b72a46',uuid=e6d49806-cecd-473a-b92f-9255868d35c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converting VIF {"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.objects.instance [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'pci_devices' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:46:10 user nova-compute[75083]:   <uuid>e6d49806-cecd-473a-b92f-9255868d35c7</uuid>
Nov 29 05:46:10 user nova-compute[75083]:   <name>instance-00000001</name>
Nov 29 05:46:10 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:46:10 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:46:10 user nova-compute[75083]:   <metadata>
Nov 29 05:46:10 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:46:10 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:46:10 user nova-compute[75083]:       <nova:name>tempest-AttachVolumeTestJSON-server-1653680976</nova:name>
Nov 29 05:46:10 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:46:10</nova:creationTime>
Nov 29 05:46:10 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:46:10 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:46:10 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:46:10 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:46:10 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:46:10 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:46:10 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:46:10 user nova-compute[75083]:       <nova:owner>
Nov 29 05:46:10 user nova-compute[75083]:         <nova:user uuid="25f2d92aba5c4069b94b8a5cd8b72a46">tempest-AttachVolumeTestJSON-1539985865-project-member</nova:user>
Nov 29 05:46:10 user nova-compute[75083]:         <nova:project uuid="c4c1cb7a503b446f945f12b3b998035b">tempest-AttachVolumeTestJSON-1539985865</nova:project>
Nov 29 05:46:10 user nova-compute[75083]:       </nova:owner>
Nov 29 05:46:10 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:46:10 user nova-compute[75083]:       <nova:ports>
Nov 29 05:46:10 user nova-compute[75083]:         <nova:port uuid="1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0">
Nov 29 05:46:10 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 05:46:10 user nova-compute[75083]:         </nova:port>
Nov 29 05:46:10 user nova-compute[75083]:       </nova:ports>
Nov 29 05:46:10 user nova-compute[75083]:     </nova:instance>
Nov 29 05:46:10 user nova-compute[75083]:   </metadata>
Nov 29 05:46:10 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:46:10 user nova-compute[75083]:     <system>
Nov 29 05:46:10 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:46:10 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:46:10 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:46:10 user nova-compute[75083]:       <entry name="serial">e6d49806-cecd-473a-b92f-9255868d35c7</entry>
Nov 29 05:46:10 user nova-compute[75083]:       <entry name="uuid">e6d49806-cecd-473a-b92f-9255868d35c7</entry>
Nov 29 05:46:10 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:46:10 user nova-compute[75083]:     </system>
Nov 29 05:46:10 user nova-compute[75083]:   </sysinfo>
Nov 29 05:46:10 user nova-compute[75083]:   <os>
Nov 29 05:46:10 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:46:10 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:46:10 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:46:10 user nova-compute[75083]:   </os>
Nov 29 05:46:10 user nova-compute[75083]:   <features>
Nov 29 05:46:10 user nova-compute[75083]:     <acpi/>
Nov 29 05:46:10 user nova-compute[75083]:     <apic/>
Nov 29 05:46:10 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:46:10 user nova-compute[75083]:   </features>
Nov 29 05:46:10 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:46:10 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:46:10 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:46:10 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:46:10 user nova-compute[75083]:   </clock>
Nov 29 05:46:10 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:46:10 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:46:10 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:46:10 user nova-compute[75083]:   </cpu>
Nov 29 05:46:10 user nova-compute[75083]:   <devices>
Nov 29 05:46:10 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:46:10 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:46:10 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk"/>
Nov 29 05:46:10 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:46:10 user nova-compute[75083]:     </disk>
Nov 29 05:46:10 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:46:10 user nova-compute[75083]:       <mac address="fa:16:3e:7a:b6:78"/>
Nov 29 05:46:10 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:46:10 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:46:10 user nova-compute[75083]:       <target dev="tap1ec74c9e-a1"/>
Nov 29 05:46:10 user nova-compute[75083]:     </interface>
Nov 29 05:46:10 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:46:10 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/console.log" append="off"/>
Nov 29 05:46:10 user nova-compute[75083]:     </serial>
Nov 29 05:46:10 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:46:10 user nova-compute[75083]:     <video>
Nov 29 05:46:10 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:46:10 user nova-compute[75083]:     </video>
Nov 29 05:46:10 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:46:10 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:46:10 user nova-compute[75083]:     </rng>
Nov 29 05:46:10 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:46:10 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:46:10 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:46:10 user nova-compute[75083]:     </memballoon>
Nov 29 05:46:10 user nova-compute[75083]:   </devices>
Nov 29 05:46:10 user nova-compute[75083]: </domain>
Nov 29 05:46:10 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1653680976',display_name='tempest-AttachVolumeTestJSON-server-1653680976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1653680976',id=1,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOJP1hrn9YscfxvgIeV/wzeq3iJtsHPsw4UYwsBDpY8QrDAnobm8WRbnfZio9s2zPze+QLzStURV3KhLmNcFlFIYVxh1xHzL9FnGoRwL1BjeWphRTOqz9jLnn2TEGffsg==',key_name='tempest-keypair-1515818350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4c1cb7a503b446f945f12b3b998035b',ramdisk_id='',reservation_id='r-50iyzeul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1539985865',owner_user_name='tempest-AttachVolumeTestJSON-1539985865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f2d92aba5c4069b94b8a5cd8b72a46',uuid=e6d49806-cecd-473a-b92f-9255868d35c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converting VIF {"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG os_vif [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Created schema index Interface.name {{(pid=75083) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Created schema index Port.name {{(pid=75083) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Created schema index Bridge.name {{(pid=75083) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [POLLOUT] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05a6127a-48f5-5d96-ae49-756bfea79ee2', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:46:10 user nova-compute[75083]: INFO oslo.privsep.daemon [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpd1ejxr1f/privsep.sock']
Nov 29 05:46:10 user sudo[84440]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpd1ejxr1f/privsep.sock
Nov 29 05:46:10 user sudo[84440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.network.neutron [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Successfully updated port: 344d545f-7d42-4750-ae3d-30a3ad813148 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Acquiring lock "refresh_cache-303f0c67-e197-4d49-b131-8c99d50d7fe1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Acquired lock "refresh_cache-303f0c67-e197-4d49-b131-8c99d50d7fe1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.network.neutron [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:46:10 user nova-compute[75083]: DEBUG nova.network.neutron [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Successfully created port: b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:46:11 user nova-compute[75083]: DEBUG nova.network.neutron [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:46:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "47437526-c4e4-4a15-ba9b-51bbae17c77b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:11 user nova-compute[75083]: DEBUG nova.compute.manager [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:46:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:46:11 user nova-compute[75083]: INFO nova.compute.claims [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Claim successful on node user
Nov 29 05:46:11 user nova-compute[75083]: DEBUG nova.compute.manager [req-443014a4-05aa-4492-9def-40ecc03e07fa req-2d78acdc-f644-412e-98c4-a2c9a390668e service nova] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Received event network-changed-344d545f-7d42-4750-ae3d-30a3ad813148 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:11 user nova-compute[75083]: DEBUG nova.compute.manager [req-443014a4-05aa-4492-9def-40ecc03e07fa req-2d78acdc-f644-412e-98c4-a2c9a390668e service nova] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Refreshing instance network info cache due to event network-changed-344d545f-7d42-4750-ae3d-30a3ad813148. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:46:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-443014a4-05aa-4492-9def-40ecc03e07fa req-2d78acdc-f644-412e-98c4-a2c9a390668e service nova] Acquiring lock "refresh_cache-303f0c67-e197-4d49-b131-8c99d50d7fe1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:46:11 user nova-compute[75083]: DEBUG nova.network.neutron [req-603f43a2-0806-459f-a943-84182d46ff2f req-02f62506-58a0-439a-8c16-f193f4ede9be service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Updated VIF entry in instance network info cache for port 1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:46:11 user nova-compute[75083]: DEBUG nova.network.neutron [req-603f43a2-0806-459f-a943-84182d46ff2f req-02f62506-58a0-439a-8c16-f193f4ede9be service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Updating instance_info_cache with network_info: [{"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:46:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-603f43a2-0806-459f-a943-84182d46ff2f req-02f62506-58a0-439a-8c16-f193f4ede9be service nova] Releasing lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:46:11 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:46:11 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:46:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:11 user nova-compute[75083]: DEBUG nova.compute.manager [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:46:11 user sudo[84440]: pam_unix(sudo:session): session closed for user root
Nov 29 05:46:11 user nova-compute[75083]: DEBUG nova.network.neutron [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Updating instance_info_cache with network_info: [{"id": "344d545f-7d42-4750-ae3d-30a3ad813148", "address": "fa:16:3e:81:bd:94", "network": {"id": "a9af19ff-0d4a-44f2-bf46-87edaef88f2d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1807000996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e318e045fa44629111941384871983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344d545f-7d", "ovs_interfaceid": "344d545f-7d42-4750-ae3d-30a3ad813148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:46:11 user nova-compute[75083]: INFO oslo.privsep.daemon [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Spawned new privsep daemon via rootwrap
Nov 29 05:46:11 user nova-compute[75083]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 05:46:12 user nova-compute[75083]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 05:46:12 user nova-compute[75083]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 29 05:46:12 user nova-compute[75083]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84444
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.network.neutron [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:46:12 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Releasing lock "refresh_cache-303f0c67-e197-4d49-b131-8c99d50d7fe1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Instance network_info: |[{"id": "344d545f-7d42-4750-ae3d-30a3ad813148", "address": "fa:16:3e:81:bd:94", "network": {"id": "a9af19ff-0d4a-44f2-bf46-87edaef88f2d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1807000996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e318e045fa44629111941384871983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344d545f-7d", "ovs_interfaceid": "344d545f-7d42-4750-ae3d-30a3ad813148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-443014a4-05aa-4492-9def-40ecc03e07fa req-2d78acdc-f644-412e-98c4-a2c9a390668e service nova] Acquired lock "refresh_cache-303f0c67-e197-4d49-b131-8c99d50d7fe1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.network.neutron [req-443014a4-05aa-4492-9def-40ecc03e07fa req-2d78acdc-f644-412e-98c4-a2c9a390668e service nova] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Refreshing network info cache for port 344d545f-7d42-4750-ae3d-30a3ad813148 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Start _get_guest_xml network_info=[{"id": "344d545f-7d42-4750-ae3d-30a3ad813148", "address": "fa:16:3e:81:bd:94", "network": {"id": "a9af19ff-0d4a-44f2-bf46-87edaef88f2d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1807000996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e318e045fa44629111941384871983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344d545f-7d", "ovs_interfaceid": "344d545f-7d42-4750-ae3d-30a3ad813148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:46:12 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:46:12 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1400391578',display_name='tempest-DeleteServersTestJSON-server-1400391578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1400391578',id=2,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93e318e045fa44629111941384871983',ramdisk_id='',reservation_id='r-yjvg60tb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1212515133',owner_user_name='tempest-DeleteServersTestJSON-1212515133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:46:05Z,user_data=None,user_id='58f6a378692741b0a63926ada864137c',uuid=303f0c67-e197-4d49-b131-8c99d50d7fe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "344d545f-7d42-4750-ae3d-30a3ad813148", "address": "fa:16:3e:81:bd:94", "network": {"id": "a9af19ff-0d4a-44f2-bf46-87edaef88f2d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1807000996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e318e045fa44629111941384871983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344d545f-7d", "ovs_interfaceid": "344d545f-7d42-4750-ae3d-30a3ad813148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Converting VIF {"id": "344d545f-7d42-4750-ae3d-30a3ad813148", "address": "fa:16:3e:81:bd:94", "network": {"id": "a9af19ff-0d4a-44f2-bf46-87edaef88f2d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1807000996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e318e045fa44629111941384871983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344d545f-7d", "ovs_interfaceid": "344d545f-7d42-4750-ae3d-30a3ad813148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:bd:94,bridge_name='br-int',has_traffic_filtering=True,id=344d545f-7d42-4750-ae3d-30a3ad813148,network=Network(a9af19ff-0d4a-44f2-bf46-87edaef88f2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap344d545f-7d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.objects.instance [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lazy-loading 'pci_devices' on Instance uuid 303f0c67-e197-4d49-b131-8c99d50d7fe1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:46:12 user nova-compute[75083]:   <uuid>303f0c67-e197-4d49-b131-8c99d50d7fe1</uuid>
Nov 29 05:46:12 user nova-compute[75083]:   <name>instance-00000002</name>
Nov 29 05:46:12 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:46:12 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:46:12 user nova-compute[75083]:   <metadata>
Nov 29 05:46:12 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:46:12 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:46:12 user nova-compute[75083]:       <nova:name>tempest-DeleteServersTestJSON-server-1400391578</nova:name>
Nov 29 05:46:12 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:46:12</nova:creationTime>
Nov 29 05:46:12 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:46:12 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:46:12 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:46:12 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:46:12 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:46:12 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:46:12 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:46:12 user nova-compute[75083]:       <nova:owner>
Nov 29 05:46:12 user nova-compute[75083]:         <nova:user uuid="58f6a378692741b0a63926ada864137c">tempest-DeleteServersTestJSON-1212515133-project-member</nova:user>
Nov 29 05:46:12 user nova-compute[75083]:         <nova:project uuid="93e318e045fa44629111941384871983">tempest-DeleteServersTestJSON-1212515133</nova:project>
Nov 29 05:46:12 user nova-compute[75083]:       </nova:owner>
Nov 29 05:46:12 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:46:12 user nova-compute[75083]:       <nova:ports>
Nov 29 05:46:12 user nova-compute[75083]:         <nova:port uuid="344d545f-7d42-4750-ae3d-30a3ad813148">
Nov 29 05:46:12 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 05:46:12 user nova-compute[75083]:         </nova:port>
Nov 29 05:46:12 user nova-compute[75083]:       </nova:ports>
Nov 29 05:46:12 user nova-compute[75083]:     </nova:instance>
Nov 29 05:46:12 user nova-compute[75083]:   </metadata>
Nov 29 05:46:12 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:46:12 user nova-compute[75083]:     <system>
Nov 29 05:46:12 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:46:12 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:46:12 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:46:12 user nova-compute[75083]:       <entry name="serial">303f0c67-e197-4d49-b131-8c99d50d7fe1</entry>
Nov 29 05:46:12 user nova-compute[75083]:       <entry name="uuid">303f0c67-e197-4d49-b131-8c99d50d7fe1</entry>
Nov 29 05:46:12 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:46:12 user nova-compute[75083]:     </system>
Nov 29 05:46:12 user nova-compute[75083]:   </sysinfo>
Nov 29 05:46:12 user nova-compute[75083]:   <os>
Nov 29 05:46:12 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:46:12 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:46:12 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:46:12 user nova-compute[75083]:   </os>
Nov 29 05:46:12 user nova-compute[75083]:   <features>
Nov 29 05:46:12 user nova-compute[75083]:     <acpi/>
Nov 29 05:46:12 user nova-compute[75083]:     <apic/>
Nov 29 05:46:12 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:46:12 user nova-compute[75083]:   </features>
Nov 29 05:46:12 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:46:12 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:46:12 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:46:12 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:46:12 user nova-compute[75083]:   </clock>
Nov 29 05:46:12 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:46:12 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:46:12 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:46:12 user nova-compute[75083]:   </cpu>
Nov 29 05:46:12 user nova-compute[75083]:   <devices>
Nov 29 05:46:12 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:46:12 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:46:12 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1/disk"/>
Nov 29 05:46:12 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:46:12 user nova-compute[75083]:     </disk>
Nov 29 05:46:12 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:46:12 user nova-compute[75083]:       <mac address="fa:16:3e:81:bd:94"/>
Nov 29 05:46:12 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:46:12 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:46:12 user nova-compute[75083]:       <target dev="tap344d545f-7d"/>
Nov 29 05:46:12 user nova-compute[75083]:     </interface>
Nov 29 05:46:12 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:46:12 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1/console.log" append="off"/>
Nov 29 05:46:12 user nova-compute[75083]:     </serial>
Nov 29 05:46:12 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:46:12 user nova-compute[75083]:     <video>
Nov 29 05:46:12 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:46:12 user nova-compute[75083]:     </video>
Nov 29 05:46:12 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:46:12 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:46:12 user nova-compute[75083]:     </rng>
Nov 29 05:46:12 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:46:12 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:46:12 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:46:12 user nova-compute[75083]:     </memballoon>
Nov 29 05:46:12 user nova-compute[75083]:   </devices>
Nov 29 05:46:12 user nova-compute[75083]: </domain>
Nov 29 05:46:12 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1400391578',display_name='tempest-DeleteServersTestJSON-server-1400391578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1400391578',id=2,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93e318e045fa44629111941384871983',ramdisk_id='',reservation_id='r-yjvg60tb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1212515133',owner_user_name='tempest-DeleteServersTestJSON-1212515133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:46:05Z,user_data=None,user_id='58f6a378692741b0a63926ada864137c',uuid=303f0c67-e197-4d49-b131-8c99d50d7fe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "344d545f-7d42-4750-ae3d-30a3ad813148", "address": "fa:16:3e:81:bd:94", "network": {"id": "a9af19ff-0d4a-44f2-bf46-87edaef88f2d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1807000996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e318e045fa44629111941384871983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344d545f-7d", "ovs_interfaceid": "344d545f-7d42-4750-ae3d-30a3ad813148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Converting VIF {"id": "344d545f-7d42-4750-ae3d-30a3ad813148", "address": "fa:16:3e:81:bd:94", "network": {"id": "a9af19ff-0d4a-44f2-bf46-87edaef88f2d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1807000996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e318e045fa44629111941384871983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344d545f-7d", "ovs_interfaceid": "344d545f-7d42-4750-ae3d-30a3ad813148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:bd:94,bridge_name='br-int',has_traffic_filtering=True,id=344d545f-7d42-4750-ae3d-30a3ad813148,network=Network(a9af19ff-0d4a-44f2-bf46-87edaef88f2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap344d545f-7d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG os_vif [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:bd:94,bridge_name='br-int',has_traffic_filtering=True,id=344d545f-7d42-4750-ae3d-30a3ad813148,network=Network(a9af19ff-0d4a-44f2-bf46-87edaef88f2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap344d545f-7d') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd2326c5-f3f8-5467-97f9-8da6af085a9b', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.policy [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4e6b7adfb1b469ab5c6c3f26633272a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c63c54083f4a0eba38539e7c196d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:46:12 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Creating image(s)
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "/opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "/opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "/opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "161c6455-90ce-4c40-a33e-7f582989135d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "161c6455-90ce-4c40-a33e-7f582989135d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ec74c9e-a1, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ec74c9e-a1, col_values=(('qos', UUID('882a86d0-d2dc-448e-b4e3-8aac231959dc')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ec74c9e-a1, col_values=(('external_ids', {'iface-id': '1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:b6:78', 'vm-uuid': 'e6d49806-cecd-473a-b92f-9255868d35c7'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:12 user nova-compute[75083]: INFO os_vif [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1')
Nov 29 05:46:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap344d545f-7d, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap344d545f-7d, col_values=(('qos', UUID('e09aa9ce-674e-4144-ad24-f5a1cd1f2ad1')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap344d545f-7d, col_values=(('external_ids', {'iface-id': '344d545f-7d42-4750-ae3d-30a3ad813148', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:bd:94', 'vm-uuid': '303f0c67-e197-4d49-b131-8c99d50d7fe1'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk 1073741824" returned: 0 in 0.063s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:12 user nova-compute[75083]: INFO os_vif [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:bd:94,bridge_name='br-int',has_traffic_filtering=True,id=344d545f-7d42-4750-ae3d-30a3ad813148,network=Network(a9af19ff-0d4a-44f2-bf46-87edaef88f2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap344d545f-7d')
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:46:12 user nova-compute[75083]: INFO nova.compute.claims [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Claim successful on node user
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] No VIF found with MAC fa:16:3e:7a:b6:78, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] No VIF found with MAC fa:16:3e:81:bd:94, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:46:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Cannot resize image /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Ensure instance console log exists: /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG nova.network.neutron [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Successfully updated port: b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquired lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG nova.network.neutron [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG nova.network.neutron [req-443014a4-05aa-4492-9def-40ecc03e07fa req-2d78acdc-f644-412e-98c4-a2c9a390668e service nova] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Updated VIF entry in instance network info cache for port 344d545f-7d42-4750-ae3d-30a3ad813148. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG nova.network.neutron [req-443014a4-05aa-4492-9def-40ecc03e07fa req-2d78acdc-f644-412e-98c4-a2c9a390668e service nova] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Updating instance_info_cache with network_info: [{"id": "344d545f-7d42-4750-ae3d-30a3ad813148", "address": "fa:16:3e:81:bd:94", "network": {"id": "a9af19ff-0d4a-44f2-bf46-87edaef88f2d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1807000996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e318e045fa44629111941384871983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344d545f-7d", "ovs_interfaceid": "344d545f-7d42-4750-ae3d-30a3ad813148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-443014a4-05aa-4492-9def-40ecc03e07fa req-2d78acdc-f644-412e-98c4-a2c9a390668e service nova] Releasing lock "refresh_cache-303f0c67-e197-4d49-b131-8c99d50d7fe1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG nova.compute.manager [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG nova.compute.manager [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG nova.network.neutron [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:46:13 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:46:13 user nova-compute[75083]: DEBUG nova.compute.manager [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG nova.compute.manager [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:46:13 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Creating image(s)
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "/opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "/opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "/opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG nova.network.neutron [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG nova.compute.manager [req-ead60106-3016-4eac-89b2-49d4804e4082 req-b6262ab0-cac8-41ce-9d2c-c76b9bf77f64 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received event network-changed-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG nova.compute.manager [req-ead60106-3016-4eac-89b2-49d4804e4082 req-b6262ab0-cac8-41ce-9d2c-c76b9bf77f64 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Refreshing instance network info cache due to event network-changed-b4ddf4bb-5def-4760-8d1b-f020942dedf8. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ead60106-3016-4eac-89b2-49d4804e4082 req-b6262ab0-cac8-41ce-9d2c-c76b9bf77f64 service nova] Acquiring lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG nova.policy [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbd7f863ad7c4229957c4b08601b5003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d0f3dd09bf436498e67d7bfdd904bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.187s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.159s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk 1073741824" returned: 0 in 0.068s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Checking if we can resize image /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Cannot resize image /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Ensure instance console log exists: /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.network.neutron [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Updating instance_info_cache with network_info: [{"id": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "address": "fa:16:3e:76:b7:47", "network": {"id": "0e6492fc-5e8d-4df7-8fac-2da472312c4d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d625d0d60faf4a4f9073df250039f58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ddf4bb-5d", "ovs_interfaceid": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Releasing lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.compute.manager [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Instance network_info: |[{"id": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "address": "fa:16:3e:76:b7:47", "network": {"id": "0e6492fc-5e8d-4df7-8fac-2da472312c4d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d625d0d60faf4a4f9073df250039f58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ddf4bb-5d", "ovs_interfaceid": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ead60106-3016-4eac-89b2-49d4804e4082 req-b6262ab0-cac8-41ce-9d2c-c76b9bf77f64 service nova] Acquired lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.network.neutron [req-ead60106-3016-4eac-89b2-49d4804e4082 req-b6262ab0-cac8-41ce-9d2c-c76b9bf77f64 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Refreshing network info cache for port b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Start _get_guest_xml network_info=[{"id": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "address": "fa:16:3e:76:b7:47", "network": {"id": "0e6492fc-5e8d-4df7-8fac-2da472312c4d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d625d0d60faf4a4f9073df250039f58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ddf4bb-5d", "ovs_interfaceid": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:46:14 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:46:14 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.network.neutron [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Successfully created port: 8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-826292306',display_name='tempest-ServerStableDeviceRescueTest-server-826292306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-826292306',id=3,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4Ued3iPzzbMe5P8yCCDECsXfcv5JHNAjhap4DZX0mLVVlTdbfXR6zFoeLnVJJxMXZB04R5Xe0j2RaI5pk8Yj72peIfQZXhFvMw9aBrNBt/3KF1NAc6raVZ7kAtojg42A==',key_name='tempest-keypair-1498054763',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d625d0d60faf4a4f9073df250039f58b',ramdisk_id='',reservation_id='r-20ynrj0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1148285851',owner_user_name='tempest-ServerStableDeviceRescueTest-1148285851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28d78f6409074549a9353312300b041b',uuid=ee1bba24-17d0-4fc3-8bff-1337d86cc9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "address": "fa:16:3e:76:b7:47", "network": {"id": "0e6492fc-5e8d-4df7-8fac-2da472312c4d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d625d0d60faf4a4f9073df250039f58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ddf4bb-5d", "ovs_interfaceid": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Converting VIF {"id": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "address": "fa:16:3e:76:b7:47", "network": {"id": "0e6492fc-5e8d-4df7-8fac-2da472312c4d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d625d0d60faf4a4f9073df250039f58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ddf4bb-5d", "ovs_interfaceid": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:b7:47,bridge_name='br-int',has_traffic_filtering=True,id=b4ddf4bb-5def-4760-8d1b-f020942dedf8,network=Network(0e6492fc-5e8d-4df7-8fac-2da472312c4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ddf4bb-5d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.objects.instance [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lazy-loading 'pci_devices' on Instance uuid ee1bba24-17d0-4fc3-8bff-1337d86cc9be {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:46:14 user nova-compute[75083]:   <uuid>ee1bba24-17d0-4fc3-8bff-1337d86cc9be</uuid>
Nov 29 05:46:14 user nova-compute[75083]:   <name>instance-00000003</name>
Nov 29 05:46:14 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:46:14 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:46:14 user nova-compute[75083]:   <metadata>
Nov 29 05:46:14 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:46:14 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:46:14 user nova-compute[75083]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-826292306</nova:name>
Nov 29 05:46:14 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:46:14</nova:creationTime>
Nov 29 05:46:14 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:46:14 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:46:14 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:46:14 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:46:14 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:46:14 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:46:14 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:46:14 user nova-compute[75083]:       <nova:owner>
Nov 29 05:46:14 user nova-compute[75083]:         <nova:user uuid="28d78f6409074549a9353312300b041b">tempest-ServerStableDeviceRescueTest-1148285851-project-member</nova:user>
Nov 29 05:46:14 user nova-compute[75083]:         <nova:project uuid="d625d0d60faf4a4f9073df250039f58b">tempest-ServerStableDeviceRescueTest-1148285851</nova:project>
Nov 29 05:46:14 user nova-compute[75083]:       </nova:owner>
Nov 29 05:46:14 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:46:14 user nova-compute[75083]:       <nova:ports>
Nov 29 05:46:14 user nova-compute[75083]:         <nova:port uuid="b4ddf4bb-5def-4760-8d1b-f020942dedf8">
Nov 29 05:46:14 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 05:46:14 user nova-compute[75083]:         </nova:port>
Nov 29 05:46:14 user nova-compute[75083]:       </nova:ports>
Nov 29 05:46:14 user nova-compute[75083]:     </nova:instance>
Nov 29 05:46:14 user nova-compute[75083]:   </metadata>
Nov 29 05:46:14 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:46:14 user nova-compute[75083]:     <system>
Nov 29 05:46:14 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:46:14 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:46:14 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:46:14 user nova-compute[75083]:       <entry name="serial">ee1bba24-17d0-4fc3-8bff-1337d86cc9be</entry>
Nov 29 05:46:14 user nova-compute[75083]:       <entry name="uuid">ee1bba24-17d0-4fc3-8bff-1337d86cc9be</entry>
Nov 29 05:46:14 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:46:14 user nova-compute[75083]:     </system>
Nov 29 05:46:14 user nova-compute[75083]:   </sysinfo>
Nov 29 05:46:14 user nova-compute[75083]:   <os>
Nov 29 05:46:14 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:46:14 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:46:14 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:46:14 user nova-compute[75083]:   </os>
Nov 29 05:46:14 user nova-compute[75083]:   <features>
Nov 29 05:46:14 user nova-compute[75083]:     <acpi/>
Nov 29 05:46:14 user nova-compute[75083]:     <apic/>
Nov 29 05:46:14 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:46:14 user nova-compute[75083]:   </features>
Nov 29 05:46:14 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:46:14 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:46:14 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:46:14 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:46:14 user nova-compute[75083]:   </clock>
Nov 29 05:46:14 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:46:14 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:46:14 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:46:14 user nova-compute[75083]:   </cpu>
Nov 29 05:46:14 user nova-compute[75083]:   <devices>
Nov 29 05:46:14 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:46:14 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:46:14 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk"/>
Nov 29 05:46:14 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:46:14 user nova-compute[75083]:     </disk>
Nov 29 05:46:14 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:46:14 user nova-compute[75083]:       <mac address="fa:16:3e:76:b7:47"/>
Nov 29 05:46:14 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:46:14 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:46:14 user nova-compute[75083]:       <target dev="tapb4ddf4bb-5d"/>
Nov 29 05:46:14 user nova-compute[75083]:     </interface>
Nov 29 05:46:14 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:46:14 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/console.log" append="off"/>
Nov 29 05:46:14 user nova-compute[75083]:     </serial>
Nov 29 05:46:14 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:46:14 user nova-compute[75083]:     <video>
Nov 29 05:46:14 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:46:14 user nova-compute[75083]:     </video>
Nov 29 05:46:14 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:46:14 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:46:14 user nova-compute[75083]:     </rng>
Nov 29 05:46:14 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:46:14 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:46:14 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:46:14 user nova-compute[75083]:     </memballoon>
Nov 29 05:46:14 user nova-compute[75083]:   </devices>
Nov 29 05:46:14 user nova-compute[75083]: </domain>
Nov 29 05:46:14 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-826292306',display_name='tempest-ServerStableDeviceRescueTest-server-826292306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-826292306',id=3,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4Ued3iPzzbMe5P8yCCDECsXfcv5JHNAjhap4DZX0mLVVlTdbfXR6zFoeLnVJJxMXZB04R5Xe0j2RaI5pk8Yj72peIfQZXhFvMw9aBrNBt/3KF1NAc6raVZ7kAtojg42A==',key_name='tempest-keypair-1498054763',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d625d0d60faf4a4f9073df250039f58b',ramdisk_id='',reservation_id='r-20ynrj0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1148285851',owner_user_name='tempest-ServerStableDeviceRescueTest-1148285851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28d78f6409074549a9353312300b041b',uuid=ee1bba24-17d0-4fc3-8bff-1337d86cc9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "address": "fa:16:3e:76:b7:47", "network": {"id": "0e6492fc-5e8d-4df7-8fac-2da472312c4d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d625d0d60faf4a4f9073df250039f58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ddf4bb-5d", "ovs_interfaceid": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Converting VIF {"id": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "address": "fa:16:3e:76:b7:47", "network": {"id": "0e6492fc-5e8d-4df7-8fac-2da472312c4d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d625d0d60faf4a4f9073df250039f58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ddf4bb-5d", "ovs_interfaceid": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:b7:47,bridge_name='br-int',has_traffic_filtering=True,id=b4ddf4bb-5def-4760-8d1b-f020942dedf8,network=Network(0e6492fc-5e8d-4df7-8fac-2da472312c4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ddf4bb-5d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG os_vif [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:b7:47,bridge_name='br-int',has_traffic_filtering=True,id=b4ddf4bb-5def-4760-8d1b-f020942dedf8,network=Network(0e6492fc-5e8d-4df7-8fac-2da472312c4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ddf4bb-5d') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a676c3a-2b0e-574a-80c3-60737e46a0db', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4ddf4bb-5d, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4ddf4bb-5d, col_values=(('qos', UUID('40fb3e39-fde6-41c7-8417-e3e28fc48798')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4ddf4bb-5d, col_values=(('external_ids', {'iface-id': 'b4ddf4bb-5def-4760-8d1b-f020942dedf8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:b7:47', 'vm-uuid': 'ee1bba24-17d0-4fc3-8bff-1337d86cc9be'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:14 user nova-compute[75083]: INFO os_vif [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:b7:47,bridge_name='br-int',has_traffic_filtering=True,id=b4ddf4bb-5def-4760-8d1b-f020942dedf8,network=Network(0e6492fc-5e8d-4df7-8fac-2da472312c4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ddf4bb-5d')
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:46:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] No VIF found with MAC fa:16:3e:76:b7:47, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:46:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:15 user nova-compute[75083]: DEBUG nova.network.neutron [req-ead60106-3016-4eac-89b2-49d4804e4082 req-b6262ab0-cac8-41ce-9d2c-c76b9bf77f64 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Updated VIF entry in instance network info cache for port b4ddf4bb-5def-4760-8d1b-f020942dedf8. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:46:15 user nova-compute[75083]: DEBUG nova.network.neutron [req-ead60106-3016-4eac-89b2-49d4804e4082 req-b6262ab0-cac8-41ce-9d2c-c76b9bf77f64 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Updating instance_info_cache with network_info: [{"id": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "address": "fa:16:3e:76:b7:47", "network": {"id": "0e6492fc-5e8d-4df7-8fac-2da472312c4d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d625d0d60faf4a4f9073df250039f58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ddf4bb-5d", "ovs_interfaceid": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:46:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ead60106-3016-4eac-89b2-49d4804e4082 req-b6262ab0-cac8-41ce-9d2c-c76b9bf77f64 service nova] Releasing lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:46:16 user nova-compute[75083]: DEBUG nova.network.neutron [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Successfully created port: 188d4866-21b0-4a1e-a17a-c0c82e849726 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:46:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:17 user nova-compute[75083]: DEBUG nova.network.neutron [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Successfully updated port: 8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:46:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:46:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquired lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:46:17 user nova-compute[75083]: DEBUG nova.network.neutron [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:46:17 user nova-compute[75083]: DEBUG nova.compute.manager [req-fc01a185-c7df-45b9-90d4-44aac758a9e1 req-87fe3db0-b142-4892-abc4-f6571e385d36 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received event network-changed-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:17 user nova-compute[75083]: DEBUG nova.compute.manager [req-fc01a185-c7df-45b9-90d4-44aac758a9e1 req-87fe3db0-b142-4892-abc4-f6571e385d36 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Refreshing instance network info cache due to event network-changed-8c103582-6856-45ff-ac2b-7a30d3138c75. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:46:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fc01a185-c7df-45b9-90d4-44aac758a9e1 req-87fe3db0-b142-4892-abc4-f6571e385d36 service nova] Acquiring lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:46:17 user nova-compute[75083]: DEBUG nova.network.neutron [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:46:18 user nova-compute[75083]: DEBUG nova.compute.manager [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:46:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:46:18 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Instance spawned successfully.
Nov 29 05:46:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:46:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:18 user nova-compute[75083]: INFO nova.compute.manager [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Took 13.04 seconds to spawn the instance on the hypervisor.
Nov 29 05:46:18 user nova-compute[75083]: DEBUG nova.compute.manager [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:46:18 user nova-compute[75083]: INFO nova.compute.manager [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Took 13.88 seconds to build instance.
Nov 29 05:46:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-49cd5e00-7b16-4ade-9c50-2cf9c32a53d0 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "303f0c67-e197-4d49-b131-8c99d50d7fe1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.052s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:18 user nova-compute[75083]: DEBUG nova.network.neutron [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Updating instance_info_cache with network_info: [{"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:46:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Releasing lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:46:18 user nova-compute[75083]: DEBUG nova.compute.manager [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Instance network_info: |[{"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:46:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fc01a185-c7df-45b9-90d4-44aac758a9e1 req-87fe3db0-b142-4892-abc4-f6571e385d36 service nova] Acquired lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:46:18 user nova-compute[75083]: DEBUG nova.network.neutron [req-fc01a185-c7df-45b9-90d4-44aac758a9e1 req-87fe3db0-b142-4892-abc4-f6571e385d36 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Refreshing network info cache for port 8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:46:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Start _get_guest_xml network_info=[{"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:46:19 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:46:19 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.compute.manager [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.compute.manager [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-265924046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-265924046',id=4,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9NfR5g6BHWgn8iHt68HXMvMqojnsSO+GsTi9O2T9R8+QSKnFuCWKp/x2ygTv5FkO6YZWsNIF2DV0Sb3TLFZytdS0uwbMQGN94Yb7Idf4fw6TKFh/TgmCvwWzSqCHn5Tw==',key_name='tempest-keypair-1939493904',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1c63c54083f4a0eba38539e7c196d61',ramdisk_id='',reservation_id='r-1epz6053',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-961204558',owner_user_name='tempest-AttachVolumeShelveTestJSON-961204558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:46:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4e6b7adfb1b469ab5c6c3f26633272a',uuid=47437526-c4e4-4a15-ba9b-51bbae17c77b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converting VIF {"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:74:88,bridge_name='br-int',has_traffic_filtering=True,id=8c103582-6856-45ff-ac2b-7a30d3138c75,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c103582-68') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.objects.instance [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'pci_devices' on Instance uuid 47437526-c4e4-4a15-ba9b-51bbae17c77b {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:46:19 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Instance spawned successfully.
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:46:19 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Instance spawned successfully.
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:46:19 user nova-compute[75083]:   <uuid>47437526-c4e4-4a15-ba9b-51bbae17c77b</uuid>
Nov 29 05:46:19 user nova-compute[75083]:   <name>instance-00000004</name>
Nov 29 05:46:19 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:46:19 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:46:19 user nova-compute[75083]:   <metadata>
Nov 29 05:46:19 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:46:19 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:46:19 user nova-compute[75083]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-265924046</nova:name>
Nov 29 05:46:19 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:46:19</nova:creationTime>
Nov 29 05:46:19 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:46:19 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:46:19 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:46:19 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:46:19 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:46:19 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:46:19 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:46:19 user nova-compute[75083]:       <nova:owner>
Nov 29 05:46:19 user nova-compute[75083]:         <nova:user uuid="e4e6b7adfb1b469ab5c6c3f26633272a">tempest-AttachVolumeShelveTestJSON-961204558-project-member</nova:user>
Nov 29 05:46:19 user nova-compute[75083]:         <nova:project uuid="d1c63c54083f4a0eba38539e7c196d61">tempest-AttachVolumeShelveTestJSON-961204558</nova:project>
Nov 29 05:46:19 user nova-compute[75083]:       </nova:owner>
Nov 29 05:46:19 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:46:19 user nova-compute[75083]:       <nova:ports>
Nov 29 05:46:19 user nova-compute[75083]:         <nova:port uuid="8c103582-6856-45ff-ac2b-7a30d3138c75">
Nov 29 05:46:19 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 05:46:19 user nova-compute[75083]:         </nova:port>
Nov 29 05:46:19 user nova-compute[75083]:       </nova:ports>
Nov 29 05:46:19 user nova-compute[75083]:     </nova:instance>
Nov 29 05:46:19 user nova-compute[75083]:   </metadata>
Nov 29 05:46:19 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:46:19 user nova-compute[75083]:     <system>
Nov 29 05:46:19 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:46:19 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:46:19 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:46:19 user nova-compute[75083]:       <entry name="serial">47437526-c4e4-4a15-ba9b-51bbae17c77b</entry>
Nov 29 05:46:19 user nova-compute[75083]:       <entry name="uuid">47437526-c4e4-4a15-ba9b-51bbae17c77b</entry>
Nov 29 05:46:19 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:46:19 user nova-compute[75083]:     </system>
Nov 29 05:46:19 user nova-compute[75083]:   </sysinfo>
Nov 29 05:46:19 user nova-compute[75083]:   <os>
Nov 29 05:46:19 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:46:19 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:46:19 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:46:19 user nova-compute[75083]:   </os>
Nov 29 05:46:19 user nova-compute[75083]:   <features>
Nov 29 05:46:19 user nova-compute[75083]:     <acpi/>
Nov 29 05:46:19 user nova-compute[75083]:     <apic/>
Nov 29 05:46:19 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:46:19 user nova-compute[75083]:   </features>
Nov 29 05:46:19 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:46:19 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:46:19 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:46:19 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:46:19 user nova-compute[75083]:   </clock>
Nov 29 05:46:19 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:46:19 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:46:19 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:46:19 user nova-compute[75083]:   </cpu>
Nov 29 05:46:19 user nova-compute[75083]:   <devices>
Nov 29 05:46:19 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:46:19 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:46:19 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk"/>
Nov 29 05:46:19 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:46:19 user nova-compute[75083]:     </disk>
Nov 29 05:46:19 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:46:19 user nova-compute[75083]:       <mac address="fa:16:3e:bd:74:88"/>
Nov 29 05:46:19 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:46:19 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:46:19 user nova-compute[75083]:       <target dev="tap8c103582-68"/>
Nov 29 05:46:19 user nova-compute[75083]:     </interface>
Nov 29 05:46:19 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:46:19 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/console.log" append="off"/>
Nov 29 05:46:19 user nova-compute[75083]:     </serial>
Nov 29 05:46:19 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:46:19 user nova-compute[75083]:     <video>
Nov 29 05:46:19 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:46:19 user nova-compute[75083]:     </video>
Nov 29 05:46:19 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:46:19 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:46:19 user nova-compute[75083]:     </rng>
Nov 29 05:46:19 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:46:19 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:46:19 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:46:19 user nova-compute[75083]:     </memballoon>
Nov 29 05:46:19 user nova-compute[75083]:   </devices>
Nov 29 05:46:19 user nova-compute[75083]: </domain>
Nov 29 05:46:19 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-265924046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-265924046',id=4,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9NfR5g6BHWgn8iHt68HXMvMqojnsSO+GsTi9O2T9R8+QSKnFuCWKp/x2ygTv5FkO6YZWsNIF2DV0Sb3TLFZytdS0uwbMQGN94Yb7Idf4fw6TKFh/TgmCvwWzSqCHn5Tw==',key_name='tempest-keypair-1939493904',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1c63c54083f4a0eba38539e7c196d61',ramdisk_id='',reservation_id='r-1epz6053',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-961204558',owner_user_name='tempest-AttachVolumeShelveTestJSON-961204558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:46:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4e6b7adfb1b469ab5c6c3f26633272a',uuid=47437526-c4e4-4a15-ba9b-51bbae17c77b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converting VIF {"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:74:88,bridge_name='br-int',has_traffic_filtering=True,id=8c103582-6856-45ff-ac2b-7a30d3138c75,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c103582-68') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG os_vif [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:74:88,bridge_name='br-int',has_traffic_filtering=True,id=8c103582-6856-45ff-ac2b-7a30d3138c75,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c103582-68') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac3c5f32-3dd7-5470-a8d8-555a2ba0df83', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c103582-68, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c103582-68, col_values=(('qos', UUID('273eb747-7af6-46fd-9c57-621599b54ef3')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c103582-68, col_values=(('external_ids', {'iface-id': '8c103582-6856-45ff-ac2b-7a30d3138c75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:74:88', 'vm-uuid': '47437526-c4e4-4a15-ba9b-51bbae17c77b'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:19 user nova-compute[75083]: INFO os_vif [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:74:88,bridge_name='br-int',has_traffic_filtering=True,id=8c103582-6856-45ff-ac2b-7a30d3138c75,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c103582-68')
Nov 29 05:46:19 user nova-compute[75083]: INFO nova.compute.manager [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Took 11.58 seconds to spawn the instance on the hypervisor.
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.compute.manager [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:46:19 user nova-compute[75083]: INFO nova.compute.manager [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Took 16.63 seconds to spawn the instance on the hypervisor.
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.compute.manager [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] No VIF found with MAC fa:16:3e:bd:74:88, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:46:19 user nova-compute[75083]: INFO nova.compute.manager [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Took 12.32 seconds to build instance.
Nov 29 05:46:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-76ad5f31-7c94-46cb-81ba-881c24120b54 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.499s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:19 user nova-compute[75083]: INFO nova.compute.manager [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Took 17.90 seconds to build instance.
Nov 29 05:46:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-965e31cf-c4fd-4952-8ca7-4d71bcb2e81f tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "e6d49806-cecd-473a-b92f-9255868d35c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.148s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.network.neutron [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Successfully updated port: 188d4866-21b0-4a1e-a17a-c0c82e849726 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquired lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.network.neutron [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.compute.manager [req-797bfab4-8027-405e-845c-f092856bfdf1 req-7f08a2fd-cca5-4347-8b1d-386bb193b84d service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Received event network-changed-188d4866-21b0-4a1e-a17a-c0c82e849726 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG nova.compute.manager [req-797bfab4-8027-405e-845c-f092856bfdf1 req-7f08a2fd-cca5-4347-8b1d-386bb193b84d service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Refreshing instance network info cache due to event network-changed-188d4866-21b0-4a1e-a17a-c0c82e849726. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:46:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-797bfab4-8027-405e-845c-f092856bfdf1 req-7f08a2fd-cca5-4347-8b1d-386bb193b84d service nova] Acquiring lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:46:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:20 user nova-compute[75083]: DEBUG nova.network.neutron [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:46:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:21 user nova-compute[75083]: DEBUG nova.network.neutron [req-fc01a185-c7df-45b9-90d4-44aac758a9e1 req-87fe3db0-b142-4892-abc4-f6571e385d36 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Updated VIF entry in instance network info cache for port 8c103582-6856-45ff-ac2b-7a30d3138c75. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:46:21 user nova-compute[75083]: DEBUG nova.network.neutron [req-fc01a185-c7df-45b9-90d4-44aac758a9e1 req-87fe3db0-b142-4892-abc4-f6571e385d36 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Updating instance_info_cache with network_info: [{"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:46:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fc01a185-c7df-45b9-90d4-44aac758a9e1 req-87fe3db0-b142-4892-abc4-f6571e385d36 service nova] Releasing lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:46:21 user nova-compute[75083]: DEBUG nova.compute.manager [req-a33daab6-828c-4799-916a-f574878c562c req-5ca53042-8254-49b0-96e7-7f1113e736ce service nova] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Received event network-vif-plugged-344d545f-7d42-4750-ae3d-30a3ad813148 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a33daab6-828c-4799-916a-f574878c562c req-5ca53042-8254-49b0-96e7-7f1113e736ce service nova] Acquiring lock "303f0c67-e197-4d49-b131-8c99d50d7fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a33daab6-828c-4799-916a-f574878c562c req-5ca53042-8254-49b0-96e7-7f1113e736ce service nova] Lock "303f0c67-e197-4d49-b131-8c99d50d7fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a33daab6-828c-4799-916a-f574878c562c req-5ca53042-8254-49b0-96e7-7f1113e736ce service nova] Lock "303f0c67-e197-4d49-b131-8c99d50d7fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:21 user nova-compute[75083]: DEBUG nova.compute.manager [req-a33daab6-828c-4799-916a-f574878c562c req-5ca53042-8254-49b0-96e7-7f1113e736ce service nova] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] No waiting events found dispatching network-vif-plugged-344d545f-7d42-4750-ae3d-30a3ad813148 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:46:21 user nova-compute[75083]: WARNING nova.compute.manager [req-a33daab6-828c-4799-916a-f574878c562c req-5ca53042-8254-49b0-96e7-7f1113e736ce service nova] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Received unexpected event network-vif-plugged-344d545f-7d42-4750-ae3d-30a3ad813148 for instance with vm_state active and task_state None.
Nov 29 05:46:21 user nova-compute[75083]: DEBUG nova.network.neutron [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Updating instance_info_cache with network_info: [{"id": "188d4866-21b0-4a1e-a17a-c0c82e849726", "address": "fa:16:3e:a8:14:4a", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d4866-21", "ovs_interfaceid": "188d4866-21b0-4a1e-a17a-c0c82e849726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:46:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Releasing lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:46:21 user nova-compute[75083]: DEBUG nova.compute.manager [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Instance network_info: |[{"id": "188d4866-21b0-4a1e-a17a-c0c82e849726", "address": "fa:16:3e:a8:14:4a", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d4866-21", "ovs_interfaceid": "188d4866-21b0-4a1e-a17a-c0c82e849726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:46:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-797bfab4-8027-405e-845c-f092856bfdf1 req-7f08a2fd-cca5-4347-8b1d-386bb193b84d service nova] Acquired lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:46:21 user nova-compute[75083]: DEBUG nova.network.neutron [req-797bfab4-8027-405e-845c-f092856bfdf1 req-7f08a2fd-cca5-4347-8b1d-386bb193b84d service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Refreshing network info cache for port 188d4866-21b0-4a1e-a17a-c0c82e849726 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:46:21 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Start _get_guest_xml network_info=[{"id": "188d4866-21b0-4a1e-a17a-c0c82e849726", "address": "fa:16:3e:a8:14:4a", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d4866-21", "ovs_interfaceid": "188d4866-21b0-4a1e-a17a-c0c82e849726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:46:22 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:46:22 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-192619014',display_name='tempest-ServerActionsTestOtherA-server-192619014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-192619014',id=5,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/QARryHVy9tL0HspVgAb5d+hXfz/yMgw4/juPCBWiK9jONO+/KTLCL7Bj2On8DfV4bHN063zv9H1zJ2YV2YRCRWmcFlsfDLpgZRojBg+ehebykt/upaC2Fb+0QP3Sb0w==',key_name='tempest-keypair-908590560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95d0f3dd09bf436498e67d7bfdd904bf',ramdisk_id='',reservation_id='r-bv7tcywi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2114836332',owner_user_name='tempest-ServerActionsTestOtherA-2114836332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:46:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbd7f863ad7c4229957c4b08601b5003',uuid=161c6455-90ce-4c40-a33e-7f582989135d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "188d4866-21b0-4a1e-a17a-c0c82e849726", "address": "fa:16:3e:a8:14:4a", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d4866-21", "ovs_interfaceid": "188d4866-21b0-4a1e-a17a-c0c82e849726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converting VIF {"id": "188d4866-21b0-4a1e-a17a-c0c82e849726", "address": "fa:16:3e:a8:14:4a", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d4866-21", "ovs_interfaceid": "188d4866-21b0-4a1e-a17a-c0c82e849726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:14:4a,bridge_name='br-int',has_traffic_filtering=True,id=188d4866-21b0-4a1e-a17a-c0c82e849726,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap188d4866-21') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.objects.instance [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lazy-loading 'pci_devices' on Instance uuid 161c6455-90ce-4c40-a33e-7f582989135d {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:46:22 user nova-compute[75083]:   <uuid>161c6455-90ce-4c40-a33e-7f582989135d</uuid>
Nov 29 05:46:22 user nova-compute[75083]:   <name>instance-00000005</name>
Nov 29 05:46:22 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:46:22 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:46:22 user nova-compute[75083]:   <metadata>
Nov 29 05:46:22 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:46:22 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:46:22 user nova-compute[75083]:       <nova:name>tempest-ServerActionsTestOtherA-server-192619014</nova:name>
Nov 29 05:46:22 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:46:22</nova:creationTime>
Nov 29 05:46:22 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:46:22 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:46:22 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:46:22 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:46:22 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:46:22 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:46:22 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:46:22 user nova-compute[75083]:       <nova:owner>
Nov 29 05:46:22 user nova-compute[75083]:         <nova:user uuid="cbd7f863ad7c4229957c4b08601b5003">tempest-ServerActionsTestOtherA-2114836332-project-member</nova:user>
Nov 29 05:46:22 user nova-compute[75083]:         <nova:project uuid="95d0f3dd09bf436498e67d7bfdd904bf">tempest-ServerActionsTestOtherA-2114836332</nova:project>
Nov 29 05:46:22 user nova-compute[75083]:       </nova:owner>
Nov 29 05:46:22 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:46:22 user nova-compute[75083]:       <nova:ports>
Nov 29 05:46:22 user nova-compute[75083]:         <nova:port uuid="188d4866-21b0-4a1e-a17a-c0c82e849726">
Nov 29 05:46:22 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 05:46:22 user nova-compute[75083]:         </nova:port>
Nov 29 05:46:22 user nova-compute[75083]:       </nova:ports>
Nov 29 05:46:22 user nova-compute[75083]:     </nova:instance>
Nov 29 05:46:22 user nova-compute[75083]:   </metadata>
Nov 29 05:46:22 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:46:22 user nova-compute[75083]:     <system>
Nov 29 05:46:22 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:46:22 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:46:22 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:46:22 user nova-compute[75083]:       <entry name="serial">161c6455-90ce-4c40-a33e-7f582989135d</entry>
Nov 29 05:46:22 user nova-compute[75083]:       <entry name="uuid">161c6455-90ce-4c40-a33e-7f582989135d</entry>
Nov 29 05:46:22 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:46:22 user nova-compute[75083]:     </system>
Nov 29 05:46:22 user nova-compute[75083]:   </sysinfo>
Nov 29 05:46:22 user nova-compute[75083]:   <os>
Nov 29 05:46:22 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:46:22 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:46:22 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:46:22 user nova-compute[75083]:   </os>
Nov 29 05:46:22 user nova-compute[75083]:   <features>
Nov 29 05:46:22 user nova-compute[75083]:     <acpi/>
Nov 29 05:46:22 user nova-compute[75083]:     <apic/>
Nov 29 05:46:22 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:46:22 user nova-compute[75083]:   </features>
Nov 29 05:46:22 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:46:22 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:46:22 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:46:22 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:46:22 user nova-compute[75083]:   </clock>
Nov 29 05:46:22 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:46:22 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:46:22 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:46:22 user nova-compute[75083]:   </cpu>
Nov 29 05:46:22 user nova-compute[75083]:   <devices>
Nov 29 05:46:22 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:46:22 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:46:22 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk"/>
Nov 29 05:46:22 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:46:22 user nova-compute[75083]:     </disk>
Nov 29 05:46:22 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:46:22 user nova-compute[75083]:       <mac address="fa:16:3e:a8:14:4a"/>
Nov 29 05:46:22 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:46:22 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:46:22 user nova-compute[75083]:       <target dev="tap188d4866-21"/>
Nov 29 05:46:22 user nova-compute[75083]:     </interface>
Nov 29 05:46:22 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:46:22 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/console.log" append="off"/>
Nov 29 05:46:22 user nova-compute[75083]:     </serial>
Nov 29 05:46:22 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:46:22 user nova-compute[75083]:     <video>
Nov 29 05:46:22 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:46:22 user nova-compute[75083]:     </video>
Nov 29 05:46:22 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:46:22 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:46:22 user nova-compute[75083]:     </rng>
Nov 29 05:46:22 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:46:22 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:46:22 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:46:22 user nova-compute[75083]:     </memballoon>
Nov 29 05:46:22 user nova-compute[75083]:   </devices>
Nov 29 05:46:22 user nova-compute[75083]: </domain>
Nov 29 05:46:22 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-192619014',display_name='tempest-ServerActionsTestOtherA-server-192619014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-192619014',id=5,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/QARryHVy9tL0HspVgAb5d+hXfz/yMgw4/juPCBWiK9jONO+/KTLCL7Bj2On8DfV4bHN063zv9H1zJ2YV2YRCRWmcFlsfDLpgZRojBg+ehebykt/upaC2Fb+0QP3Sb0w==',key_name='tempest-keypair-908590560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95d0f3dd09bf436498e67d7bfdd904bf',ramdisk_id='',reservation_id='r-bv7tcywi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2114836332',owner_user_name='tempest-ServerActionsTestOtherA-2114836332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:46:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbd7f863ad7c4229957c4b08601b5003',uuid=161c6455-90ce-4c40-a33e-7f582989135d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "188d4866-21b0-4a1e-a17a-c0c82e849726", "address": "fa:16:3e:a8:14:4a", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d4866-21", "ovs_interfaceid": "188d4866-21b0-4a1e-a17a-c0c82e849726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converting VIF {"id": "188d4866-21b0-4a1e-a17a-c0c82e849726", "address": "fa:16:3e:a8:14:4a", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d4866-21", "ovs_interfaceid": "188d4866-21b0-4a1e-a17a-c0c82e849726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:14:4a,bridge_name='br-int',has_traffic_filtering=True,id=188d4866-21b0-4a1e-a17a-c0c82e849726,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap188d4866-21') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG os_vif [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:14:4a,bridge_name='br-int',has_traffic_filtering=True,id=188d4866-21b0-4a1e-a17a-c0c82e849726,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap188d4866-21') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72e4733d-c7f7-57ab-8420-21a667d43a7f', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap188d4866-21, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap188d4866-21, col_values=(('qos', UUID('d8297b02-c757-4f2b-b982-88d316955d2d')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap188d4866-21, col_values=(('external_ids', {'iface-id': '188d4866-21b0-4a1e-a17a-c0c82e849726', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:14:4a', 'vm-uuid': '161c6455-90ce-4c40-a33e-7f582989135d'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:46:22 user nova-compute[75083]: INFO os_vif [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:14:4a,bridge_name='br-int',has_traffic_filtering=True,id=188d4866-21b0-4a1e-a17a-c0c82e849726,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap188d4866-21')
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] No VIF found with MAC fa:16:3e:a8:14:4a, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:23 user nova-compute[75083]: DEBUG nova.network.neutron [req-797bfab4-8027-405e-845c-f092856bfdf1 req-7f08a2fd-cca5-4347-8b1d-386bb193b84d service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Updated VIF entry in instance network info cache for port 188d4866-21b0-4a1e-a17a-c0c82e849726. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:46:23 user nova-compute[75083]: DEBUG nova.network.neutron [req-797bfab4-8027-405e-845c-f092856bfdf1 req-7f08a2fd-cca5-4347-8b1d-386bb193b84d service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Updating instance_info_cache with network_info: [{"id": "188d4866-21b0-4a1e-a17a-c0c82e849726", "address": "fa:16:3e:a8:14:4a", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d4866-21", "ovs_interfaceid": "188d4866-21b0-4a1e-a17a-c0c82e849726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:46:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-797bfab4-8027-405e-845c-f092856bfdf1 req-7f08a2fd-cca5-4347-8b1d-386bb193b84d service nova] Releasing lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:46:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-e39bf173-d0c4-4b32-a37c-905a52a4efaf req-13d6ccee-9291-47e3-a740-fee946290822 service nova] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Received event network-vif-plugged-344d545f-7d42-4750-ae3d-30a3ad813148 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e39bf173-d0c4-4b32-a37c-905a52a4efaf req-13d6ccee-9291-47e3-a740-fee946290822 service nova] Acquiring lock "303f0c67-e197-4d49-b131-8c99d50d7fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e39bf173-d0c4-4b32-a37c-905a52a4efaf req-13d6ccee-9291-47e3-a740-fee946290822 service nova] Lock "303f0c67-e197-4d49-b131-8c99d50d7fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e39bf173-d0c4-4b32-a37c-905a52a4efaf req-13d6ccee-9291-47e3-a740-fee946290822 service nova] Lock "303f0c67-e197-4d49-b131-8c99d50d7fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-e39bf173-d0c4-4b32-a37c-905a52a4efaf req-13d6ccee-9291-47e3-a740-fee946290822 service nova] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] No waiting events found dispatching network-vif-plugged-344d545f-7d42-4750-ae3d-30a3ad813148 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:46:23 user nova-compute[75083]: WARNING nova.compute.manager [req-e39bf173-d0c4-4b32-a37c-905a52a4efaf req-13d6ccee-9291-47e3-a740-fee946290822 service nova] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Received unexpected event network-vif-plugged-344d545f-7d42-4750-ae3d-30a3ad813148 for instance with vm_state active and task_state None.
Nov 29 05:46:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:24 user nova-compute[75083]: DEBUG nova.compute.manager [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:46:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:46:24 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Instance spawned successfully.
Nov 29 05:46:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:46:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:24 user nova-compute[75083]: INFO nova.compute.manager [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Took 12.58 seconds to spawn the instance on the hypervisor.
Nov 29 05:46:24 user nova-compute[75083]: DEBUG nova.compute.manager [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:46:24 user nova-compute[75083]: INFO nova.compute.manager [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Took 13.50 seconds to build instance.
Nov 29 05:46:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7508a179-51fb-410e-9ea6-c2f18f55ba6c tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.666s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:27 user nova-compute[75083]: DEBUG nova.compute.manager [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:46:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:46:27 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Instance spawned successfully.
Nov 29 05:46:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:46:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:27 user nova-compute[75083]: INFO nova.compute.manager [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Took 13.91 seconds to spawn the instance on the hypervisor.
Nov 29 05:46:27 user nova-compute[75083]: DEBUG nova.compute.manager [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:46:27 user nova-compute[75083]: INFO nova.compute.manager [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Took 14.85 seconds to build instance.
Nov 29 05:46:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-86abf227-963d-4192-90f3-167100887bbb tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "161c6455-90ce-4c40-a33e-7f582989135d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.996s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Acquiring lock "0414bda1-7b04-40ba-a693-44be9296e432" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "0414bda1-7b04-40ba-a693-44be9296e432" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:27 user nova-compute[75083]: DEBUG nova.compute.manager [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:46:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:28 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:46:28 user nova-compute[75083]: INFO nova.compute.claims [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Claim successful on node user
Nov 29 05:46:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:28 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:46:28 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:46:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.609s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:46:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:46:28 user nova-compute[75083]: DEBUG nova.network.neutron [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:46:28 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 29 05:46:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:46:28 user nova-compute[75083]: DEBUG nova.policy [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '107e2c95f7614188ba8edffa84a1314d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471762377c1f451ab78d898e89ed83e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:46:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:29 user nova-compute[75083]: DEBUG nova.compute.manager [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:46:29 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:46:29 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Creating image(s)
Nov 29 05:46:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Acquiring lock "/opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "/opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "/opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Acquiring lock "8040691e2d2310b199db5b797b1378e92de8d33b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "8040691e2d2310b199db5b797b1378e92de8d33b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8040691e2d2310b199db5b797b1378e92de8d33b.part --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8040691e2d2310b199db5b797b1378e92de8d33b.part --force-share --output=json" returned: 0 in 0.261s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:30 user nova-compute[75083]: DEBUG nova.virt.images [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] c330ac7c-34d0-450e-a72b-ff68dc5a30b7 was qcow2, converting to raw {{(pid=75083) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 05:46:30 user nova-compute[75083]: DEBUG nova.privsep.utils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75083) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 05:46:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8040691e2d2310b199db5b797b1378e92de8d33b.part /opt/stack/data/nova/instances/_base/8040691e2d2310b199db5b797b1378e92de8d33b.converted {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8040691e2d2310b199db5b797b1378e92de8d33b.part /opt/stack/data/nova/instances/_base/8040691e2d2310b199db5b797b1378e92de8d33b.converted" returned: 0 in 0.224s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8040691e2d2310b199db5b797b1378e92de8d33b.converted --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8040691e2d2310b199db5b797b1378e92de8d33b.converted --force-share --output=json" returned: 0 in 0.296s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "8040691e2d2310b199db5b797b1378e92de8d33b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.510s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8040691e2d2310b199db5b797b1378e92de8d33b --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8040691e2d2310b199db5b797b1378e92de8d33b --force-share --output=json" returned: 0 in 0.300s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Acquiring lock "8040691e2d2310b199db5b797b1378e92de8d33b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "8040691e2d2310b199db5b797b1378e92de8d33b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8040691e2d2310b199db5b797b1378e92de8d33b --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8040691e2d2310b199db5b797b1378e92de8d33b --force-share --output=json" returned: 0 in 0.473s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8040691e2d2310b199db5b797b1378e92de8d33b,backing_fmt=raw /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8040691e2d2310b199db5b797b1378e92de8d33b,backing_fmt=raw /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk 1073741824" returned: 0 in 0.113s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "8040691e2d2310b199db5b797b1378e92de8d33b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.596s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8040691e2d2310b199db5b797b1378e92de8d33b --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8040691e2d2310b199db5b797b1378e92de8d33b --force-share --output=json" returned: 0 in 0.413s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:31 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:46:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Acquiring lock "ae18699b-d0cf-44b5-8467-a112fd154580" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "ae18699b-d0cf-44b5-8467-a112fd154580" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG nova.compute.manager [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG nova.network.neutron [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Successfully created port: 6c418847-5bf6-4315-9acd-c743ce87f36c {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG nova.compute.manager [req-84ff8e5b-6eaa-448f-8b47-faf02f47903a req-01f298ea-c174-45aa-ba3a-884836e3e10c service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-84ff8e5b-6eaa-448f-8b47-faf02f47903a req-01f298ea-c174-45aa-ba3a-884836e3e10c service nova] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-84ff8e5b-6eaa-448f-8b47-faf02f47903a req-01f298ea-c174-45aa-ba3a-884836e3e10c service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-84ff8e5b-6eaa-448f-8b47-faf02f47903a req-01f298ea-c174-45aa-ba3a-884836e3e10c service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG nova.compute.manager [req-84ff8e5b-6eaa-448f-8b47-faf02f47903a req-01f298ea-c174-45aa-ba3a-884836e3e10c service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] No waiting events found dispatching network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:46:32 user nova-compute[75083]: WARNING nova.compute.manager [req-84ff8e5b-6eaa-448f-8b47-faf02f47903a req-01f298ea-c174-45aa-ba3a-884836e3e10c service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received unexpected event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 for instance with vm_state active and task_state None.
Nov 29 05:46:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:46:32 user nova-compute[75083]: INFO nova.compute.claims [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Claim successful on node user
Nov 29 05:46:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk --force-share --output=json" returned: 0 in 0.419s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Cannot resize image /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Ensure instance console log exists: /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquiring lock "b2f88b2e-0244-4e18-98ae-21861b02db3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:46:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:33 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:46:33 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:46:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.896s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:33 user nova-compute[75083]: DEBUG nova.compute.manager [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:46:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.458s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:33 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:46:33 user nova-compute[75083]: INFO nova.compute.claims [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Claim successful on node user
Nov 29 05:46:33 user nova-compute[75083]: DEBUG nova.compute.manager [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:46:33 user nova-compute[75083]: DEBUG nova.network.neutron [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:46:33 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:46:33 user nova-compute[75083]: DEBUG nova.compute.manager [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:46:33 user nova-compute[75083]: DEBUG nova.policy [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b9424c8a1054c8f8128ef0f0a2b6dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7f2ae08bd241fcaa60e97d864545f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:46:33 user nova-compute[75083]: DEBUG nova.compute.manager [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:46:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:46:33 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Creating image(s)
Nov 29 05:46:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "/opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "/opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.470s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG nova.network.neutron [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Successfully updated port: 6c418847-5bf6-4315-9acd-c743ce87f36c {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Acquiring lock "refresh_cache-0414bda1-7b04-40ba-a693-44be9296e432" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Acquired lock "refresh_cache-0414bda1-7b04-40ba-a693-44be9296e432" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG nova.network.neutron [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG nova.compute.manager [req-40631892-d00d-4552-b5e6-f3a177bbe836 req-52e6eb64-8ecc-4c3b-bf89-35eda325ab30 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-40631892-d00d-4552-b5e6-f3a177bbe836 req-52e6eb64-8ecc-4c3b-bf89-35eda325ab30 service nova] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-40631892-d00d-4552-b5e6-f3a177bbe836 req-52e6eb64-8ecc-4c3b-bf89-35eda325ab30 service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-40631892-d00d-4552-b5e6-f3a177bbe836 req-52e6eb64-8ecc-4c3b-bf89-35eda325ab30 service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG nova.compute.manager [req-40631892-d00d-4552-b5e6-f3a177bbe836 req-52e6eb64-8ecc-4c3b-bf89-35eda325ab30 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] No waiting events found dispatching network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:46:34 user nova-compute[75083]: WARNING nova.compute.manager [req-40631892-d00d-4552-b5e6-f3a177bbe836 req-52e6eb64-8ecc-4c3b-bf89-35eda325ab30 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received unexpected event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 for instance with vm_state active and task_state None.
Nov 29 05:46:34 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG nova.compute.manager [req-90f3647f-0a01-4251-b982-f0fd5b113d4a req-8c8ca2f5-b730-4c15-b7ca-7fbb7b245464 service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Received event network-changed-6c418847-5bf6-4315-9acd-c743ce87f36c {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG nova.compute.manager [req-90f3647f-0a01-4251-b982-f0fd5b113d4a req-8c8ca2f5-b730-4c15-b7ca-7fbb7b245464 service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Refreshing instance network info cache due to event network-changed-6c418847-5bf6-4315-9acd-c743ce87f36c. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-90f3647f-0a01-4251-b982-f0fd5b113d4a req-8c8ca2f5-b730-4c15-b7ca-7fbb7b245464 service nova] Acquiring lock "refresh_cache-0414bda1-7b04-40ba-a693-44be9296e432" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.376s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG nova.network.neutron [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.440s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk 1073741824" returned: 0 in 0.143s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.525s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:46:34 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:46:34 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.326s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.policy [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c746113481e4d179fba6e77efcee7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916664e2bf04c018daedae140735f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:46:35 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Creating image(s)
Nov 29 05:46:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk --force-share --output=json" returned: 0 in 0.367s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Cannot resize image /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Ensure instance console log exists: /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.network.neutron [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Successfully created port: 576fd898-62e6-4bf7-a914-6b94081176b1 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.281s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.network.neutron [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Updating instance_info_cache with network_info: [{"id": "6c418847-5bf6-4315-9acd-c743ce87f36c", "address": "fa:16:3e:1e:c8:98", "network": {"id": "e5e61cc2-ec29-4baa-af6c-216f426467a4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-481090086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "471762377c1f451ab78d898e89ed83e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c418847-5b", "ovs_interfaceid": "6c418847-5bf6-4315-9acd-c743ce87f36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Releasing lock "refresh_cache-0414bda1-7b04-40ba-a693-44be9296e432" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Instance network_info: |[{"id": "6c418847-5bf6-4315-9acd-c743ce87f36c", "address": "fa:16:3e:1e:c8:98", "network": {"id": "e5e61cc2-ec29-4baa-af6c-216f426467a4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-481090086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "471762377c1f451ab78d898e89ed83e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c418847-5b", "ovs_interfaceid": "6c418847-5bf6-4315-9acd-c743ce87f36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-90f3647f-0a01-4251-b982-f0fd5b113d4a req-8c8ca2f5-b730-4c15-b7ca-7fbb7b245464 service nova] Acquired lock "refresh_cache-0414bda1-7b04-40ba-a693-44be9296e432" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.network.neutron [req-90f3647f-0a01-4251-b982-f0fd5b113d4a req-8c8ca2f5-b730-4c15-b7ca-7fbb7b245464 service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Refreshing network info cache for port 6c418847-5bf6-4315-9acd-c743ce87f36c {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Start _get_guest_xml network_info=[{"id": "6c418847-5bf6-4315-9acd-c743ce87f36c", "address": "fa:16:3e:1e:c8:98", "network": {"id": "e5e61cc2-ec29-4baa-af6c-216f426467a4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-481090086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "471762377c1f451ab78d898e89ed83e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c418847-5b", "ovs_interfaceid": "6c418847-5bf6-4315-9acd-c743ce87f36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:46:17Z,direct_url=<?>,disk_format='qcow2',id=c330ac7c-34d0-450e-a72b-ff68dc5a30b7,min_disk=0,min_ram=0,name='',owner='b56d7ca3b1dd4e7aa5a09034844c19dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:46:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': 'c330ac7c-34d0-450e-a72b-ff68dc5a30b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:46:35 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:46:35 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:46:17Z,direct_url=<?>,disk_format='qcow2',id=c330ac7c-34d0-450e-a72b-ff68dc5a30b7,min_disk=0,min_ram=0,name='',owner='b56d7ca3b1dd4e7aa5a09034844c19dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:46:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1715263696',display_name='tempest-AttachSCSIVolumeTestJSON-server-1715263696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1715263696',id=6,image_ref='c330ac7c-34d0-450e-a72b-ff68dc5a30b7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvms4cikzQuDQW8pqrgdwdFezFpt6FWF0jGUwEBCo+8I6w+8L1lMkuuL2T4MkDHChLBHf7ipdiig9VroC/XdDIcOk4Z1uM9ny61ibIke1kx9EdGlSkyH2i0eXp2ZtTb1g==',key_name='tempest-keypair-258695651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='471762377c1f451ab78d898e89ed83e0',ramdisk_id='',reservation_id='r-oz1f0zfh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c330ac7c-34d0-450e-a72b-ff68dc5a30b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1001448366',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1001448366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:46:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='107e2c95f7614188ba8edffa84a1314d',uuid=0414bda1-7b04-40ba-a693-44be9296e432,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c418847-5bf6-4315-9acd-c743ce87f36c", "address": "fa:16:3e:1e:c8:98", "network": {"id": "e5e61cc2-ec29-4baa-af6c-216f426467a4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-481090086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "471762377c1f451ab78d898e89ed83e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c418847-5b", "ovs_interfaceid": "6c418847-5bf6-4315-9acd-c743ce87f36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Converting VIF {"id": "6c418847-5bf6-4315-9acd-c743ce87f36c", "address": "fa:16:3e:1e:c8:98", "network": {"id": "e5e61cc2-ec29-4baa-af6c-216f426467a4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-481090086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "471762377c1f451ab78d898e89ed83e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c418847-5b", "ovs_interfaceid": "6c418847-5bf6-4315-9acd-c743ce87f36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:c8:98,bridge_name='br-int',has_traffic_filtering=True,id=6c418847-5bf6-4315-9acd-c743ce87f36c,network=Network(e5e61cc2-ec29-4baa-af6c-216f426467a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c418847-5b') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.objects.instance [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lazy-loading 'pci_devices' on Instance uuid 0414bda1-7b04-40ba-a693-44be9296e432 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:46:35 user nova-compute[75083]:   <uuid>0414bda1-7b04-40ba-a693-44be9296e432</uuid>
Nov 29 05:46:35 user nova-compute[75083]:   <name>instance-00000006</name>
Nov 29 05:46:35 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:46:35 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:46:35 user nova-compute[75083]:   <metadata>
Nov 29 05:46:35 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:46:35 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:46:35 user nova-compute[75083]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1715263696</nova:name>
Nov 29 05:46:35 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:46:35</nova:creationTime>
Nov 29 05:46:35 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:46:35 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:46:35 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:46:35 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:46:35 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:46:35 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:46:35 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:46:35 user nova-compute[75083]:       <nova:owner>
Nov 29 05:46:35 user nova-compute[75083]:         <nova:user uuid="107e2c95f7614188ba8edffa84a1314d">tempest-AttachSCSIVolumeTestJSON-1001448366-project-member</nova:user>
Nov 29 05:46:35 user nova-compute[75083]:         <nova:project uuid="471762377c1f451ab78d898e89ed83e0">tempest-AttachSCSIVolumeTestJSON-1001448366</nova:project>
Nov 29 05:46:35 user nova-compute[75083]:       </nova:owner>
Nov 29 05:46:35 user nova-compute[75083]:       <nova:root type="image" uuid="c330ac7c-34d0-450e-a72b-ff68dc5a30b7"/>
Nov 29 05:46:35 user nova-compute[75083]:       <nova:ports>
Nov 29 05:46:35 user nova-compute[75083]:         <nova:port uuid="6c418847-5bf6-4315-9acd-c743ce87f36c">
Nov 29 05:46:35 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 05:46:35 user nova-compute[75083]:         </nova:port>
Nov 29 05:46:35 user nova-compute[75083]:       </nova:ports>
Nov 29 05:46:35 user nova-compute[75083]:     </nova:instance>
Nov 29 05:46:35 user nova-compute[75083]:   </metadata>
Nov 29 05:46:35 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:46:35 user nova-compute[75083]:     <system>
Nov 29 05:46:35 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:46:35 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:46:35 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:46:35 user nova-compute[75083]:       <entry name="serial">0414bda1-7b04-40ba-a693-44be9296e432</entry>
Nov 29 05:46:35 user nova-compute[75083]:       <entry name="uuid">0414bda1-7b04-40ba-a693-44be9296e432</entry>
Nov 29 05:46:35 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:46:35 user nova-compute[75083]:     </system>
Nov 29 05:46:35 user nova-compute[75083]:   </sysinfo>
Nov 29 05:46:35 user nova-compute[75083]:   <os>
Nov 29 05:46:35 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:46:35 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:46:35 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:46:35 user nova-compute[75083]:   </os>
Nov 29 05:46:35 user nova-compute[75083]:   <features>
Nov 29 05:46:35 user nova-compute[75083]:     <acpi/>
Nov 29 05:46:35 user nova-compute[75083]:     <apic/>
Nov 29 05:46:35 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:46:35 user nova-compute[75083]:   </features>
Nov 29 05:46:35 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:46:35 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:46:35 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:46:35 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:46:35 user nova-compute[75083]:   </clock>
Nov 29 05:46:35 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:46:35 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:46:35 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:46:35 user nova-compute[75083]:   </cpu>
Nov 29 05:46:35 user nova-compute[75083]:   <devices>
Nov 29 05:46:35 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:46:35 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:46:35 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk"/>
Nov 29 05:46:35 user nova-compute[75083]:       <target dev="sda" bus="scsi"/>
Nov 29 05:46:35 user nova-compute[75083]:       <address type="drive" controller="0" unit="0"/>
Nov 29 05:46:35 user nova-compute[75083]:     </disk>
Nov 29 05:46:35 user nova-compute[75083]:     <disk type="file" device="cdrom">
Nov 29 05:46:35 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 05:46:35 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk.config"/>
Nov 29 05:46:35 user nova-compute[75083]:       <target dev="sdb" bus="scsi"/>
Nov 29 05:46:35 user nova-compute[75083]:       <address type="drive" controller="0" unit="1"/>
Nov 29 05:46:35 user nova-compute[75083]:     </disk>
Nov 29 05:46:35 user nova-compute[75083]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 29 05:46:35 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:46:35 user nova-compute[75083]:       <mac address="fa:16:3e:1e:c8:98"/>
Nov 29 05:46:35 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:46:35 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:46:35 user nova-compute[75083]:       <target dev="tap6c418847-5b"/>
Nov 29 05:46:35 user nova-compute[75083]:     </interface>
Nov 29 05:46:35 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:46:35 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/console.log" append="off"/>
Nov 29 05:46:35 user nova-compute[75083]:     </serial>
Nov 29 05:46:35 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:46:35 user nova-compute[75083]:     <video>
Nov 29 05:46:35 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:46:35 user nova-compute[75083]:     </video>
Nov 29 05:46:35 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:46:35 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:46:35 user nova-compute[75083]:     </rng>
Nov 29 05:46:35 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:46:35 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:46:35 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:46:35 user nova-compute[75083]:     </memballoon>
Nov 29 05:46:35 user nova-compute[75083]:   </devices>
Nov 29 05:46:35 user nova-compute[75083]: </domain>
Nov 29 05:46:35 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1715263696',display_name='tempest-AttachSCSIVolumeTestJSON-server-1715263696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1715263696',id=6,image_ref='c330ac7c-34d0-450e-a72b-ff68dc5a30b7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvms4cikzQuDQW8pqrgdwdFezFpt6FWF0jGUwEBCo+8I6w+8L1lMkuuL2T4MkDHChLBHf7ipdiig9VroC/XdDIcOk4Z1uM9ny61ibIke1kx9EdGlSkyH2i0eXp2ZtTb1g==',key_name='tempest-keypair-258695651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='471762377c1f451ab78d898e89ed83e0',ramdisk_id='',reservation_id='r-oz1f0zfh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c330ac7c-34d0-450e-a72b-ff68dc5a30b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1001448366',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1001448366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:46:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='107e2c95f7614188ba8edffa84a1314d',uuid=0414bda1-7b04-40ba-a693-44be9296e432,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c418847-5bf6-4315-9acd-c743ce87f36c", "address": "fa:16:3e:1e:c8:98", "network": {"id": "e5e61cc2-ec29-4baa-af6c-216f426467a4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-481090086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "471762377c1f451ab78d898e89ed83e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c418847-5b", "ovs_interfaceid": "6c418847-5bf6-4315-9acd-c743ce87f36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Converting VIF {"id": "6c418847-5bf6-4315-9acd-c743ce87f36c", "address": "fa:16:3e:1e:c8:98", "network": {"id": "e5e61cc2-ec29-4baa-af6c-216f426467a4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-481090086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "471762377c1f451ab78d898e89ed83e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c418847-5b", "ovs_interfaceid": "6c418847-5bf6-4315-9acd-c743ce87f36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:c8:98,bridge_name='br-int',has_traffic_filtering=True,id=6c418847-5bf6-4315-9acd-c743ce87f36c,network=Network(e5e61cc2-ec29-4baa-af6c-216f426467a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c418847-5b') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:46:35 user nova-compute[75083]: DEBUG os_vif [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:c8:98,bridge_name='br-int',has_traffic_filtering=True,id=6c418847-5bf6-4315-9acd-c743ce87f36c,network=Network(e5e61cc2-ec29-4baa-af6c-216f426467a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c418847-5b') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.418s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b037ecae-72fd-56d6-8aaf-d4e14d520b85', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c418847-5b, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c418847-5b, col_values=(('qos', UUID('90b13ad8-b32a-47c0-9c08-1751bc78140a')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c418847-5b, col_values=(('external_ids', {'iface-id': '6c418847-5bf6-4315-9acd-c743ce87f36c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:c8:98', 'vm-uuid': '0414bda1-7b04-40ba-a693-44be9296e432'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk 1073741824" returned: 0 in 0.099s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.528s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:36 user nova-compute[75083]: INFO os_vif [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:c8:98,bridge_name='br-int',has_traffic_filtering=True,id=6c418847-5bf6-4315-9acd-c743ce87f36c,network=Network(e5e61cc2-ec29-4baa-af6c-216f426467a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c418847-5b')
Nov 29 05:46:36 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] No BDM found with device name sda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] No VIF found with MAC fa:16:3e:1e:c8:98, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:46:36 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Using config drive
Nov 29 05:46:36 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Successfully created port: 9ac8517e-5bf8-41ec-839e-40dcffd8a7ac {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.455s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Cannot resize image /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Ensure instance console log exists: /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:37 user nova-compute[75083]: DEBUG nova.network.neutron [req-90f3647f-0a01-4251-b982-f0fd5b113d4a req-8c8ca2f5-b730-4c15-b7ca-7fbb7b245464 service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Updated VIF entry in instance network info cache for port 6c418847-5bf6-4315-9acd-c743ce87f36c. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:46:37 user nova-compute[75083]: DEBUG nova.network.neutron [req-90f3647f-0a01-4251-b982-f0fd5b113d4a req-8c8ca2f5-b730-4c15-b7ca-7fbb7b245464 service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Updating instance_info_cache with network_info: [{"id": "6c418847-5bf6-4315-9acd-c743ce87f36c", "address": "fa:16:3e:1e:c8:98", "network": {"id": "e5e61cc2-ec29-4baa-af6c-216f426467a4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-481090086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "471762377c1f451ab78d898e89ed83e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c418847-5b", "ovs_interfaceid": "6c418847-5bf6-4315-9acd-c743ce87f36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:46:37 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Creating config drive at /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk.config
Nov 29 05:46:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpup2tiak9 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:37 user nova-compute[75083]: DEBUG nova.network.neutron [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Successfully updated port: 576fd898-62e6-4bf7-a914-6b94081176b1 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-90f3647f-0a01-4251-b982-f0fd5b113d4a req-8c8ca2f5-b730-4c15-b7ca-7fbb7b245464 service nova] Releasing lock "refresh_cache-0414bda1-7b04-40ba-a693-44be9296e432" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-bba75586-64e0-42b6-99e7-e7f1cc17508d req-b58bc031-905d-4917-94e8-7928120cb9d7 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Received event network-changed-576fd898-62e6-4bf7-a914-6b94081176b1 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-bba75586-64e0-42b6-99e7-e7f1cc17508d req-b58bc031-905d-4917-94e8-7928120cb9d7 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Refreshing instance network info cache due to event network-changed-576fd898-62e6-4bf7-a914-6b94081176b1. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bba75586-64e0-42b6-99e7-e7f1cc17508d req-b58bc031-905d-4917-94e8-7928120cb9d7 service nova] Acquiring lock "refresh_cache-ae18699b-d0cf-44b5-8467-a112fd154580" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bba75586-64e0-42b6-99e7-e7f1cc17508d req-b58bc031-905d-4917-94e8-7928120cb9d7 service nova] Acquired lock "refresh_cache-ae18699b-d0cf-44b5-8467-a112fd154580" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.network.neutron [req-bba75586-64e0-42b6-99e7-e7f1cc17508d req-b58bc031-905d-4917-94e8-7928120cb9d7 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Refreshing network info cache for port 576fd898-62e6-4bf7-a914-6b94081176b1 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Acquiring lock "refresh_cache-ae18699b-d0cf-44b5-8467-a112fd154580" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpup2tiak9" returned: 0 in 0.133s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.network.neutron [req-bba75586-64e0-42b6-99e7-e7f1cc17508d req-b58bc031-905d-4917-94e8-7928120cb9d7 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.network.neutron [req-bba75586-64e0-42b6-99e7-e7f1cc17508d req-b58bc031-905d-4917-94e8-7928120cb9d7 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bba75586-64e0-42b6-99e7-e7f1cc17508d req-b58bc031-905d-4917-94e8-7928120cb9d7 service nova] Releasing lock "refresh_cache-ae18699b-d0cf-44b5-8467-a112fd154580" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Acquired lock "refresh_cache-ae18699b-d0cf-44b5-8467-a112fd154580" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.network.neutron [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.network.neutron [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Successfully updated port: 9ac8517e-5bf8-41ec-839e-40dcffd8a7ac {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.network.neutron [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Updating instance_info_cache with network_info: [{"id": "576fd898-62e6-4bf7-a914-6b94081176b1", "address": "fa:16:3e:4f:5a:84", "network": {"id": "e98dee6b-18b4-41c2-af52-23b9bead051d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-91142156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7f2ae08bd241fcaa60e97d864545f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576fd898-62", "ovs_interfaceid": "576fd898-62e6-4bf7-a914-6b94081176b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-07548bde-09bb-42f5-b982-0015ebc408dc req-ed8486b1-c604-4cc6-8e46-7bc9570a61f9 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received event network-changed-9ac8517e-5bf8-41ec-839e-40dcffd8a7ac {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-07548bde-09bb-42f5-b982-0015ebc408dc req-ed8486b1-c604-4cc6-8e46-7bc9570a61f9 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Refreshing instance network info cache due to event network-changed-9ac8517e-5bf8-41ec-839e-40dcffd8a7ac. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-07548bde-09bb-42f5-b982-0015ebc408dc req-ed8486b1-c604-4cc6-8e46-7bc9570a61f9 service nova] Acquiring lock "refresh_cache-b2f88b2e-0244-4e18-98ae-21861b02db3a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-07548bde-09bb-42f5-b982-0015ebc408dc req-ed8486b1-c604-4cc6-8e46-7bc9570a61f9 service nova] Acquired lock "refresh_cache-b2f88b2e-0244-4e18-98ae-21861b02db3a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.network.neutron [req-07548bde-09bb-42f5-b982-0015ebc408dc req-ed8486b1-c604-4cc6-8e46-7bc9570a61f9 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Refreshing network info cache for port 9ac8517e-5bf8-41ec-839e-40dcffd8a7ac {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquiring lock "refresh_cache-b2f88b2e-0244-4e18-98ae-21861b02db3a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Releasing lock "refresh_cache-ae18699b-d0cf-44b5-8467-a112fd154580" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Instance network_info: |[{"id": "576fd898-62e6-4bf7-a914-6b94081176b1", "address": "fa:16:3e:4f:5a:84", "network": {"id": "e98dee6b-18b4-41c2-af52-23b9bead051d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-91142156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7f2ae08bd241fcaa60e97d864545f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576fd898-62", "ovs_interfaceid": "576fd898-62e6-4bf7-a914-6b94081176b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Start _get_guest_xml network_info=[{"id": "576fd898-62e6-4bf7-a914-6b94081176b1", "address": "fa:16:3e:4f:5a:84", "network": {"id": "e98dee6b-18b4-41c2-af52-23b9bead051d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-91142156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7f2ae08bd241fcaa60e97d864545f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576fd898-62", "ovs_interfaceid": "576fd898-62e6-4bf7-a914-6b94081176b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:46:38 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:46:38 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:46:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-243593488',display_name='tempest-TestVolumeSwap-server-243593488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-243593488',id=7,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNk6U9fL+cCmVxUB+GYgbg3rqejQxUVvAg8+Adeq8b2M7Q6RgkPR2YnNwVLVM7MHhCaCXMaEP3DVETchA37HzlY6FfPgTRTzDZn1LwLlMZvDEpHKPLzWTLPN1YzMt/ZCVQ==',key_name='tempest-keypair-1787660746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e7f2ae08bd241fcaa60e97d864545f3',ramdisk_id='',reservation_id='r-0baugmjz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1735569809',owner_user_name='tempest-TestVolumeSwap-1735569809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:46:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b9424c8a1054c8f8128ef0f0a2b6dcf',uuid=ae18699b-d0cf-44b5-8467-a112fd154580,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "576fd898-62e6-4bf7-a914-6b94081176b1", "address": "fa:16:3e:4f:5a:84", "network": {"id": "e98dee6b-18b4-41c2-af52-23b9bead051d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-91142156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7f2ae08bd241fcaa60e97d864545f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576fd898-62", "ovs_interfaceid": "576fd898-62e6-4bf7-a914-6b94081176b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Converting VIF {"id": "576fd898-62e6-4bf7-a914-6b94081176b1", "address": "fa:16:3e:4f:5a:84", "network": {"id": "e98dee6b-18b4-41c2-af52-23b9bead051d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-91142156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7f2ae08bd241fcaa60e97d864545f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576fd898-62", "ovs_interfaceid": "576fd898-62e6-4bf7-a914-6b94081176b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:5a:84,bridge_name='br-int',has_traffic_filtering=True,id=576fd898-62e6-4bf7-a914-6b94081176b1,network=Network(e98dee6b-18b4-41c2-af52-23b9bead051d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap576fd898-62') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.objects.instance [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lazy-loading 'pci_devices' on Instance uuid ae18699b-d0cf-44b5-8467-a112fd154580 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.network.neutron [req-07548bde-09bb-42f5-b982-0015ebc408dc req-ed8486b1-c604-4cc6-8e46-7bc9570a61f9 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:46:39 user nova-compute[75083]:   <uuid>ae18699b-d0cf-44b5-8467-a112fd154580</uuid>
Nov 29 05:46:39 user nova-compute[75083]:   <name>instance-00000007</name>
Nov 29 05:46:39 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:46:39 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:46:39 user nova-compute[75083]:   <metadata>
Nov 29 05:46:39 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:46:39 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:46:39 user nova-compute[75083]:       <nova:name>tempest-TestVolumeSwap-server-243593488</nova:name>
Nov 29 05:46:39 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:46:38</nova:creationTime>
Nov 29 05:46:39 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:46:39 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:46:39 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:46:39 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:46:39 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:46:39 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:46:39 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:46:39 user nova-compute[75083]:       <nova:owner>
Nov 29 05:46:39 user nova-compute[75083]:         <nova:user uuid="3b9424c8a1054c8f8128ef0f0a2b6dcf">tempest-TestVolumeSwap-1735569809-project-member</nova:user>
Nov 29 05:46:39 user nova-compute[75083]:         <nova:project uuid="6e7f2ae08bd241fcaa60e97d864545f3">tempest-TestVolumeSwap-1735569809</nova:project>
Nov 29 05:46:39 user nova-compute[75083]:       </nova:owner>
Nov 29 05:46:39 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:46:39 user nova-compute[75083]:       <nova:ports>
Nov 29 05:46:39 user nova-compute[75083]:         <nova:port uuid="576fd898-62e6-4bf7-a914-6b94081176b1">
Nov 29 05:46:39 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 05:46:39 user nova-compute[75083]:         </nova:port>
Nov 29 05:46:39 user nova-compute[75083]:       </nova:ports>
Nov 29 05:46:39 user nova-compute[75083]:     </nova:instance>
Nov 29 05:46:39 user nova-compute[75083]:   </metadata>
Nov 29 05:46:39 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:46:39 user nova-compute[75083]:     <system>
Nov 29 05:46:39 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:46:39 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:46:39 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:46:39 user nova-compute[75083]:       <entry name="serial">ae18699b-d0cf-44b5-8467-a112fd154580</entry>
Nov 29 05:46:39 user nova-compute[75083]:       <entry name="uuid">ae18699b-d0cf-44b5-8467-a112fd154580</entry>
Nov 29 05:46:39 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:46:39 user nova-compute[75083]:     </system>
Nov 29 05:46:39 user nova-compute[75083]:   </sysinfo>
Nov 29 05:46:39 user nova-compute[75083]:   <os>
Nov 29 05:46:39 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:46:39 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:46:39 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:46:39 user nova-compute[75083]:   </os>
Nov 29 05:46:39 user nova-compute[75083]:   <features>
Nov 29 05:46:39 user nova-compute[75083]:     <acpi/>
Nov 29 05:46:39 user nova-compute[75083]:     <apic/>
Nov 29 05:46:39 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:46:39 user nova-compute[75083]:   </features>
Nov 29 05:46:39 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:46:39 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:46:39 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:46:39 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:46:39 user nova-compute[75083]:   </clock>
Nov 29 05:46:39 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:46:39 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:46:39 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:46:39 user nova-compute[75083]:   </cpu>
Nov 29 05:46:39 user nova-compute[75083]:   <devices>
Nov 29 05:46:39 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:46:39 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:46:39 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk"/>
Nov 29 05:46:39 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:46:39 user nova-compute[75083]:     </disk>
Nov 29 05:46:39 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:46:39 user nova-compute[75083]:       <mac address="fa:16:3e:4f:5a:84"/>
Nov 29 05:46:39 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:46:39 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:46:39 user nova-compute[75083]:       <target dev="tap576fd898-62"/>
Nov 29 05:46:39 user nova-compute[75083]:     </interface>
Nov 29 05:46:39 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:46:39 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/console.log" append="off"/>
Nov 29 05:46:39 user nova-compute[75083]:     </serial>
Nov 29 05:46:39 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:46:39 user nova-compute[75083]:     <video>
Nov 29 05:46:39 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:46:39 user nova-compute[75083]:     </video>
Nov 29 05:46:39 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:46:39 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:46:39 user nova-compute[75083]:     </rng>
Nov 29 05:46:39 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:46:39 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:46:39 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:46:39 user nova-compute[75083]:     </memballoon>
Nov 29 05:46:39 user nova-compute[75083]:   </devices>
Nov 29 05:46:39 user nova-compute[75083]: </domain>
Nov 29 05:46:39 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-243593488',display_name='tempest-TestVolumeSwap-server-243593488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-243593488',id=7,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNk6U9fL+cCmVxUB+GYgbg3rqejQxUVvAg8+Adeq8b2M7Q6RgkPR2YnNwVLVM7MHhCaCXMaEP3DVETchA37HzlY6FfPgTRTzDZn1LwLlMZvDEpHKPLzWTLPN1YzMt/ZCVQ==',key_name='tempest-keypair-1787660746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e7f2ae08bd241fcaa60e97d864545f3',ramdisk_id='',reservation_id='r-0baugmjz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1735569809',owner_user_name='tempest-TestVolumeSwap-1735569809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:46:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b9424c8a1054c8f8128ef0f0a2b6dcf',uuid=ae18699b-d0cf-44b5-8467-a112fd154580,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "576fd898-62e6-4bf7-a914-6b94081176b1", "address": "fa:16:3e:4f:5a:84", "network": {"id": "e98dee6b-18b4-41c2-af52-23b9bead051d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-91142156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7f2ae08bd241fcaa60e97d864545f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576fd898-62", "ovs_interfaceid": "576fd898-62e6-4bf7-a914-6b94081176b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Converting VIF {"id": "576fd898-62e6-4bf7-a914-6b94081176b1", "address": "fa:16:3e:4f:5a:84", "network": {"id": "e98dee6b-18b4-41c2-af52-23b9bead051d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-91142156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7f2ae08bd241fcaa60e97d864545f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576fd898-62", "ovs_interfaceid": "576fd898-62e6-4bf7-a914-6b94081176b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:5a:84,bridge_name='br-int',has_traffic_filtering=True,id=576fd898-62e6-4bf7-a914-6b94081176b1,network=Network(e98dee6b-18b4-41c2-af52-23b9bead051d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap576fd898-62') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG os_vif [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:5a:84,bridge_name='br-int',has_traffic_filtering=True,id=576fd898-62e6-4bf7-a914-6b94081176b1,network=Network(e98dee6b-18b4-41c2-af52-23b9bead051d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap576fd898-62') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37869835-641b-55c8-beba-def61809c6d7', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap576fd898-62, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap576fd898-62, col_values=(('qos', UUID('5612df26-331e-46c3-bf48-1a771b86ba6c')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap576fd898-62, col_values=(('external_ids', {'iface-id': '576fd898-62e6-4bf7-a914-6b94081176b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:5a:84', 'vm-uuid': 'ae18699b-d0cf-44b5-8467-a112fd154580'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:39 user nova-compute[75083]: INFO os_vif [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:5a:84,bridge_name='br-int',has_traffic_filtering=True,id=576fd898-62e6-4bf7-a914-6b94081176b1,network=Network(e98dee6b-18b4-41c2-af52-23b9bead051d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap576fd898-62')
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.network.neutron [req-07548bde-09bb-42f5-b982-0015ebc408dc req-ed8486b1-c604-4cc6-8e46-7bc9570a61f9 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] No VIF found with MAC fa:16:3e:4f:5a:84, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-07548bde-09bb-42f5-b982-0015ebc408dc req-ed8486b1-c604-4cc6-8e46-7bc9570a61f9 service nova] Releasing lock "refresh_cache-b2f88b2e-0244-4e18-98ae-21861b02db3a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquired lock "refresh_cache-b2f88b2e-0244-4e18-98ae-21861b02db3a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Updating instance_info_cache with network_info: [{"id": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "address": "fa:16:3e:b3:28:72", "network": {"id": "acfa7005-35a1-408e-a897-5920887137b3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-302522629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac8517e-5b", "ovs_interfaceid": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Releasing lock "refresh_cache-b2f88b2e-0244-4e18-98ae-21861b02db3a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Instance network_info: |[{"id": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "address": "fa:16:3e:b3:28:72", "network": {"id": "acfa7005-35a1-408e-a897-5920887137b3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-302522629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac8517e-5b", "ovs_interfaceid": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Start _get_guest_xml network_info=[{"id": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "address": "fa:16:3e:b3:28:72", "network": {"id": "acfa7005-35a1-408e-a897-5920887137b3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-302522629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac8517e-5b", "ovs_interfaceid": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:46:39 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:46:39 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-435233267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-435233267',id=8,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVo1YmBFLd3yYkAIW3JoUP4JziHChmMQVX+ttBFc7qW+T8emUJzEuqgOO60aMaVCz4WsSuNB1wNEq+HNrQ09nJNiqezTzIp51WzgrWGg90AnD0HNS2LM7B+NhJDHUeq3A==',key_name='tempest-keypair-489296993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8916664e2bf04c018daedae140735f3a',ramdisk_id='',reservation_id='r-mli56wj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2091340319',owner_user_name='tempest-TaggedAttachmentsTest-2091340319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:46:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c746113481e4d179fba6e77efcee7a2',uuid=b2f88b2e-0244-4e18-98ae-21861b02db3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "address": "fa:16:3e:b3:28:72", "network": {"id": "acfa7005-35a1-408e-a897-5920887137b3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-302522629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac8517e-5b", "ovs_interfaceid": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Converting VIF {"id": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "address": "fa:16:3e:b3:28:72", "network": {"id": "acfa7005-35a1-408e-a897-5920887137b3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-302522629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac8517e-5b", "ovs_interfaceid": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:28:72,bridge_name='br-int',has_traffic_filtering=True,id=9ac8517e-5bf8-41ec-839e-40dcffd8a7ac,network=Network(acfa7005-35a1-408e-a897-5920887137b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac8517e-5b') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.objects.instance [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lazy-loading 'pci_devices' on Instance uuid b2f88b2e-0244-4e18-98ae-21861b02db3a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:46:39 user nova-compute[75083]:   <uuid>b2f88b2e-0244-4e18-98ae-21861b02db3a</uuid>
Nov 29 05:46:39 user nova-compute[75083]:   <name>instance-00000008</name>
Nov 29 05:46:39 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:46:39 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:46:39 user nova-compute[75083]:   <metadata>
Nov 29 05:46:39 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:46:39 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:46:39 user nova-compute[75083]:       <nova:name>tempest-device-tagging-server-435233267</nova:name>
Nov 29 05:46:39 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:46:39</nova:creationTime>
Nov 29 05:46:39 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:46:39 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:46:39 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:46:39 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:46:39 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:46:39 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:46:39 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:46:39 user nova-compute[75083]:       <nova:owner>
Nov 29 05:46:39 user nova-compute[75083]:         <nova:user uuid="9c746113481e4d179fba6e77efcee7a2">tempest-TaggedAttachmentsTest-2091340319-project-member</nova:user>
Nov 29 05:46:39 user nova-compute[75083]:         <nova:project uuid="8916664e2bf04c018daedae140735f3a">tempest-TaggedAttachmentsTest-2091340319</nova:project>
Nov 29 05:46:39 user nova-compute[75083]:       </nova:owner>
Nov 29 05:46:39 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:46:39 user nova-compute[75083]:       <nova:ports>
Nov 29 05:46:39 user nova-compute[75083]:         <nova:port uuid="9ac8517e-5bf8-41ec-839e-40dcffd8a7ac">
Nov 29 05:46:39 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 05:46:39 user nova-compute[75083]:         </nova:port>
Nov 29 05:46:39 user nova-compute[75083]:       </nova:ports>
Nov 29 05:46:39 user nova-compute[75083]:     </nova:instance>
Nov 29 05:46:39 user nova-compute[75083]:   </metadata>
Nov 29 05:46:39 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:46:39 user nova-compute[75083]:     <system>
Nov 29 05:46:39 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:46:39 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:46:39 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:46:39 user nova-compute[75083]:       <entry name="serial">b2f88b2e-0244-4e18-98ae-21861b02db3a</entry>
Nov 29 05:46:39 user nova-compute[75083]:       <entry name="uuid">b2f88b2e-0244-4e18-98ae-21861b02db3a</entry>
Nov 29 05:46:39 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:46:39 user nova-compute[75083]:     </system>
Nov 29 05:46:39 user nova-compute[75083]:   </sysinfo>
Nov 29 05:46:39 user nova-compute[75083]:   <os>
Nov 29 05:46:39 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:46:39 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:46:39 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:46:39 user nova-compute[75083]:   </os>
Nov 29 05:46:39 user nova-compute[75083]:   <features>
Nov 29 05:46:39 user nova-compute[75083]:     <acpi/>
Nov 29 05:46:39 user nova-compute[75083]:     <apic/>
Nov 29 05:46:39 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:46:39 user nova-compute[75083]:   </features>
Nov 29 05:46:39 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:46:39 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:46:39 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:46:39 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:46:39 user nova-compute[75083]:   </clock>
Nov 29 05:46:39 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:46:39 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:46:39 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:46:39 user nova-compute[75083]:   </cpu>
Nov 29 05:46:39 user nova-compute[75083]:   <devices>
Nov 29 05:46:39 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:46:39 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:46:39 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk"/>
Nov 29 05:46:39 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:46:39 user nova-compute[75083]:     </disk>
Nov 29 05:46:39 user nova-compute[75083]:     <disk type="file" device="cdrom">
Nov 29 05:46:39 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 05:46:39 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk.config"/>
Nov 29 05:46:39 user nova-compute[75083]:       <target dev="hda" bus="ide"/>
Nov 29 05:46:39 user nova-compute[75083]:     </disk>
Nov 29 05:46:39 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:46:39 user nova-compute[75083]:       <mac address="fa:16:3e:b3:28:72"/>
Nov 29 05:46:39 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:46:39 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:46:39 user nova-compute[75083]:       <target dev="tap9ac8517e-5b"/>
Nov 29 05:46:39 user nova-compute[75083]:     </interface>
Nov 29 05:46:39 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:46:39 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/console.log" append="off"/>
Nov 29 05:46:39 user nova-compute[75083]:     </serial>
Nov 29 05:46:39 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:46:39 user nova-compute[75083]:     <video>
Nov 29 05:46:39 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:46:39 user nova-compute[75083]:     </video>
Nov 29 05:46:39 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:46:39 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:46:39 user nova-compute[75083]:     </rng>
Nov 29 05:46:39 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:46:39 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:46:39 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:46:39 user nova-compute[75083]:     </memballoon>
Nov 29 05:46:39 user nova-compute[75083]:   </devices>
Nov 29 05:46:39 user nova-compute[75083]: </domain>
Nov 29 05:46:39 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-435233267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-435233267',id=8,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVo1YmBFLd3yYkAIW3JoUP4JziHChmMQVX+ttBFc7qW+T8emUJzEuqgOO60aMaVCz4WsSuNB1wNEq+HNrQ09nJNiqezTzIp51WzgrWGg90AnD0HNS2LM7B+NhJDHUeq3A==',key_name='tempest-keypair-489296993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8916664e2bf04c018daedae140735f3a',ramdisk_id='',reservation_id='r-mli56wj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2091340319',owner_user_name='tempest-TaggedAttachmentsTest-2091340319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:46:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c746113481e4d179fba6e77efcee7a2',uuid=b2f88b2e-0244-4e18-98ae-21861b02db3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "address": "fa:16:3e:b3:28:72", "network": {"id": "acfa7005-35a1-408e-a897-5920887137b3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-302522629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac8517e-5b", "ovs_interfaceid": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Converting VIF {"id": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "address": "fa:16:3e:b3:28:72", "network": {"id": "acfa7005-35a1-408e-a897-5920887137b3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-302522629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac8517e-5b", "ovs_interfaceid": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:28:72,bridge_name='br-int',has_traffic_filtering=True,id=9ac8517e-5bf8-41ec-839e-40dcffd8a7ac,network=Network(acfa7005-35a1-408e-a897-5920887137b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac8517e-5b') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG os_vif [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:28:72,bridge_name='br-int',has_traffic_filtering=True,id=9ac8517e-5bf8-41ec-839e-40dcffd8a7ac,network=Network(acfa7005-35a1-408e-a897-5920887137b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac8517e-5b') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9bb70923-d02e-5b1c-9d56-ee2983ff23df', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ac8517e-5b, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ac8517e-5b, col_values=(('qos', UUID('56643b98-1764-4f3e-8f4b-09c3f5cebeef')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ac8517e-5b, col_values=(('external_ids', {'iface-id': '9ac8517e-5bf8-41ec-839e-40dcffd8a7ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:28:72', 'vm-uuid': 'b2f88b2e-0244-4e18-98ae-21861b02db3a'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:39 user nova-compute[75083]: INFO os_vif [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:28:72,bridge_name='br-int',has_traffic_filtering=True,id=9ac8517e-5bf8-41ec-839e-40dcffd8a7ac,network=Network(acfa7005-35a1-408e-a897-5920887137b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac8517e-5b')
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] No BDM found with device name hda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:46:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] No VIF found with MAC fa:16:3e:b3:28:72, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:46:39 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Using config drive
Nov 29 05:46:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-4992513d-f610-4a66-aaa3-facfcd006eed req-ee476c37-a6ef-47ba-a501-e6ccec37872d service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Received event network-vif-plugged-6c418847-5bf6-4315-9acd-c743ce87f36c {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4992513d-f610-4a66-aaa3-facfcd006eed req-ee476c37-a6ef-47ba-a501-e6ccec37872d service nova] Acquiring lock "0414bda1-7b04-40ba-a693-44be9296e432-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4992513d-f610-4a66-aaa3-facfcd006eed req-ee476c37-a6ef-47ba-a501-e6ccec37872d service nova] Lock "0414bda1-7b04-40ba-a693-44be9296e432-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4992513d-f610-4a66-aaa3-facfcd006eed req-ee476c37-a6ef-47ba-a501-e6ccec37872d service nova] Lock "0414bda1-7b04-40ba-a693-44be9296e432-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-4992513d-f610-4a66-aaa3-facfcd006eed req-ee476c37-a6ef-47ba-a501-e6ccec37872d service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] No waiting events found dispatching network-vif-plugged-6c418847-5bf6-4315-9acd-c743ce87f36c {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:46:40 user nova-compute[75083]: WARNING nova.compute.manager [req-4992513d-f610-4a66-aaa3-facfcd006eed req-ee476c37-a6ef-47ba-a501-e6ccec37872d service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Received unexpected event network-vif-plugged-6c418847-5bf6-4315-9acd-c743ce87f36c for instance with vm_state building and task_state spawning.
Nov 29 05:46:40 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Creating config drive at /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk.config
Nov 29 05:46:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxh54efka {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxh54efka" returned: 0 in 0.053s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Acquiring lock "12989829-1b4c-4aaf-ad24-b30488c4e472" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Lock "12989829-1b4c-4aaf-ad24-b30488c4e472" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:41 user nova-compute[75083]: DEBUG nova.compute.manager [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:46:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:46:41 user nova-compute[75083]: INFO nova.compute.claims [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Claim successful on node user
Nov 29 05:46:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.674s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG nova.compute.manager [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG nova.compute.manager [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG nova.network.neutron [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:46:42 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:46:42 user nova-compute[75083]: DEBUG nova.compute.manager [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG nova.policy [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6de4aa0d366546268ed7254afaaf7b08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228d74739f504c8aa3a034742390113c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG nova.compute.manager [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:46:42 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Creating image(s)
Nov 29 05:46:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Acquiring lock "/opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Lock "/opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Lock "/opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.205s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-29e878bf-8da6-426a-9317-7e44843dd6fb req-68c97a93-1072-4609-8adc-9f46677c1c54 service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Received event network-vif-plugged-6c418847-5bf6-4315-9acd-c743ce87f36c {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-29e878bf-8da6-426a-9317-7e44843dd6fb req-68c97a93-1072-4609-8adc-9f46677c1c54 service nova] Acquiring lock "0414bda1-7b04-40ba-a693-44be9296e432-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-29e878bf-8da6-426a-9317-7e44843dd6fb req-68c97a93-1072-4609-8adc-9f46677c1c54 service nova] Lock "0414bda1-7b04-40ba-a693-44be9296e432-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-29e878bf-8da6-426a-9317-7e44843dd6fb req-68c97a93-1072-4609-8adc-9f46677c1c54 service nova] Lock "0414bda1-7b04-40ba-a693-44be9296e432-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-29e878bf-8da6-426a-9317-7e44843dd6fb req-68c97a93-1072-4609-8adc-9f46677c1c54 service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] No waiting events found dispatching network-vif-plugged-6c418847-5bf6-4315-9acd-c743ce87f36c {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:46:42 user nova-compute[75083]: WARNING nova.compute.manager [req-29e878bf-8da6-426a-9317-7e44843dd6fb req-68c97a93-1072-4609-8adc-9f46677c1c54 service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Received unexpected event network-vif-plugged-6c418847-5bf6-4315-9acd-c743ce87f36c for instance with vm_state building and task_state spawning.
Nov 29 05:46:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-29e878bf-8da6-426a-9317-7e44843dd6fb req-68c97a93-1072-4609-8adc-9f46677c1c54 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Received event network-vif-plugged-576fd898-62e6-4bf7-a914-6b94081176b1 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-29e878bf-8da6-426a-9317-7e44843dd6fb req-68c97a93-1072-4609-8adc-9f46677c1c54 service nova] Acquiring lock "ae18699b-d0cf-44b5-8467-a112fd154580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-29e878bf-8da6-426a-9317-7e44843dd6fb req-68c97a93-1072-4609-8adc-9f46677c1c54 service nova] Lock "ae18699b-d0cf-44b5-8467-a112fd154580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-29e878bf-8da6-426a-9317-7e44843dd6fb req-68c97a93-1072-4609-8adc-9f46677c1c54 service nova] Lock "ae18699b-d0cf-44b5-8467-a112fd154580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-29e878bf-8da6-426a-9317-7e44843dd6fb req-68c97a93-1072-4609-8adc-9f46677c1c54 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] No waiting events found dispatching network-vif-plugged-576fd898-62e6-4bf7-a914-6b94081176b1 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:46:42 user nova-compute[75083]: WARNING nova.compute.manager [req-29e878bf-8da6-426a-9317-7e44843dd6fb req-68c97a93-1072-4609-8adc-9f46677c1c54 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Received unexpected event network-vif-plugged-576fd898-62e6-4bf7-a914-6b94081176b1 for instance with vm_state building and task_state spawning.
Nov 29 05:46:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-29e878bf-8da6-426a-9317-7e44843dd6fb req-68c97a93-1072-4609-8adc-9f46677c1c54 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Received event network-vif-plugged-576fd898-62e6-4bf7-a914-6b94081176b1 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-29e878bf-8da6-426a-9317-7e44843dd6fb req-68c97a93-1072-4609-8adc-9f46677c1c54 service nova] Acquiring lock "ae18699b-d0cf-44b5-8467-a112fd154580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-29e878bf-8da6-426a-9317-7e44843dd6fb req-68c97a93-1072-4609-8adc-9f46677c1c54 service nova] Lock "ae18699b-d0cf-44b5-8467-a112fd154580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-29e878bf-8da6-426a-9317-7e44843dd6fb req-68c97a93-1072-4609-8adc-9f46677c1c54 service nova] Lock "ae18699b-d0cf-44b5-8467-a112fd154580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-29e878bf-8da6-426a-9317-7e44843dd6fb req-68c97a93-1072-4609-8adc-9f46677c1c54 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] No waiting events found dispatching network-vif-plugged-576fd898-62e6-4bf7-a914-6b94081176b1 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:46:42 user nova-compute[75083]: WARNING nova.compute.manager [req-29e878bf-8da6-426a-9317-7e44843dd6fb req-68c97a93-1072-4609-8adc-9f46677c1c54 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Received unexpected event network-vif-plugged-576fd898-62e6-4bf7-a914-6b94081176b1 for instance with vm_state building and task_state spawning.
Nov 29 05:46:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.200s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk 1073741824" returned: 0 in 0.055s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG nova.network.neutron [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Successfully created port: ccdce1d3-0ef3-437b-aaab-383bc235b27f {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.206s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Cannot resize image /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Ensure instance console log exists: /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG nova.network.neutron [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Successfully updated port: ccdce1d3-0ef3-437b-aaab-383bc235b27f {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Acquiring lock "refresh_cache-12989829-1b4c-4aaf-ad24-b30488c4e472" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Acquired lock "refresh_cache-12989829-1b4c-4aaf-ad24-b30488c4e472" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG nova.network.neutron [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:46:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.compute.manager [req-5a34d27d-08dd-447c-8c4b-cdc7556196ec req-f8dd2505-ec30-4a8f-a875-aff94937819c service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Received event network-changed-ccdce1d3-0ef3-437b-aaab-383bc235b27f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.compute.manager [req-5a34d27d-08dd-447c-8c4b-cdc7556196ec req-f8dd2505-ec30-4a8f-a875-aff94937819c service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Refreshing instance network info cache due to event network-changed-ccdce1d3-0ef3-437b-aaab-383bc235b27f. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5a34d27d-08dd-447c-8c4b-cdc7556196ec req-f8dd2505-ec30-4a8f-a875-aff94937819c service nova] Acquiring lock "refresh_cache-12989829-1b4c-4aaf-ad24-b30488c4e472" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.network.neutron [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.compute.manager [req-50f04366-ca4f-49df-a7d5-4136bab1ad14 req-c82c4a5b-d098-4b5c-b330-a4cc78f9a20f service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Received event network-vif-plugged-188d4866-21b0-4a1e-a17a-c0c82e849726 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-50f04366-ca4f-49df-a7d5-4136bab1ad14 req-c82c4a5b-d098-4b5c-b330-a4cc78f9a20f service nova] Acquiring lock "161c6455-90ce-4c40-a33e-7f582989135d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-50f04366-ca4f-49df-a7d5-4136bab1ad14 req-c82c4a5b-d098-4b5c-b330-a4cc78f9a20f service nova] Lock "161c6455-90ce-4c40-a33e-7f582989135d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-50f04366-ca4f-49df-a7d5-4136bab1ad14 req-c82c4a5b-d098-4b5c-b330-a4cc78f9a20f service nova] Lock "161c6455-90ce-4c40-a33e-7f582989135d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.compute.manager [req-50f04366-ca4f-49df-a7d5-4136bab1ad14 req-c82c4a5b-d098-4b5c-b330-a4cc78f9a20f service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] No waiting events found dispatching network-vif-plugged-188d4866-21b0-4a1e-a17a-c0c82e849726 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:46:44 user nova-compute[75083]: WARNING nova.compute.manager [req-50f04366-ca4f-49df-a7d5-4136bab1ad14 req-c82c4a5b-d098-4b5c-b330-a4cc78f9a20f service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Received unexpected event network-vif-plugged-188d4866-21b0-4a1e-a17a-c0c82e849726 for instance with vm_state active and task_state None.
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.network.neutron [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Updating instance_info_cache with network_info: [{"id": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "address": "fa:16:3e:47:af:1e", "network": {"id": "7b7dbeb9-8470-4f69-9c8d-537c75e4c009", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-386572162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228d74739f504c8aa3a034742390113c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccdce1d3-0e", "ovs_interfaceid": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Releasing lock "refresh_cache-12989829-1b4c-4aaf-ad24-b30488c4e472" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.compute.manager [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Instance network_info: |[{"id": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "address": "fa:16:3e:47:af:1e", "network": {"id": "7b7dbeb9-8470-4f69-9c8d-537c75e4c009", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-386572162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228d74739f504c8aa3a034742390113c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccdce1d3-0e", "ovs_interfaceid": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5a34d27d-08dd-447c-8c4b-cdc7556196ec req-f8dd2505-ec30-4a8f-a875-aff94937819c service nova] Acquired lock "refresh_cache-12989829-1b4c-4aaf-ad24-b30488c4e472" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.network.neutron [req-5a34d27d-08dd-447c-8c4b-cdc7556196ec req-f8dd2505-ec30-4a8f-a875-aff94937819c service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Refreshing network info cache for port ccdce1d3-0ef3-437b-aaab-383bc235b27f {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Start _get_guest_xml network_info=[{"id": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "address": "fa:16:3e:47:af:1e", "network": {"id": "7b7dbeb9-8470-4f69-9c8d-537c75e4c009", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-386572162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228d74739f504c8aa3a034742390113c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccdce1d3-0e", "ovs_interfaceid": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:46:44 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:46:44 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-981525727',display_name='tempest-VolumesAssistedSnapshotsTest-server-981525727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-981525727',id=9,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUF3io1TF9VV8r8jVCmuijZpXkF6gU8DDpNCqepn2zLZd23+Ke1vrmDTusSKcyGICYvwnXlf6mWnVBaNEbz3gvN1a7lr7DUheCMYD1wc949VJw4kUjigQa/psy1MBShbw==',key_name='tempest-keypair-583905881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='228d74739f504c8aa3a034742390113c',ramdisk_id='',reservation_id='r-fwlp05s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1291886007',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1291886007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:46:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6de4aa0d366546268ed7254afaaf7b08',uuid=12989829-1b4c-4aaf-ad24-b30488c4e472,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "address": "fa:16:3e:47:af:1e", "network": {"id": "7b7dbeb9-8470-4f69-9c8d-537c75e4c009", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-386572162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228d74739f504c8aa3a034742390113c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccdce1d3-0e", "ovs_interfaceid": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Converting VIF {"id": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "address": "fa:16:3e:47:af:1e", "network": {"id": "7b7dbeb9-8470-4f69-9c8d-537c75e4c009", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-386572162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228d74739f504c8aa3a034742390113c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccdce1d3-0e", "ovs_interfaceid": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:af:1e,bridge_name='br-int',has_traffic_filtering=True,id=ccdce1d3-0ef3-437b-aaab-383bc235b27f,network=Network(7b7dbeb9-8470-4f69-9c8d-537c75e4c009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccdce1d3-0e') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.objects.instance [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Lazy-loading 'pci_devices' on Instance uuid 12989829-1b4c-4aaf-ad24-b30488c4e472 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:46:44 user nova-compute[75083]:   <uuid>12989829-1b4c-4aaf-ad24-b30488c4e472</uuid>
Nov 29 05:46:44 user nova-compute[75083]:   <name>instance-00000009</name>
Nov 29 05:46:44 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:46:44 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:46:44 user nova-compute[75083]:   <metadata>
Nov 29 05:46:44 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:46:44 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:46:44 user nova-compute[75083]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-981525727</nova:name>
Nov 29 05:46:44 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:46:44</nova:creationTime>
Nov 29 05:46:44 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:46:44 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:46:44 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:46:44 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:46:44 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:46:44 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:46:44 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:46:44 user nova-compute[75083]:       <nova:owner>
Nov 29 05:46:44 user nova-compute[75083]:         <nova:user uuid="6de4aa0d366546268ed7254afaaf7b08">tempest-VolumesAssistedSnapshotsTest-1291886007-project-member</nova:user>
Nov 29 05:46:44 user nova-compute[75083]:         <nova:project uuid="228d74739f504c8aa3a034742390113c">tempest-VolumesAssistedSnapshotsTest-1291886007</nova:project>
Nov 29 05:46:44 user nova-compute[75083]:       </nova:owner>
Nov 29 05:46:44 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:46:44 user nova-compute[75083]:       <nova:ports>
Nov 29 05:46:44 user nova-compute[75083]:         <nova:port uuid="ccdce1d3-0ef3-437b-aaab-383bc235b27f">
Nov 29 05:46:44 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 05:46:44 user nova-compute[75083]:         </nova:port>
Nov 29 05:46:44 user nova-compute[75083]:       </nova:ports>
Nov 29 05:46:44 user nova-compute[75083]:     </nova:instance>
Nov 29 05:46:44 user nova-compute[75083]:   </metadata>
Nov 29 05:46:44 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:46:44 user nova-compute[75083]:     <system>
Nov 29 05:46:44 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:46:44 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:46:44 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:46:44 user nova-compute[75083]:       <entry name="serial">12989829-1b4c-4aaf-ad24-b30488c4e472</entry>
Nov 29 05:46:44 user nova-compute[75083]:       <entry name="uuid">12989829-1b4c-4aaf-ad24-b30488c4e472</entry>
Nov 29 05:46:44 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:46:44 user nova-compute[75083]:     </system>
Nov 29 05:46:44 user nova-compute[75083]:   </sysinfo>
Nov 29 05:46:44 user nova-compute[75083]:   <os>
Nov 29 05:46:44 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:46:44 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:46:44 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:46:44 user nova-compute[75083]:   </os>
Nov 29 05:46:44 user nova-compute[75083]:   <features>
Nov 29 05:46:44 user nova-compute[75083]:     <acpi/>
Nov 29 05:46:44 user nova-compute[75083]:     <apic/>
Nov 29 05:46:44 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:46:44 user nova-compute[75083]:   </features>
Nov 29 05:46:44 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:46:44 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:46:44 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:46:44 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:46:44 user nova-compute[75083]:   </clock>
Nov 29 05:46:44 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:46:44 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:46:44 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:46:44 user nova-compute[75083]:   </cpu>
Nov 29 05:46:44 user nova-compute[75083]:   <devices>
Nov 29 05:46:44 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:46:44 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:46:44 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk"/>
Nov 29 05:46:44 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:46:44 user nova-compute[75083]:     </disk>
Nov 29 05:46:44 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:46:44 user nova-compute[75083]:       <mac address="fa:16:3e:47:af:1e"/>
Nov 29 05:46:44 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:46:44 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:46:44 user nova-compute[75083]:       <target dev="tapccdce1d3-0e"/>
Nov 29 05:46:44 user nova-compute[75083]:     </interface>
Nov 29 05:46:44 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:46:44 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/console.log" append="off"/>
Nov 29 05:46:44 user nova-compute[75083]:     </serial>
Nov 29 05:46:44 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:46:44 user nova-compute[75083]:     <video>
Nov 29 05:46:44 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:46:44 user nova-compute[75083]:     </video>
Nov 29 05:46:44 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:46:44 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:46:44 user nova-compute[75083]:     </rng>
Nov 29 05:46:44 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:46:44 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:46:44 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:46:44 user nova-compute[75083]:     </memballoon>
Nov 29 05:46:44 user nova-compute[75083]:   </devices>
Nov 29 05:46:44 user nova-compute[75083]: </domain>
Nov 29 05:46:44 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-981525727',display_name='tempest-VolumesAssistedSnapshotsTest-server-981525727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-981525727',id=9,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUF3io1TF9VV8r8jVCmuijZpXkF6gU8DDpNCqepn2zLZd23+Ke1vrmDTusSKcyGICYvwnXlf6mWnVBaNEbz3gvN1a7lr7DUheCMYD1wc949VJw4kUjigQa/psy1MBShbw==',key_name='tempest-keypair-583905881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='228d74739f504c8aa3a034742390113c',ramdisk_id='',reservation_id='r-fwlp05s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1291886007',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1291886007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:46:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6de4aa0d366546268ed7254afaaf7b08',uuid=12989829-1b4c-4aaf-ad24-b30488c4e472,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "address": "fa:16:3e:47:af:1e", "network": {"id": "7b7dbeb9-8470-4f69-9c8d-537c75e4c009", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-386572162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228d74739f504c8aa3a034742390113c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccdce1d3-0e", "ovs_interfaceid": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Converting VIF {"id": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "address": "fa:16:3e:47:af:1e", "network": {"id": "7b7dbeb9-8470-4f69-9c8d-537c75e4c009", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-386572162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228d74739f504c8aa3a034742390113c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccdce1d3-0e", "ovs_interfaceid": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:af:1e,bridge_name='br-int',has_traffic_filtering=True,id=ccdce1d3-0ef3-437b-aaab-383bc235b27f,network=Network(7b7dbeb9-8470-4f69-9c8d-537c75e4c009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccdce1d3-0e') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG os_vif [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:af:1e,bridge_name='br-int',has_traffic_filtering=True,id=ccdce1d3-0ef3-437b-aaab-383bc235b27f,network=Network(7b7dbeb9-8470-4f69-9c8d-537c75e4c009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccdce1d3-0e') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c26b74fd-877f-56b9-87a9-c76e5aacf3de', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccdce1d3-0e, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapccdce1d3-0e, col_values=(('qos', UUID('fe39952c-ed59-4a4b-bb49-ac7fdfcd0081')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapccdce1d3-0e, col_values=(('external_ids', {'iface-id': 'ccdce1d3-0ef3-437b-aaab-383bc235b27f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:af:1e', 'vm-uuid': '12989829-1b4c-4aaf-ad24-b30488c4e472'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:44 user nova-compute[75083]: INFO os_vif [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:af:1e,bridge_name='br-int',has_traffic_filtering=True,id=ccdce1d3-0ef3-437b-aaab-383bc235b27f,network=Network(7b7dbeb9-8470-4f69-9c8d-537c75e4c009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccdce1d3-0e')
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] No VIF found with MAC fa:16:3e:47:af:1e, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.compute.manager [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:46:44 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Instance spawned successfully.
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:44 user nova-compute[75083]: INFO nova.compute.manager [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Took 15.89 seconds to spawn the instance on the hypervisor.
Nov 29 05:46:44 user nova-compute[75083]: DEBUG nova.compute.manager [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:46:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:45 user nova-compute[75083]: INFO nova.compute.manager [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Took 17.23 seconds to build instance.
Nov 29 05:46:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-33e1a2ef-1b50-4111-8bbd-f51a2832b7b7 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "0414bda1-7b04-40ba-a693-44be9296e432" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.363s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:45 user nova-compute[75083]: DEBUG nova.network.neutron [req-5a34d27d-08dd-447c-8c4b-cdc7556196ec req-f8dd2505-ec30-4a8f-a875-aff94937819c service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Updated VIF entry in instance network info cache for port ccdce1d3-0ef3-437b-aaab-383bc235b27f. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:46:45 user nova-compute[75083]: DEBUG nova.network.neutron [req-5a34d27d-08dd-447c-8c4b-cdc7556196ec req-f8dd2505-ec30-4a8f-a875-aff94937819c service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Updating instance_info_cache with network_info: [{"id": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "address": "fa:16:3e:47:af:1e", "network": {"id": "7b7dbeb9-8470-4f69-9c8d-537c75e4c009", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-386572162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228d74739f504c8aa3a034742390113c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccdce1d3-0e", "ovs_interfaceid": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:46:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5a34d27d-08dd-447c-8c4b-cdc7556196ec req-f8dd2505-ec30-4a8f-a875-aff94937819c service nova] Releasing lock "refresh_cache-12989829-1b4c-4aaf-ad24-b30488c4e472" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:46:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:46:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:46:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:46:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:46:45 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Instance spawned successfully.
Nov 29 05:46:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:46:45 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Instance spawned successfully.
Nov 29 05:46:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:46:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:46 user nova-compute[75083]: INFO nova.compute.manager [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Took 12.50 seconds to spawn the instance on the hypervisor.
Nov 29 05:46:46 user nova-compute[75083]: DEBUG nova.compute.manager [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:46:46 user nova-compute[75083]: INFO nova.compute.manager [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Took 10.88 seconds to spawn the instance on the hypervisor.
Nov 29 05:46:46 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:46:46 user nova-compute[75083]: DEBUG nova.compute.manager [req-ab992544-fbf9-42ce-95a7-f782346b41a4 req-c405951e-dd78-49d8-9c51-325eb6367e0b service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received event network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ab992544-fbf9-42ce-95a7-f782346b41a4 req-c405951e-dd78-49d8-9c51-325eb6367e0b service nova] Acquiring lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ab992544-fbf9-42ce-95a7-f782346b41a4 req-c405951e-dd78-49d8-9c51-325eb6367e0b service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ab992544-fbf9-42ce-95a7-f782346b41a4 req-c405951e-dd78-49d8-9c51-325eb6367e0b service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:46 user nova-compute[75083]: DEBUG nova.compute.manager [req-ab992544-fbf9-42ce-95a7-f782346b41a4 req-c405951e-dd78-49d8-9c51-325eb6367e0b service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] No waiting events found dispatching network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:46:46 user nova-compute[75083]: WARNING nova.compute.manager [req-ab992544-fbf9-42ce-95a7-f782346b41a4 req-c405951e-dd78-49d8-9c51-325eb6367e0b service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received unexpected event network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 for instance with vm_state active and task_state None.
Nov 29 05:46:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:46 user nova-compute[75083]: INFO nova.compute.manager [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Took 14.13 seconds to build instance.
Nov 29 05:46:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:46 user nova-compute[75083]: DEBUG nova.compute.manager [req-fd6cb21c-ae2a-4f26-ba5e-e82abc011ad8 req-9b23c3cd-d2c7-4d38-b04e-7a6b866367a5 service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Received event network-vif-plugged-188d4866-21b0-4a1e-a17a-c0c82e849726 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fd6cb21c-ae2a-4f26-ba5e-e82abc011ad8 req-9b23c3cd-d2c7-4d38-b04e-7a6b866367a5 service nova] Acquiring lock "161c6455-90ce-4c40-a33e-7f582989135d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fd6cb21c-ae2a-4f26-ba5e-e82abc011ad8 req-9b23c3cd-d2c7-4d38-b04e-7a6b866367a5 service nova] Lock "161c6455-90ce-4c40-a33e-7f582989135d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fd6cb21c-ae2a-4f26-ba5e-e82abc011ad8 req-9b23c3cd-d2c7-4d38-b04e-7a6b866367a5 service nova] Lock "161c6455-90ce-4c40-a33e-7f582989135d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:46 user nova-compute[75083]: DEBUG nova.compute.manager [req-fd6cb21c-ae2a-4f26-ba5e-e82abc011ad8 req-9b23c3cd-d2c7-4d38-b04e-7a6b866367a5 service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] No waiting events found dispatching network-vif-plugged-188d4866-21b0-4a1e-a17a-c0c82e849726 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:46:46 user nova-compute[75083]: WARNING nova.compute.manager [req-fd6cb21c-ae2a-4f26-ba5e-e82abc011ad8 req-9b23c3cd-d2c7-4d38-b04e-7a6b866367a5 service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Received unexpected event network-vif-plugged-188d4866-21b0-4a1e-a17a-c0c82e849726 for instance with vm_state active and task_state None.
Nov 29 05:46:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c662b18-52de-423c-b8b3-80cab8b2c955 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "ae18699b-d0cf-44b5-8467-a112fd154580" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.392s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:46 user nova-compute[75083]: INFO nova.compute.manager [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Took 13.73 seconds to build instance.
Nov 29 05:46:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd9977ec-7ccb-4f96-8b84-a5839adeb9fd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.035s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:48 user nova-compute[75083]: DEBUG nova.compute.manager [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received event network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] Acquiring lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:48 user nova-compute[75083]: DEBUG nova.compute.manager [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] No waiting events found dispatching network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:46:48 user nova-compute[75083]: WARNING nova.compute.manager [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received unexpected event network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 for instance with vm_state active and task_state None.
Nov 29 05:46:48 user nova-compute[75083]: DEBUG nova.compute.manager [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received event network-vif-plugged-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] Acquiring lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:48 user nova-compute[75083]: DEBUG nova.compute.manager [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] No waiting events found dispatching network-vif-plugged-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:46:48 user nova-compute[75083]: WARNING nova.compute.manager [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received unexpected event network-vif-plugged-8c103582-6856-45ff-ac2b-7a30d3138c75 for instance with vm_state active and task_state None.
Nov 29 05:46:48 user nova-compute[75083]: DEBUG nova.compute.manager [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received event network-vif-plugged-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] Acquiring lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:48 user nova-compute[75083]: DEBUG nova.compute.manager [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] No waiting events found dispatching network-vif-plugged-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:46:48 user nova-compute[75083]: WARNING nova.compute.manager [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received unexpected event network-vif-plugged-8c103582-6856-45ff-ac2b-7a30d3138c75 for instance with vm_state active and task_state None.
Nov 29 05:46:48 user nova-compute[75083]: DEBUG nova.compute.manager [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Received event network-vif-plugged-ccdce1d3-0ef3-437b-aaab-383bc235b27f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] Acquiring lock "12989829-1b4c-4aaf-ad24-b30488c4e472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] Lock "12989829-1b4c-4aaf-ad24-b30488c4e472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] Lock "12989829-1b4c-4aaf-ad24-b30488c4e472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:48 user nova-compute[75083]: DEBUG nova.compute.manager [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] No waiting events found dispatching network-vif-plugged-ccdce1d3-0ef3-437b-aaab-383bc235b27f {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:46:48 user nova-compute[75083]: WARNING nova.compute.manager [req-5e22567d-cb4e-435f-9110-2cdb5a5daf48 req-17123309-1a7b-4ec4-9df7-7523eac1bc0d service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Received unexpected event network-vif-plugged-ccdce1d3-0ef3-437b-aaab-383bc235b27f for instance with vm_state building and task_state spawning.
Nov 29 05:46:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:46:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:46:49 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Instance spawned successfully.
Nov 29 05:46:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:46:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:46:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:46:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 05:46:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] There are 0 instances to clean {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 05:46:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:46:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75083) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 05:46:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:46:49 user nova-compute[75083]: INFO nova.compute.manager [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Took 7.05 seconds to spawn the instance on the hypervisor.
Nov 29 05:46:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:46:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:49 user nova-compute[75083]: INFO nova.compute.manager [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Took 8.33 seconds to build instance.
Nov 29 05:46:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e93b2663-86dc-461c-ac3a-dbf203a55e9b tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Lock "12989829-1b4c-4aaf-ad24-b30488c4e472" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.455s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:50 user nova-compute[75083]: DEBUG nova.compute.manager [req-354b564a-4f93-416c-8c75-e901d017433f req-edfc7c13-c65c-449a-890b-129190a9b423 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received event network-vif-plugged-9ac8517e-5bf8-41ec-839e-40dcffd8a7ac {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-354b564a-4f93-416c-8c75-e901d017433f req-edfc7c13-c65c-449a-890b-129190a9b423 service nova] Acquiring lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-354b564a-4f93-416c-8c75-e901d017433f req-edfc7c13-c65c-449a-890b-129190a9b423 service nova] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-354b564a-4f93-416c-8c75-e901d017433f req-edfc7c13-c65c-449a-890b-129190a9b423 service nova] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:50 user nova-compute[75083]: DEBUG nova.compute.manager [req-354b564a-4f93-416c-8c75-e901d017433f req-edfc7c13-c65c-449a-890b-129190a9b423 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] No waiting events found dispatching network-vif-plugged-9ac8517e-5bf8-41ec-839e-40dcffd8a7ac {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:46:50 user nova-compute[75083]: WARNING nova.compute.manager [req-354b564a-4f93-416c-8c75-e901d017433f req-edfc7c13-c65c-449a-890b-129190a9b423 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received unexpected event network-vif-plugged-9ac8517e-5bf8-41ec-839e-40dcffd8a7ac for instance with vm_state active and task_state None.
Nov 29 05:46:50 user nova-compute[75083]: DEBUG nova.compute.manager [req-10faf51e-f8d7-42a9-bf00-c464c9e4c827 req-2391e8ec-0dd8-4ee4-b422-00c85aa340c0 service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Received event network-vif-plugged-ccdce1d3-0ef3-437b-aaab-383bc235b27f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-10faf51e-f8d7-42a9-bf00-c464c9e4c827 req-2391e8ec-0dd8-4ee4-b422-00c85aa340c0 service nova] Acquiring lock "12989829-1b4c-4aaf-ad24-b30488c4e472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-10faf51e-f8d7-42a9-bf00-c464c9e4c827 req-2391e8ec-0dd8-4ee4-b422-00c85aa340c0 service nova] Lock "12989829-1b4c-4aaf-ad24-b30488c4e472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-10faf51e-f8d7-42a9-bf00-c464c9e4c827 req-2391e8ec-0dd8-4ee4-b422-00c85aa340c0 service nova] Lock "12989829-1b4c-4aaf-ad24-b30488c4e472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:50 user nova-compute[75083]: DEBUG nova.compute.manager [req-10faf51e-f8d7-42a9-bf00-c464c9e4c827 req-2391e8ec-0dd8-4ee4-b422-00c85aa340c0 service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] No waiting events found dispatching network-vif-plugged-ccdce1d3-0ef3-437b-aaab-383bc235b27f {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:46:50 user nova-compute[75083]: WARNING nova.compute.manager [req-10faf51e-f8d7-42a9-bf00-c464c9e4c827 req-2391e8ec-0dd8-4ee4-b422-00c85aa340c0 service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Received unexpected event network-vif-plugged-ccdce1d3-0ef3-437b-aaab-383bc235b27f for instance with vm_state active and task_state None.
Nov 29 05:46:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:46:52 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:46:52 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:46:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 05:46:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 05:46:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:46:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:46:52 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 05:46:52 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lazy-loading 'info_cache' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:46:52 user nova-compute[75083]: DEBUG nova.compute.manager [req-fef796e3-bfb0-479c-b1c7-1a89d0fe641d req-583360f8-179d-4d4b-b0d3-5ad2e45fec40 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received event network-vif-plugged-9ac8517e-5bf8-41ec-839e-40dcffd8a7ac {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:46:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fef796e3-bfb0-479c-b1c7-1a89d0fe641d req-583360f8-179d-4d4b-b0d3-5ad2e45fec40 service nova] Acquiring lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fef796e3-bfb0-479c-b1c7-1a89d0fe641d req-583360f8-179d-4d4b-b0d3-5ad2e45fec40 service nova] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fef796e3-bfb0-479c-b1c7-1a89d0fe641d req-583360f8-179d-4d4b-b0d3-5ad2e45fec40 service nova] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:52 user nova-compute[75083]: DEBUG nova.compute.manager [req-fef796e3-bfb0-479c-b1c7-1a89d0fe641d req-583360f8-179d-4d4b-b0d3-5ad2e45fec40 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] No waiting events found dispatching network-vif-plugged-9ac8517e-5bf8-41ec-839e-40dcffd8a7ac {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:46:52 user nova-compute[75083]: WARNING nova.compute.manager [req-fef796e3-bfb0-479c-b1c7-1a89d0fe641d req-583360f8-179d-4d4b-b0d3-5ad2e45fec40 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received unexpected event network-vif-plugged-9ac8517e-5bf8-41ec-839e-40dcffd8a7ac for instance with vm_state active and task_state None.
Nov 29 05:46:53 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Updating instance_info_cache with network_info: [{"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:46:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:46:53 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 05:46:53 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:46:53 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:46:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:53 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 05:46:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk --force-share --output=json" returned: 0 in 0.339s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:46:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:58 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:46:58 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=7668MB free_disk=25.64163589477539GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance e6d49806-cecd-473a-b92f-9255868d35c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 303f0c67-e197-4d49-b131-8c99d50d7fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance ee1bba24-17d0-4fc3-8bff-1337d86cc9be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 47437526-c4e4-4a15-ba9b-51bbae17c77b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 161c6455-90ce-4c40-a33e-7f582989135d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 0414bda1-7b04-40ba-a693-44be9296e432 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance ae18699b-d0cf-44b5-8467-a112fd154580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b2f88b2e-0244-4e18-98ae-21861b02db3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 12989829-1b4c-4aaf-ad24-b30488c4e472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 0f45ac21-017c-4247-b2ae-756ae1c12911 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance e8fe9965-822d-4058-a031-e71b5fb03db4 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing inventories for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Updating ProviderTree inventory for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Updating inventory in ProviderTree for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing aggregate associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, aggregates: None {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 05:46:58 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing trait associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, traits: HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 05:46:59 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:46:59 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:46:59 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 05:46:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.916s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.630s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:59 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:46:59 user nova-compute[75083]: INFO nova.compute.claims [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Claim successful on node user
Nov 29 05:46:59 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:46:59 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:46:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:46:59 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:46:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.990s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:46:59 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:46:59 user nova-compute[75083]: INFO nova.compute.claims [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Claim successful on node user
Nov 29 05:46:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:46:59 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:46:59 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:46:59 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:46:59 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:46:59 user nova-compute[75083]: INFO nova.virt.block_device [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Booting with volume 2aa95ada-7a3b-46fd-9ca0-b74053557a0c at /dev/vda
Nov 29 05:46:59 user nova-compute[75083]: DEBUG nova.policy [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ac161fa6da3443a9d8201e0714b4fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24f07ef08334fea827629fdf234ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:47:00 user nova-compute[75083]: DEBUG os_brick.utils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:47:00 user nova-compute[75083]: INFO oslo.privsep.daemon [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpknef1a32/privsep.sock']
Nov 29 05:47:00 user sudo[85978]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpknef1a32/privsep.sock
Nov 29 05:47:00 user sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 05:47:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:47:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:47:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:47:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:47:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 05:47:00 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:47:00 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:47:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.826s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:47:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:47:00 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:47:00 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:47:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:47:00 user nova-compute[75083]: INFO nova.virt.block_device [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Booting with volume e1bd378b-277c-40a6-9292-e87b013b8ba0 at /dev/vda
Nov 29 05:47:00 user nova-compute[75083]: DEBUG nova.policy [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72c70230bafc432daad785bc45c76f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d83eb8afd744209d2f156412f867b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:47:00 user nova-compute[75083]: DEBUG os_brick.utils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:47:00 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Successfully created port: 750d3bad-3dc1-4a84-afd5-39f7d814da39 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:47:01 user sudo[85978]: pam_unix(sudo:session): session closed for user root
Nov 29 05:47:01 user nova-compute[75083]: INFO oslo.privsep.daemon [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Spawned new privsep daemon via rootwrap
Nov 29 05:47:01 user nova-compute[75083]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 05:47:01 user nova-compute[75083]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 05:47:01 user nova-compute[75083]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 29 05:47:01 user nova-compute[75083]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86165
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0413775-2ebc-4a2d-a314-724390f8665e]: (2,) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:01 user nova-compute[75083]: WARNING oslo_privsep.priv_context [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] privsep daemon already running
Nov 29 05:47:01 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Successfully created port: 91851640-12fe-4910-bc52-dd499dfcb1cf {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[781147e9-0b7b-4576-9950-60caa936df5f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:01 user nova-compute[75083]: WARNING os_brick.initiator.connectors.nvmeof [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[54319dfa-70af-4876-8cd3-fe74a88adb74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e10f4b6-d669-4026-9b53-f8cb1a5a19fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.034s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e211e8-95d8-4a7b-8091-0eed7cdc35db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7478d65-4d18-4a71-a059-253a8c377fc2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a83baaa-627f-472e-b8f5-b5287e29fc88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d14df83-40f8-40fa-83a3-0a27b0b074a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[58335e10-cd7f-4b6f-b0da-a7e41a931d37]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:47:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:47:02 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:47:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04b2eac-8439-4824-b584-60be16058d08]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:47:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:47:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:47:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:47:02 user nova-compute[75083]: DEBUG os_brick.utils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] <== get_connector_properties: return (1170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:47:02 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Updating existing volume attachment record: 0d817260-afcc-46b0-8c2d-aad7a069d0a9 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:47:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:47:02 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:47:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2663b8e9-0b72-4b8b-b705-e80b3e5e3ba9]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:47:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:47:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:47:02 user nova-compute[75083]: DEBUG os_brick.utils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] <== get_connector_properties: return (2034ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:47:02 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Updating existing volume attachment record: 5aa6f109-d983-4eab-999a-dff3a3203c6b {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:47:02 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Successfully created port: dd6b4eda-d093-4ed5-b230-acca120a8213 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:47:02 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Successfully created port: a8c8c3cf-ad69-4ba6-81cd-aed9289bc816 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:47:02 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Successfully created port: 283e3943-59e6-4eb2-8485-64e0cc08b4ed {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:47:03 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Successfully created port: ed9cab68-946e-4ed5-87d7-4f73c2f82ac2 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:47:03 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Successfully created port: d92f1220-3106-4729-91df-22000fd2a29a {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:47:03 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Successfully created port: 0e0f5cbd-0d8d-40f8-949e-b6ae380534b2 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:47:04 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Successfully created port: c90d0fc0-6432-4f98-8295-af931e20e0b5 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:47:04 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Successfully created port: f4c3696b-581b-4f04-831a-44532362bf1b {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:47:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:04 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Successfully updated port: 91851640-12fe-4910-bc52-dd499dfcb1cf {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:47:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-7bc19d94-28a8-4d55-bbde-f2f536d54916 req-43de2dcc-5de2-462b-9f9d-451de0227202 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-changed-91851640-12fe-4910-bc52-dd499dfcb1cf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-7bc19d94-28a8-4d55-bbde-f2f536d54916 req-43de2dcc-5de2-462b-9f9d-451de0227202 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Refreshing instance network info cache due to event network-changed-91851640-12fe-4910-bc52-dd499dfcb1cf. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:47:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7bc19d94-28a8-4d55-bbde-f2f536d54916 req-43de2dcc-5de2-462b-9f9d-451de0227202 service nova] Acquiring lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:47:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7bc19d94-28a8-4d55-bbde-f2f536d54916 req-43de2dcc-5de2-462b-9f9d-451de0227202 service nova] Acquired lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:47:04 user nova-compute[75083]: DEBUG nova.network.neutron [req-7bc19d94-28a8-4d55-bbde-f2f536d54916 req-43de2dcc-5de2-462b-9f9d-451de0227202 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Refreshing network info cache for port 91851640-12fe-4910-bc52-dd499dfcb1cf {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:47:04 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Successfully updated port: 750d3bad-3dc1-4a84-afd5-39f7d814da39 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:47:05 user nova-compute[75083]: DEBUG nova.compute.manager [req-16f17eb7-9414-4011-8750-44bb1d7c168f req-e891fb70-7460-419d-bb80-adf548f79ff0 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-changed-750d3bad-3dc1-4a84-afd5-39f7d814da39 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:05 user nova-compute[75083]: DEBUG nova.compute.manager [req-16f17eb7-9414-4011-8750-44bb1d7c168f req-e891fb70-7460-419d-bb80-adf548f79ff0 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Refreshing instance network info cache due to event network-changed-750d3bad-3dc1-4a84-afd5-39f7d814da39. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:47:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-16f17eb7-9414-4011-8750-44bb1d7c168f req-e891fb70-7460-419d-bb80-adf548f79ff0 service nova] Acquiring lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:47:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-16f17eb7-9414-4011-8750-44bb1d7c168f req-e891fb70-7460-419d-bb80-adf548f79ff0 service nova] Acquired lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:47:05 user nova-compute[75083]: DEBUG nova.network.neutron [req-16f17eb7-9414-4011-8750-44bb1d7c168f req-e891fb70-7460-419d-bb80-adf548f79ff0 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Refreshing network info cache for port 750d3bad-3dc1-4a84-afd5-39f7d814da39 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:47:05 user nova-compute[75083]: DEBUG nova.network.neutron [req-7bc19d94-28a8-4d55-bbde-f2f536d54916 req-43de2dcc-5de2-462b-9f9d-451de0227202 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:47:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:05 user nova-compute[75083]: DEBUG nova.network.neutron [req-16f17eb7-9414-4011-8750-44bb1d7c168f req-e891fb70-7460-419d-bb80-adf548f79ff0 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:47:05 user nova-compute[75083]: DEBUG nova.network.neutron [req-7bc19d94-28a8-4d55-bbde-f2f536d54916 req-43de2dcc-5de2-462b-9f9d-451de0227202 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:47:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7bc19d94-28a8-4d55-bbde-f2f536d54916 req-43de2dcc-5de2-462b-9f9d-451de0227202 service nova] Releasing lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:47:05 user nova-compute[75083]: DEBUG nova.network.neutron [req-16f17eb7-9414-4011-8750-44bb1d7c168f req-e891fb70-7460-419d-bb80-adf548f79ff0 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:47:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-16f17eb7-9414-4011-8750-44bb1d7c168f req-e891fb70-7460-419d-bb80-adf548f79ff0 service nova] Releasing lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:47:06 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Successfully updated port: b3b24c5a-0012-4caa-ae37-f752635c9190 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:47:06 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Successfully updated port: 1323b7f9-c161-4943-8cf4-123982ca7348 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:47:07 user nova-compute[75083]: DEBUG nova.compute.manager [req-9632f7b6-2a60-4d00-9ab6-cb6529d80dd9 req-cee33803-fe32-428e-a490-bd694ebc2f64 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-changed-b3b24c5a-0012-4caa-ae37-f752635c9190 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:07 user nova-compute[75083]: DEBUG nova.compute.manager [req-9632f7b6-2a60-4d00-9ab6-cb6529d80dd9 req-cee33803-fe32-428e-a490-bd694ebc2f64 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Refreshing instance network info cache due to event network-changed-b3b24c5a-0012-4caa-ae37-f752635c9190. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:47:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9632f7b6-2a60-4d00-9ab6-cb6529d80dd9 req-cee33803-fe32-428e-a490-bd694ebc2f64 service nova] Acquiring lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:47:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9632f7b6-2a60-4d00-9ab6-cb6529d80dd9 req-cee33803-fe32-428e-a490-bd694ebc2f64 service nova] Acquired lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:47:07 user nova-compute[75083]: DEBUG nova.network.neutron [req-9632f7b6-2a60-4d00-9ab6-cb6529d80dd9 req-cee33803-fe32-428e-a490-bd694ebc2f64 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Refreshing network info cache for port b3b24c5a-0012-4caa-ae37-f752635c9190 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:47:07 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Successfully updated port: af0d6e28-f22d-43b7-ba2e-147fcc449a18 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:47:07 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Successfully updated port: 807ff050-85ba-4543-9516-95ffb6235f90 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:47:07 user nova-compute[75083]: DEBUG nova.network.neutron [req-9632f7b6-2a60-4d00-9ab6-cb6529d80dd9 req-cee33803-fe32-428e-a490-bd694ebc2f64 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:47:07 user nova-compute[75083]: DEBUG nova.network.neutron [req-9632f7b6-2a60-4d00-9ab6-cb6529d80dd9 req-cee33803-fe32-428e-a490-bd694ebc2f64 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:47:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9632f7b6-2a60-4d00-9ab6-cb6529d80dd9 req-cee33803-fe32-428e-a490-bd694ebc2f64 service nova] Releasing lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:47:07 user nova-compute[75083]: DEBUG nova.compute.manager [req-9632f7b6-2a60-4d00-9ab6-cb6529d80dd9 req-cee33803-fe32-428e-a490-bd694ebc2f64 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-changed-1323b7f9-c161-4943-8cf4-123982ca7348 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:07 user nova-compute[75083]: DEBUG nova.compute.manager [req-9632f7b6-2a60-4d00-9ab6-cb6529d80dd9 req-cee33803-fe32-428e-a490-bd694ebc2f64 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Refreshing instance network info cache due to event network-changed-1323b7f9-c161-4943-8cf4-123982ca7348. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:47:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9632f7b6-2a60-4d00-9ab6-cb6529d80dd9 req-cee33803-fe32-428e-a490-bd694ebc2f64 service nova] Acquiring lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:47:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9632f7b6-2a60-4d00-9ab6-cb6529d80dd9 req-cee33803-fe32-428e-a490-bd694ebc2f64 service nova] Acquired lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:47:07 user nova-compute[75083]: DEBUG nova.network.neutron [req-9632f7b6-2a60-4d00-9ab6-cb6529d80dd9 req-cee33803-fe32-428e-a490-bd694ebc2f64 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Refreshing network info cache for port 1323b7f9-c161-4943-8cf4-123982ca7348 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:47:07 user nova-compute[75083]: DEBUG nova.network.neutron [req-9632f7b6-2a60-4d00-9ab6-cb6529d80dd9 req-cee33803-fe32-428e-a490-bd694ebc2f64 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:47:07 user nova-compute[75083]: DEBUG nova.network.neutron [req-9632f7b6-2a60-4d00-9ab6-cb6529d80dd9 req-cee33803-fe32-428e-a490-bd694ebc2f64 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:47:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9632f7b6-2a60-4d00-9ab6-cb6529d80dd9 req-cee33803-fe32-428e-a490-bd694ebc2f64 service nova] Releasing lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:47:08 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Successfully updated port: dd6b4eda-d093-4ed5-b230-acca120a8213 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:47:08 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Successfully updated port: a8c8c3cf-ad69-4ba6-81cd-aed9289bc816 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG nova.compute.manager [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-changed-af0d6e28-f22d-43b7-ba2e-147fcc449a18 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG nova.compute.manager [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Refreshing instance network info cache due to event network-changed-af0d6e28-f22d-43b7-ba2e-147fcc449a18. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] Acquiring lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] Acquired lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG nova.network.neutron [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Refreshing network info cache for port af0d6e28-f22d-43b7-ba2e-147fcc449a18 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG nova.network.neutron [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Successfully updated port: ed9cab68-946e-4ed5-87d7-4f73c2f82ac2 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Successfully updated port: 283e3943-59e6-4eb2-8485-64e0cc08b4ed {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG nova.network.neutron [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] Releasing lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG nova.compute.manager [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-changed-807ff050-85ba-4543-9516-95ffb6235f90 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG nova.compute.manager [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Refreshing instance network info cache due to event network-changed-807ff050-85ba-4543-9516-95ffb6235f90. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] Acquiring lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] Acquired lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG nova.network.neutron [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Refreshing network info cache for port 807ff050-85ba-4543-9516-95ffb6235f90 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG nova.network.neutron [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG nova.network.neutron [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] Releasing lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG nova.compute.manager [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-changed-dd6b4eda-d093-4ed5-b230-acca120a8213 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG nova.compute.manager [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Refreshing instance network info cache due to event network-changed-dd6b4eda-d093-4ed5-b230-acca120a8213. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] Acquiring lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] Acquired lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG nova.network.neutron [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Refreshing network info cache for port dd6b4eda-d093-4ed5-b230-acca120a8213 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:47:09 user nova-compute[75083]: INFO nova.virt.block_device [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Booting with volume d3950d96-ff2a-493d-8802-3ad5c9a7fd83 at /dev/vdb
Nov 29 05:47:09 user nova-compute[75083]: DEBUG nova.network.neutron [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:47:09 user nova-compute[75083]: INFO nova.virt.block_device [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Booting with volume cc4de376-09fa-4938-bc93-e1c88d782b6a at /dev/vdb
Nov 29 05:47:09 user nova-compute[75083]: DEBUG os_brick.utils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b807b54f-d3f4-4a4e-9748-18d46bab0ab3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f14dc43-1a13-4c82-9b7f-5227483cdf20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG os_brick.utils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3fc360-471e-469d-9f94-68b314d90552]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a932f012-8045-4882-974b-25374a3f1c2c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[135575f4-a347-4b38-88be-82c54b7ad308]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:47:10 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d8c707-2bd0-4ee6-a91d-36226083a31f]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG os_brick.utils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Updating existing volume attachment record: 99b4225e-7967-4135-9aef-f7c21a603af8 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[466fbabe-2a1a-475d-bb2e-f8997f1e4545]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b235a368-e4f7-4d31-99d7-8adfd50a5c34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e780bc8-6624-478b-aac1-f71c332f3ec6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG nova.network.neutron [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] Releasing lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-changed-a8c8c3cf-ad69-4ba6-81cd-aed9289bc816 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Refreshing instance network info cache due to event network-changed-a8c8c3cf-ad69-4ba6-81cd-aed9289bc816. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] Acquiring lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] Acquired lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG nova.network.neutron [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Refreshing network info cache for port a8c8c3cf-ad69-4ba6-81cd-aed9289bc816 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:47:10 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6104a8-0291-4164-b16f-fab794c779b6]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG os_brick.utils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] <== get_connector_properties: return (214ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Updating existing volume attachment record: c2c624ac-6d67-470f-ab97-3fcd43e6aaa3 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG nova.network.neutron [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Successfully updated port: 0e0f5cbd-0d8d-40f8-949e-b6ae380534b2 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Successfully updated port: d92f1220-3106-4729-91df-22000fd2a29a {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG nova.network.neutron [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-630ecfe6-3ac9-411a-b2e8-77020cdb9076 req-b3f2657f-65df-45fe-ac71-dbfa99ea767f service nova] Releasing lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:47:11 user nova-compute[75083]: DEBUG nova.compute.manager [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-changed-ed9cab68-946e-4ed5-87d7-4f73c2f82ac2 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:11 user nova-compute[75083]: DEBUG nova.compute.manager [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Refreshing instance network info cache due to event network-changed-ed9cab68-946e-4ed5-87d7-4f73c2f82ac2. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:47:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] Acquiring lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:47:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] Acquired lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:47:11 user nova-compute[75083]: DEBUG nova.network.neutron [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Refreshing network info cache for port ed9cab68-946e-4ed5-87d7-4f73c2f82ac2 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:47:11 user nova-compute[75083]: DEBUG nova.network.neutron [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:47:11 user nova-compute[75083]: DEBUG nova.network.neutron [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:47:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] Releasing lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:47:11 user nova-compute[75083]: DEBUG nova.compute.manager [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-changed-283e3943-59e6-4eb2-8485-64e0cc08b4ed {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:11 user nova-compute[75083]: DEBUG nova.compute.manager [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Refreshing instance network info cache due to event network-changed-283e3943-59e6-4eb2-8485-64e0cc08b4ed. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:47:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] Acquiring lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:47:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] Acquired lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:47:11 user nova-compute[75083]: DEBUG nova.network.neutron [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Refreshing network info cache for port 283e3943-59e6-4eb2-8485-64e0cc08b4ed {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:47:11 user nova-compute[75083]: DEBUG nova.network.neutron [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:47:11 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Successfully updated port: c90d0fc0-6432-4f98-8295-af931e20e0b5 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:47:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Acquiring lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:47:11 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Successfully updated port: f4c3696b-581b-4f04-831a-44532362bf1b {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:47:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Acquiring lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:47:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Acquired lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:47:11 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:47:12 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:47:12 user nova-compute[75083]: DEBUG nova.network.neutron [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:47:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] Releasing lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:47:12 user nova-compute[75083]: DEBUG nova.compute.manager [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-changed-0e0f5cbd-0d8d-40f8-949e-b6ae380534b2 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:12 user nova-compute[75083]: DEBUG nova.compute.manager [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Refreshing instance network info cache due to event network-changed-0e0f5cbd-0d8d-40f8-949e-b6ae380534b2. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:47:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] Acquiring lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:47:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Acquired lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:47:12 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:47:12 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:47:13 user nova-compute[75083]: DEBUG nova.compute.manager [req-d9697471-39c5-4619-afa5-af84dab0c60e req-38d895fc-705f-4552-a313-1ef76087148d service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-changed-c90d0fc0-6432-4f98-8295-af931e20e0b5 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:13 user nova-compute[75083]: DEBUG nova.compute.manager [req-d9697471-39c5-4619-afa5-af84dab0c60e req-38d895fc-705f-4552-a313-1ef76087148d service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Refreshing instance network info cache due to event network-changed-c90d0fc0-6432-4f98-8295-af931e20e0b5. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:47:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d9697471-39c5-4619-afa5-af84dab0c60e req-38d895fc-705f-4552-a313-1ef76087148d service nova] Acquiring lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Updating instance_info_cache with network_info: [{"id": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "address": "fa:16:3e:a9:ac:51", "network": {"id": "9c8a8302-51cb-4107-940f-b5f511d6a9d0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908598171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap750d3bad-3d", "ovs_interfaceid": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1323b7f9-c161-4943-8cf4-123982ca7348", "address": "fa:16:3e:cb:bc:b7", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1323b7f9-c1", "ovs_interfaceid": "1323b7f9-c161-4943-8cf4-123982ca7348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "807ff050-85ba-4543-9516-95ffb6235f90", "address": "fa:16:3e:47:bd:de", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807ff050-85", "ovs_interfaceid": "807ff050-85ba-4543-9516-95ffb6235f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd6b4eda-d093-4ed5-b230-acca120a8213", "address": "fa:16:3e:e4:98:4b", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6b4eda-d0", "ovs_interfaceid": "dd6b4eda-d093-4ed5-b230-acca120a8213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "address": "fa:16:3e:8c:e2:17", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283e3943-59", "ovs_interfaceid": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d92f1220-3106-4729-91df-22000fd2a29a", "address": "fa:16:3e:1a:77:de", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92f1220-31", "ovs_interfaceid": "d92f1220-3106-4729-91df-22000fd2a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "address": "fa:16:3e:f8:e7:46", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90d0fc0-64", "ovs_interfaceid": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Updating instance_info_cache with network_info: [{"id": "91851640-12fe-4910-bc52-dd499dfcb1cf", "address": "fa:16:3e:09:eb:19", "network": {"id": "a5217202-1f29-4714-b72b-12e14124535a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2006028268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91851640-12", "ovs_interfaceid": "91851640-12fe-4910-bc52-dd499dfcb1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3b24c5a-0012-4caa-ae37-f752635c9190", "address": "fa:16:3e:33:b9:fa", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b24c5a-00", "ovs_interfaceid": "b3b24c5a-0012-4caa-ae37-f752635c9190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "address": "fa:16:3e:81:a1:d8", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0d6e28-f2", "ovs_interfaceid": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "address": "fa:16:3e:95:7c:7d", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c8c3cf-ad", "ovs_interfaceid": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "address": "fa:16:3e:78:74:b7", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9cab68-94", "ovs_interfaceid": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "address": "fa:16:3e:d9:f8:79", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e0f5cbd-0d", "ovs_interfaceid": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4c3696b-581b-4f04-831a-44532362bf1b", "address": "fa:16:3e:cc:7e:83", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c3696b-58", "ovs_interfaceid": "f4c3696b-581b-4f04-831a-44532362bf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Releasing lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Instance network_info: |[{"id": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "address": "fa:16:3e:a9:ac:51", "network": {"id": "9c8a8302-51cb-4107-940f-b5f511d6a9d0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908598171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap750d3bad-3d", "ovs_interfaceid": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1323b7f9-c161-4943-8cf4-123982ca7348", "address": "fa:16:3e:cb:bc:b7", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1323b7f9-c1", "ovs_interfaceid": "1323b7f9-c161-4943-8cf4-123982ca7348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "807ff050-85ba-4543-9516-95ffb6235f90", "address": "fa:16:3e:47:bd:de", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807ff050-85", "ovs_interfaceid": "807ff050-85ba-4543-9516-95ffb6235f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd6b4eda-d093-4ed5-b230-acca120a8213", "address": "fa:16:3e:e4:98:4b", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6b4eda-d0", "ovs_interfaceid": "dd6b4eda-d093-4ed5-b230-acca120a8213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "address": "fa:16:3e:8c:e2:17", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283e3943-59", "ovs_interfaceid": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d92f1220-3106-4729-91df-22000fd2a29a", "address": "fa:16:3e:1a:77:de", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92f1220-31", "ovs_interfaceid": "d92f1220-3106-4729-91df-22000fd2a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "address": "fa:16:3e:f8:e7:46", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90d0fc0-64", "ovs_interfaceid": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d9697471-39c5-4619-afa5-af84dab0c60e req-38d895fc-705f-4552-a313-1ef76087148d service nova] Acquired lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG nova.network.neutron [req-d9697471-39c5-4619-afa5-af84dab0c60e req-38d895fc-705f-4552-a313-1ef76087148d service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Refreshing network info cache for port c90d0fc0-6432-4f98-8295-af931e20e0b5 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Releasing lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Instance network_info: |[{"id": "91851640-12fe-4910-bc52-dd499dfcb1cf", "address": "fa:16:3e:09:eb:19", "network": {"id": "a5217202-1f29-4714-b72b-12e14124535a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2006028268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91851640-12", "ovs_interfaceid": "91851640-12fe-4910-bc52-dd499dfcb1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3b24c5a-0012-4caa-ae37-f752635c9190", "address": "fa:16:3e:33:b9:fa", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b24c5a-00", "ovs_interfaceid": "b3b24c5a-0012-4caa-ae37-f752635c9190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "address": "fa:16:3e:81:a1:d8", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0d6e28-f2", "ovs_interfaceid": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "address": "fa:16:3e:95:7c:7d", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c8c3cf-ad", "ovs_interfaceid": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "address": "fa:16:3e:78:74:b7", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9cab68-94", "ovs_interfaceid": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "address": "fa:16:3e:d9:f8:79", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e0f5cbd-0d", "ovs_interfaceid": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4c3696b-581b-4f04-831a-44532362bf1b", "address": "fa:16:3e:cc:7e:83", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c3696b-58", "ovs_interfaceid": "f4c3696b-581b-4f04-831a-44532362bf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] Acquired lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG nova.network.neutron [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Refreshing network info cache for port 0e0f5cbd-0d8d-40f8-949e-b6ae380534b2 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG nova.network.neutron [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Updated VIF entry in instance network info cache for port 0e0f5cbd-0d8d-40f8-949e-b6ae380534b2. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG nova.network.neutron [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Updating instance_info_cache with network_info: [{"id": "91851640-12fe-4910-bc52-dd499dfcb1cf", "address": "fa:16:3e:09:eb:19", "network": {"id": "a5217202-1f29-4714-b72b-12e14124535a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2006028268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91851640-12", "ovs_interfaceid": "91851640-12fe-4910-bc52-dd499dfcb1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3b24c5a-0012-4caa-ae37-f752635c9190", "address": "fa:16:3e:33:b9:fa", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b24c5a-00", "ovs_interfaceid": "b3b24c5a-0012-4caa-ae37-f752635c9190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "address": "fa:16:3e:81:a1:d8", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0d6e28-f2", "ovs_interfaceid": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "address": "fa:16:3e:95:7c:7d", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c8c3cf-ad", "ovs_interfaceid": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "address": "fa:16:3e:78:74:b7", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9cab68-94", "ovs_interfaceid": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "address": "fa:16:3e:d9:f8:79", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e0f5cbd-0d", "ovs_interfaceid": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4c3696b-581b-4f04-831a-44532362bf1b", "address": "fa:16:3e:cc:7e:83", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c3696b-58", "ovs_interfaceid": "f4c3696b-581b-4f04-831a-44532362bf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG nova.network.neutron [req-d9697471-39c5-4619-afa5-af84dab0c60e req-38d895fc-705f-4552-a313-1ef76087148d service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Updated VIF entry in instance network info cache for port c90d0fc0-6432-4f98-8295-af931e20e0b5. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG nova.network.neutron [req-d9697471-39c5-4619-afa5-af84dab0c60e req-38d895fc-705f-4552-a313-1ef76087148d service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Updating instance_info_cache with network_info: [{"id": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "address": "fa:16:3e:a9:ac:51", "network": {"id": "9c8a8302-51cb-4107-940f-b5f511d6a9d0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908598171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap750d3bad-3d", "ovs_interfaceid": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1323b7f9-c161-4943-8cf4-123982ca7348", "address": "fa:16:3e:cb:bc:b7", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1323b7f9-c1", "ovs_interfaceid": "1323b7f9-c161-4943-8cf4-123982ca7348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "807ff050-85ba-4543-9516-95ffb6235f90", "address": "fa:16:3e:47:bd:de", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807ff050-85", "ovs_interfaceid": "807ff050-85ba-4543-9516-95ffb6235f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd6b4eda-d093-4ed5-b230-acca120a8213", "address": "fa:16:3e:e4:98:4b", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6b4eda-d0", "ovs_interfaceid": "dd6b4eda-d093-4ed5-b230-acca120a8213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "address": "fa:16:3e:8c:e2:17", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283e3943-59", "ovs_interfaceid": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d92f1220-3106-4729-91df-22000fd2a29a", "address": "fa:16:3e:1a:77:de", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92f1220-31", "ovs_interfaceid": "d92f1220-3106-4729-91df-22000fd2a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "address": "fa:16:3e:f8:e7:46", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90d0fc0-64", "ovs_interfaceid": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] Releasing lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG nova.compute.manager [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-changed-d92f1220-3106-4729-91df-22000fd2a29a {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG nova.compute.manager [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Refreshing instance network info cache due to event network-changed-d92f1220-3106-4729-91df-22000fd2a29a. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] Acquiring lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d9697471-39c5-4619-afa5-af84dab0c60e req-38d895fc-705f-4552-a313-1ef76087148d service nova] Releasing lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG nova.compute.manager [req-d9697471-39c5-4619-afa5-af84dab0c60e req-38d895fc-705f-4552-a313-1ef76087148d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-changed-f4c3696b-581b-4f04-831a-44532362bf1b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG nova.compute.manager [req-d9697471-39c5-4619-afa5-af84dab0c60e req-38d895fc-705f-4552-a313-1ef76087148d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Refreshing instance network info cache due to event network-changed-f4c3696b-581b-4f04-831a-44532362bf1b. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d9697471-39c5-4619-afa5-af84dab0c60e req-38d895fc-705f-4552-a313-1ef76087148d service nova] Acquiring lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d9697471-39c5-4619-afa5-af84dab0c60e req-38d895fc-705f-4552-a313-1ef76087148d service nova] Acquired lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG nova.network.neutron [req-d9697471-39c5-4619-afa5-af84dab0c60e req-38d895fc-705f-4552-a313-1ef76087148d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Refreshing network info cache for port f4c3696b-581b-4f04-831a-44532362bf1b {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] Acquired lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG nova.network.neutron [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Refreshing network info cache for port d92f1220-3106-4729-91df-22000fd2a29a {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:47:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:15 user nova-compute[75083]: DEBUG nova.network.neutron [req-d9697471-39c5-4619-afa5-af84dab0c60e req-38d895fc-705f-4552-a313-1ef76087148d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Updated VIF entry in instance network info cache for port f4c3696b-581b-4f04-831a-44532362bf1b. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:47:15 user nova-compute[75083]: DEBUG nova.network.neutron [req-d9697471-39c5-4619-afa5-af84dab0c60e req-38d895fc-705f-4552-a313-1ef76087148d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Updating instance_info_cache with network_info: [{"id": "91851640-12fe-4910-bc52-dd499dfcb1cf", "address": "fa:16:3e:09:eb:19", "network": {"id": "a5217202-1f29-4714-b72b-12e14124535a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2006028268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91851640-12", "ovs_interfaceid": "91851640-12fe-4910-bc52-dd499dfcb1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3b24c5a-0012-4caa-ae37-f752635c9190", "address": "fa:16:3e:33:b9:fa", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b24c5a-00", "ovs_interfaceid": "b3b24c5a-0012-4caa-ae37-f752635c9190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "address": "fa:16:3e:81:a1:d8", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0d6e28-f2", "ovs_interfaceid": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "address": "fa:16:3e:95:7c:7d", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c8c3cf-ad", "ovs_interfaceid": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "address": "fa:16:3e:78:74:b7", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9cab68-94", "ovs_interfaceid": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "address": "fa:16:3e:d9:f8:79", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e0f5cbd-0d", "ovs_interfaceid": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4c3696b-581b-4f04-831a-44532362bf1b", "address": "fa:16:3e:cc:7e:83", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c3696b-58", "ovs_interfaceid": "f4c3696b-581b-4f04-831a-44532362bf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:47:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d9697471-39c5-4619-afa5-af84dab0c60e req-38d895fc-705f-4552-a313-1ef76087148d service nova] Releasing lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:47:15 user nova-compute[75083]: DEBUG nova.network.neutron [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Updated VIF entry in instance network info cache for port d92f1220-3106-4729-91df-22000fd2a29a. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:47:15 user nova-compute[75083]: DEBUG nova.network.neutron [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Updating instance_info_cache with network_info: [{"id": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "address": "fa:16:3e:a9:ac:51", "network": {"id": "9c8a8302-51cb-4107-940f-b5f511d6a9d0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908598171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap750d3bad-3d", "ovs_interfaceid": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1323b7f9-c161-4943-8cf4-123982ca7348", "address": "fa:16:3e:cb:bc:b7", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1323b7f9-c1", "ovs_interfaceid": "1323b7f9-c161-4943-8cf4-123982ca7348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "807ff050-85ba-4543-9516-95ffb6235f90", "address": "fa:16:3e:47:bd:de", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807ff050-85", "ovs_interfaceid": "807ff050-85ba-4543-9516-95ffb6235f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd6b4eda-d093-4ed5-b230-acca120a8213", "address": "fa:16:3e:e4:98:4b", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6b4eda-d0", "ovs_interfaceid": "dd6b4eda-d093-4ed5-b230-acca120a8213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "address": "fa:16:3e:8c:e2:17", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283e3943-59", "ovs_interfaceid": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d92f1220-3106-4729-91df-22000fd2a29a", "address": "fa:16:3e:1a:77:de", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92f1220-31", "ovs_interfaceid": "d92f1220-3106-4729-91df-22000fd2a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "address": "fa:16:3e:f8:e7:46", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90d0fc0-64", "ovs_interfaceid": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:47:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c81f3744-05ff-4df7-a32b-297a141ce873 req-45bd313e-c6dd-4a88-9855-53be71179ebb service nova] Releasing lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:47:18 user nova-compute[75083]: INFO nova.virt.block_device [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Booting with volume 10d34edb-4d46-4cf7-8363-e5c6e623d726 at /dev/vdc
Nov 29 05:47:18 user nova-compute[75083]: INFO nova.virt.block_device [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Booting with volume 3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 at /dev/vdc
Nov 29 05:47:18 user nova-compute[75083]: DEBUG os_brick.utils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6654601-2a8f-424d-b07a-e4ebebfedcdc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG os_brick.utils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1cd18b-3bbe-4d9c-a7ef-815d9d781f84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1aee15-f190-4f1c-bffd-1f97e8a28205]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2a704a-3ac1-4fb7-a851-2e7f335f1f8f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8324566-a7ee-4852-8698-a5c1ac576c9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcf0208-a028-45af-a245-4db4884d839e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:47:18 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1e8fce-7d20-4b08-955f-9b12582486e1]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebff76a-0b89-4131-a5b2-791d8f902f5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG os_brick.utils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Updating existing volume attachment record: f3407acf-e995-4249-a9c5-d9d9421689d0 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[263908da-99dc-47c9-a53e-7bf8502704ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:47:18 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:47:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[961237f3-e458-4ab4-8017-c7b1392d92d7]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG os_brick.utils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:47:18 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Updating existing volume attachment record: c5f063a5-d12f-4ab8-8917-41bb0cdb8368 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:47:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:47:26 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Creating image(s)
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Did not create local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Ensure instance console log exists: /opt/stack/data/nova/instances/0f45ac21-017c-4247-b2ae-756ae1c12911/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Start _get_guest_xml network_info=[{"id": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "address": "fa:16:3e:a9:ac:51", "network": {"id": "9c8a8302-51cb-4107-940f-b5f511d6a9d0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908598171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap750d3bad-3d", "ovs_interfaceid": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1323b7f9-c161-4943-8cf4-123982ca7348", "address": "fa:16:3e:cb:bc:b7", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1323b7f9-c1", "ovs_interfaceid": "1323b7f9-c161-4943-8cf4-123982ca7348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "807ff050-85ba-4543-9516-95ffb6235f90", "address": "fa:16:3e:47:bd:de", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807ff050-85", "ovs_interfaceid": "807ff050-85ba-4543-9516-95ffb6235f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd6b4eda-d093-4ed5-b230-acca120a8213", "address": "fa:16:3e:e4:98:4b", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6b4eda-d0", "ovs_interfaceid": "dd6b4eda-d093-4ed5-b230-acca120a8213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "address": "fa:16:3e:8c:e2:17", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283e3943-59", "ovs_interfaceid": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d92f1220-3106-4729-91df-22000fd2a29a", "address": "fa:16:3e:1a:77:de", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92f1220-31", "ovs_interfaceid": "d92f1220-3106-4729-91df-22000fd2a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "address": "fa:16:3e:f8:e7:46", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90d0fc0-64", "ovs_interfaceid": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '5aa6f109-d983-4eab-999a-dff3a3203c6b', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lRBUOeED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0f45ac21-017c-4247-b2ae-756ae1c12911', 'attached_at': '', 'detached_at': '', 'volume_id': '2aa95ada-7a3b-46fd-9ca0-b74053557a0c', 'serial': '2aa95ada-7a3b-46fd-9ca0-b74053557a0c'}, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'c2c624ac-6d67-470f-ab97-3fcd43e6aaa3', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rOPflVUZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0f45ac21-017c-4247-b2ae-756ae1c12911', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc4de376-09fa-4938-bc93-e1c88d782b6a', 'serial': 'cc4de376-09fa-4938-bc93-e1c88d782b6a'}, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'f3407acf-e995-4249-a9c5-d9d9421689d0', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISClvnpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0f45ac21-017c-4247-b2ae-756ae1c12911', 'attached_at': '', 'detached_at': '', 'volume_id': '10d34edb-4d46-4cf7-8363-e5c6e623d726', 'serial': '10d34edb-4d46-4cf7-8363-e5c6e623d726'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:47:26 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Creating image(s)
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Did not create local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Ensure instance console log exists: /opt/stack/data/nova/instances/e8fe9965-822d-4058-a031-e71b5fb03db4/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Start _get_guest_xml network_info=[{"id": "91851640-12fe-4910-bc52-dd499dfcb1cf", "address": "fa:16:3e:09:eb:19", "network": {"id": "a5217202-1f29-4714-b72b-12e14124535a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2006028268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91851640-12", "ovs_interfaceid": "91851640-12fe-4910-bc52-dd499dfcb1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3b24c5a-0012-4caa-ae37-f752635c9190", "address": "fa:16:3e:33:b9:fa", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b24c5a-00", "ovs_interfaceid": "b3b24c5a-0012-4caa-ae37-f752635c9190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "address": "fa:16:3e:81:a1:d8", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0d6e28-f2", "ovs_interfaceid": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "address": "fa:16:3e:95:7c:7d", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c8c3cf-ad", "ovs_interfaceid": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "address": "fa:16:3e:78:74:b7", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9cab68-94", "ovs_interfaceid": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "address": "fa:16:3e:d9:f8:79", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e0f5cbd-0d", "ovs_interfaceid": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4c3696b-581b-4f04-831a-44532362bf1b", "address": "fa:16:3e:cc:7e:83", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c3696b-58", "ovs_interfaceid": "f4c3696b-581b-4f04-831a-44532362bf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '0d817260-afcc-46b0-8c2d-aad7a069d0a9', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBNWepYo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8fe9965-822d-4058-a031-e71b5fb03db4', 'attached_at': '', 'detached_at': '', 'volume_id': 'e1bd378b-277c-40a6-9292-e87b013b8ba0', 'serial': 'e1bd378b-277c-40a6-9292-e87b013b8ba0'}, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '99b4225e-7967-4135-9aef-f7c21a603af8', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyfRpkZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8fe9965-822d-4058-a031-e71b5fb03db4', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3950d96-ff2a-493d-8802-3ad5c9a7fd83', 'serial': 'd3950d96-ff2a-493d-8802-3ad5c9a7fd83'}, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'c5f063a5-d12f-4ab8-8917-41bb0cdb8368', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmrQSZjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8fe9965-822d-4058-a031-e71b5fb03db4', 'attached_at': '', 'detached_at': '', 'volume_id': '3114b1ca-f90b-44fa-9c49-fd3c8b7852a3', 'serial': '3114b1ca-f90b-44fa-9c49-fd3c8b7852a3'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:47:26 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:47:26 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:47:26 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:47:26 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connector [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Factory for ISCSI on None {{(pid=75083) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lRBUOeED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:47:26 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:47:26 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:47:26 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBNWepYo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:47:26 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb24150-4d38-4f71-adf7-92bf8337d804]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:47:26 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[edba45aa-50f6-41cd-8674-749c0e9249d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c] added
Nov 29 05:47:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b424cd38-d682-4024-b308-092c7ec49ccd]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[781eca3b-7c95-42ae-8d81-cbb90da5c468]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lRBUOeED {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lRBUOeED" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf7344f-fedf-47e3-a051-7fc62555aa08]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lRBUOeED'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[466a79ad-f700-4ef7-90b1-4f3e16480d49]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[60202217-b38b-4284-bc38-821a12d8a89a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 05:47:26 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 05:47:26 user nova-compute[75083]:  {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:47:26 user nova-compute[75083]: WARNING os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 05:47:26 user nova-compute[75083]: 
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec47325a-e8e3-4ecb-92b8-2229af32f828]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c, portal: 172.16.0.220,3260]
Nov 29 05:47:26 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c, portal: 172.16.0.220,3260] successful.
Nov 29 05:47:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9e06b7-dde4-4d42-bd9b-c01c8fc0eb41]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee20886d-cd1f-421f-b2d7-5aa809f911ad]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e846ec-f8b3-4a9c-ac49-e774a793800e]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:47:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lRBUOeED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23365643862366664', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365643862366664', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.266s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:47:27 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:47:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:47:27 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:47:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e00e387-db62-416c-a212-86e4da2c82f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:47:27 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rOPflVUZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:47:27 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:47:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb00dd5-6f90-4b0e-bef1-81439d4db3ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0] added
Nov 29 05:47:27 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75170d3-241c-4274-bd90-670c4785af56]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[71962bc7-9aea-4136-98ff-5c1e2f3ce037]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IBNWepYo {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IBNWepYo" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5f6766-ae68-49f8-bf1d-c05f466134cf]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IBNWepYo'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7838ec-406f-4a4d-9dc9-266ddbb49848]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd1f32f-e219-4752-91ce-b1fcd5fa2801]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:28 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:28 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cff181a-e277-4e58-b523-d21e4758bd8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0, portal: 172.16.0.220,3260]
Nov 29 05:47:28 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0, portal: 172.16.0.220,3260] successful.
Nov 29 05:47:28 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb865657-a4bc-4fba-b199-2dc0d88b742f]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a07811-9b5a-478f-ba25-a8f4578b2da0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:28 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:47:28 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:28 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:47:28 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af65be4-94c9-4a25-a3d0-b177121ce398]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:47:28 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBNWepYo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] <== connect_volume: return (2568ms) {'type': 'block', 'scsi_wwn': '26162393661303035', 'path': '/dev/sdc'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162393661303035', 'path': '/dev/sdc'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.274s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:47:29 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:47:29 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff57f9a8-07a5-4dad-8088-a8eac3174ca2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:47:29 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyfRpkZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:47:29 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a6141c-d63c-4846-98b7-3c760679fb07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a] added
Nov 29 05:47:29 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2444b6d-8bcd-4031-b41e-9e4e084e6995]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[059818c0-f00f-49b6-aba6-0623e9d54906]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rOPflVUZ {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rOPflVUZ" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b48bb1b-f733-46df-9256-4bb6ccc0f979]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rOPflVUZ'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ac4cbc-68a4-4088-b5dc-bd4cbf882e69]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad1baa4-abfd-493c-9fbb-ae161f10c978]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:29 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:47:29 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:29 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:47:29 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb212130-b1f5-4936-b1f6-1ded1f8d2d69]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a, portal: 172.16.0.220,3260]
Nov 29 05:47:29 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a, portal: 172.16.0.220,3260] successful.
Nov 29 05:47:29 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be61d1e-064a-4026-9958-ad9e7e42397c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e34a80-c707-4411-8403-80f574e33bea]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:29 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:47:29 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:47:29 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:29 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:47:29 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:47:29 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b8b28a-adaa-4acf-9880-fa5fb876b15c]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rOPflVUZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:47:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] <== connect_volume: return (2587ms) {'type': 'block', 'scsi_wwn': '23461323264346330', 'path': '/dev/sdd'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461323264346330', 'path': '/dev/sdd'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.287s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:47:30 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:47:30 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef303fe5-dfb9-44ca-9161-a22a34c2ae12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:47:30 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISClvnpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:47:30 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b332b99-7de7-45f7-9325-07122a605144]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83] added
Nov 29 05:47:30 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba60b420-36a6-4e18-a8c7-6d653d236f9a]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ba1282-a0b2-4fe1-a4ae-1e10d0c9cf1b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YyfRpkZW {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YyfRpkZW" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4968dd6b-c4dd-4238-85c4-d5f46d31fd1e]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YyfRpkZW'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[89426a60-791b-4133-859b-22a3544d34b6]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[385d5002-e6e4-483e-8be8-1e632599b131]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:30 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:47:30 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:47:30 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:30 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:47:30 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:47:30 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2b68f7-5c71-4b14-8a28-b789825c74ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83, portal: 172.16.0.220,3260]
Nov 29 05:47:30 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83, portal: 172.16.0.220,3260] successful.
Nov 29 05:47:30 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e208da5-e532-49b8-abdc-67ed766c1b45]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8e8a0c-c793-4611-bdbc-159c047b68d3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:30 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:47:30 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:47:30 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:47:30 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:30 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:47:30 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:47:30 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:47:30 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae14b601-c029-4c1b-87ed-14fdb84e6187]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:30 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyfRpkZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] <== connect_volume: return (2585ms) {'type': 'block', 'scsi_wwn': '26538353735653036', 'path': '/dev/sde'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538353735653036', 'path': '/dev/sde'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.269s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:47:31 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:47:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:47:31 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05cdbf0-0b0d-4f2f-a439-80b99ccbc5d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:47:31 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmrQSZjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:47:31 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:47:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[751a3240-fba6-459d-b589-388972ccbd40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726] added
Nov 29 05:47:31 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccb0a90-7077-4afe-b305-8fab94c4b626]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[74386842-73f7-4014-88cd-227fd6f096e8]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ISClvnpd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ISClvnpd" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e1010b-0313-4c86-a3e4-0a652483cc63]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ISClvnpd'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1ac645-20e5-4ef5-8328-0304308e3023]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d26291-5987-4d6d-8ace-94ca44c2594f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:31 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:47:31 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:47:31 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:47:31 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:31 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:47:31 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:47:31 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:47:31 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:47:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d894406-9e02-4f4b-868d-f999fc08cbfa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726, portal: 172.16.0.220,3260]
Nov 29 05:47:32 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726, portal: 172.16.0.220,3260] successful.
Nov 29 05:47:32 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[698355d1-3530-4b54-b17c-58d6fe952652]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7082ac0c-8973-4760-9d98-5b69484fd671]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:32 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:47:32 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:47:32 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:47:32 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:47:32 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:32 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:47:32 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:47:32 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:47:32 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:47:32 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[95545a94-71fd-4eab-b7eb-c569ead4d48f]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:47:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISClvnpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] <== connect_volume: return (2610ms) {'type': 'block', 'scsi_wwn': '26638633138393632', 'path': '/dev/sdf'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638633138393632', 'path': '/dev/sdf'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.304s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:47:33 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:47:33 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "address": "fa:16:3e:a9:ac:51", "network": {"id": "9c8a8302-51cb-4107-940f-b5f511d6a9d0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908598171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap750d3bad-3d", "ovs_interfaceid": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "address": "fa:16:3e:a9:ac:51", "network": {"id": "9c8a8302-51cb-4107-940f-b5f511d6a9d0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908598171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap750d3bad-3d", "ovs_interfaceid": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ac:51,bridge_name='br-int',has_traffic_filtering=True,id=750d3bad-3dc1-4a84-afd5-39f7d814da39,network=Network(9c8a8302-51cb-4107-940f-b5f511d6a9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap750d3bad-3d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1323b7f9-c161-4943-8cf4-123982ca7348", "address": "fa:16:3e:cb:bc:b7", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1323b7f9-c1", "ovs_interfaceid": "1323b7f9-c161-4943-8cf4-123982ca7348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "1323b7f9-c161-4943-8cf4-123982ca7348", "address": "fa:16:3e:cb:bc:b7", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1323b7f9-c1", "ovs_interfaceid": "1323b7f9-c161-4943-8cf4-123982ca7348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:bc:b7,bridge_name='br-int',has_traffic_filtering=True,id=1323b7f9-c161-4943-8cf4-123982ca7348,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1323b7f9-c1') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "807ff050-85ba-4543-9516-95ffb6235f90", "address": "fa:16:3e:47:bd:de", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807ff050-85", "ovs_interfaceid": "807ff050-85ba-4543-9516-95ffb6235f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "807ff050-85ba-4543-9516-95ffb6235f90", "address": "fa:16:3e:47:bd:de", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807ff050-85", "ovs_interfaceid": "807ff050-85ba-4543-9516-95ffb6235f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=807ff050-85ba-4543-9516-95ffb6235f90,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap807ff050-85') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd6b4eda-d093-4ed5-b230-acca120a8213", "address": "fa:16:3e:e4:98:4b", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6b4eda-d0", "ovs_interfaceid": "dd6b4eda-d093-4ed5-b230-acca120a8213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "dd6b4eda-d093-4ed5-b230-acca120a8213", "address": "fa:16:3e:e4:98:4b", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6b4eda-d0", "ovs_interfaceid": "dd6b4eda-d093-4ed5-b230-acca120a8213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:98:4b,bridge_name='br-int',has_traffic_filtering=True,id=dd6b4eda-d093-4ed5-b230-acca120a8213,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6b4eda-d0') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "address": "fa:16:3e:8c:e2:17", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283e3943-59", "ovs_interfaceid": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "address": "fa:16:3e:8c:e2:17", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283e3943-59", "ovs_interfaceid": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e2:17,bridge_name='br-int',has_traffic_filtering=True,id=283e3943-59e6-4eb2-8485-64e0cc08b4ed,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283e3943-59') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d92f1220-3106-4729-91df-22000fd2a29a", "address": "fa:16:3e:1a:77:de", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92f1220-31", "ovs_interfaceid": "d92f1220-3106-4729-91df-22000fd2a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "d92f1220-3106-4729-91df-22000fd2a29a", "address": "fa:16:3e:1a:77:de", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92f1220-31", "ovs_interfaceid": "d92f1220-3106-4729-91df-22000fd2a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:77:de,bridge_name='br-int',has_traffic_filtering=True,id=d92f1220-3106-4729-91df-22000fd2a29a,network=Network(979d0619-d0b6-485f-b7ea-251b510e7647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92f1220-31') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "address": "fa:16:3e:f8:e7:46", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90d0fc0-64", "ovs_interfaceid": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "address": "fa:16:3e:f8:e7:46", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90d0fc0-64", "ovs_interfaceid": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e7:46,bridge_name='br-int',has_traffic_filtering=True,id=c90d0fc0-6432-4f98-8295-af931e20e0b5,network=Network(979d0619-d0b6-485f-b7ea-251b510e7647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc90d0fc0-64') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.objects.instance [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f45ac21-017c-4247-b2ae-756ae1c12911 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f502000-496a-4ce1-8ebe-64324353d3d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:47:33 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:47:33 user nova-compute[75083]:   <uuid>0f45ac21-017c-4247-b2ae-756ae1c12911</uuid>
Nov 29 05:47:33 user nova-compute[75083]:   <name>instance-0000000a</name>
Nov 29 05:47:33 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:47:33 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:47:33 user nova-compute[75083]:   <metadata>
Nov 29 05:47:33 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:47:33 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:47:33 user nova-compute[75083]:       <nova:name>tempest-device-tagging-server-161073125</nova:name>
Nov 29 05:47:33 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:47:26</nova:creationTime>
Nov 29 05:47:33 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:47:33 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:47:33 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:47:33 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:47:33 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:47:33 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:47:33 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:47:33 user nova-compute[75083]:       <nova:owner>
Nov 29 05:47:33 user nova-compute[75083]:         <nova:user uuid="8ac161fa6da3443a9d8201e0714b4fab">tempest-TaggedBootDevicesTest-1645506517-project-member</nova:user>
Nov 29 05:47:33 user nova-compute[75083]:         <nova:project uuid="b24f07ef08334fea827629fdf234ee0d">tempest-TaggedBootDevicesTest-1645506517</nova:project>
Nov 29 05:47:33 user nova-compute[75083]:       </nova:owner>
Nov 29 05:47:33 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:47:33 user nova-compute[75083]:       <nova:ports>
Nov 29 05:47:33 user nova-compute[75083]:         <nova:port uuid="750d3bad-3dc1-4a84-afd5-39f7d814da39">
Nov 29 05:47:33 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 05:47:33 user nova-compute[75083]:         </nova:port>
Nov 29 05:47:33 user nova-compute[75083]:         <nova:port uuid="1323b7f9-c161-4943-8cf4-123982ca7348">
Nov 29 05:47:33 user nova-compute[75083]:           <nova:ip type="fixed" address="10.1.1.47" ipVersion="4"/>
Nov 29 05:47:33 user nova-compute[75083]:         </nova:port>
Nov 29 05:47:33 user nova-compute[75083]:         <nova:port uuid="807ff050-85ba-4543-9516-95ffb6235f90">
Nov 29 05:47:33 user nova-compute[75083]:           <nova:ip type="fixed" address="10.1.1.5" ipVersion="4"/>
Nov 29 05:47:33 user nova-compute[75083]:         </nova:port>
Nov 29 05:47:33 user nova-compute[75083]:         <nova:port uuid="dd6b4eda-d093-4ed5-b230-acca120a8213">
Nov 29 05:47:33 user nova-compute[75083]:           <nova:ip type="fixed" address="10.1.1.126" ipVersion="4"/>
Nov 29 05:47:33 user nova-compute[75083]:         </nova:port>
Nov 29 05:47:33 user nova-compute[75083]:         <nova:port uuid="283e3943-59e6-4eb2-8485-64e0cc08b4ed">
Nov 29 05:47:33 user nova-compute[75083]:           <nova:ip type="fixed" address="10.1.1.37" ipVersion="4"/>
Nov 29 05:47:33 user nova-compute[75083]:         </nova:port>
Nov 29 05:47:33 user nova-compute[75083]:         <nova:port uuid="d92f1220-3106-4729-91df-22000fd2a29a">
Nov 29 05:47:33 user nova-compute[75083]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 05:47:33 user nova-compute[75083]:         </nova:port>
Nov 29 05:47:33 user nova-compute[75083]:         <nova:port uuid="c90d0fc0-6432-4f98-8295-af931e20e0b5">
Nov 29 05:47:33 user nova-compute[75083]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 05:47:33 user nova-compute[75083]:         </nova:port>
Nov 29 05:47:33 user nova-compute[75083]:       </nova:ports>
Nov 29 05:47:33 user nova-compute[75083]:     </nova:instance>
Nov 29 05:47:33 user nova-compute[75083]:   </metadata>
Nov 29 05:47:33 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:47:33 user nova-compute[75083]:     <system>
Nov 29 05:47:33 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:47:33 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:47:33 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:47:33 user nova-compute[75083]:       <entry name="serial">0f45ac21-017c-4247-b2ae-756ae1c12911</entry>
Nov 29 05:47:33 user nova-compute[75083]:       <entry name="uuid">0f45ac21-017c-4247-b2ae-756ae1c12911</entry>
Nov 29 05:47:33 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:47:33 user nova-compute[75083]:     </system>
Nov 29 05:47:33 user nova-compute[75083]:   </sysinfo>
Nov 29 05:47:33 user nova-compute[75083]:   <os>
Nov 29 05:47:33 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:47:33 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:47:33 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:47:33 user nova-compute[75083]:   </os>
Nov 29 05:47:33 user nova-compute[75083]:   <features>
Nov 29 05:47:33 user nova-compute[75083]:     <acpi/>
Nov 29 05:47:33 user nova-compute[75083]:     <apic/>
Nov 29 05:47:33 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:47:33 user nova-compute[75083]:   </features>
Nov 29 05:47:33 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:47:33 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:47:33 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:47:33 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:47:33 user nova-compute[75083]:   </clock>
Nov 29 05:47:33 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:47:33 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:47:33 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:47:33 user nova-compute[75083]:   </cpu>
Nov 29 05:47:33 user nova-compute[75083]:   <devices>
Nov 29 05:47:33 user nova-compute[75083]:     <disk type="file" device="cdrom">
Nov 29 05:47:33 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 05:47:33 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/0f45ac21-017c-4247-b2ae-756ae1c12911/disk.config"/>
Nov 29 05:47:33 user nova-compute[75083]:       <target dev="hda" bus="ide"/>
Nov 29 05:47:33 user nova-compute[75083]:     </disk>
Nov 29 05:47:33 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 05:47:33 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:47:33 user nova-compute[75083]:       <source dev="/dev/sdb"/>
Nov 29 05:47:33 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:47:33 user nova-compute[75083]:       <serial>2aa95ada-7a3b-46fd-9ca0-b74053557a0c</serial>
Nov 29 05:47:33 user nova-compute[75083]:     </disk>
Nov 29 05:47:33 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 05:47:33 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:47:33 user nova-compute[75083]:       <source dev="/dev/sdd"/>
Nov 29 05:47:33 user nova-compute[75083]:       <target dev="vdb" bus="virtio"/>
Nov 29 05:47:33 user nova-compute[75083]:       <serial>cc4de376-09fa-4938-bc93-e1c88d782b6a</serial>
Nov 29 05:47:33 user nova-compute[75083]:     </disk>
Nov 29 05:47:33 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 05:47:33 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:47:33 user nova-compute[75083]:       <source dev="/dev/sdf"/>
Nov 29 05:47:33 user nova-compute[75083]:       <target dev="vdc" bus="virtio"/>
Nov 29 05:47:33 user nova-compute[75083]:       <serial>10d34edb-4d46-4cf7-8363-e5c6e623d726</serial>
Nov 29 05:47:33 user nova-compute[75083]:     </disk>
Nov 29 05:47:33 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:47:33 user nova-compute[75083]:       <mac address="fa:16:3e:a9:ac:51"/>
Nov 29 05:47:33 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:47:33 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:47:33 user nova-compute[75083]:       <target dev="tap750d3bad-3d"/>
Nov 29 05:47:33 user nova-compute[75083]:     </interface>
Nov 29 05:47:33 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:47:33 user nova-compute[75083]:       <mac address="fa:16:3e:cb:bc:b7"/>
Nov 29 05:47:33 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:47:33 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:47:33 user nova-compute[75083]:       <target dev="tap1323b7f9-c1"/>
Nov 29 05:47:33 user nova-compute[75083]:     </interface>
Nov 29 05:47:33 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:47:33 user nova-compute[75083]:       <mac address="fa:16:3e:47:bd:de"/>
Nov 29 05:47:33 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:47:33 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:47:33 user nova-compute[75083]:       <target dev="tap807ff050-85"/>
Nov 29 05:47:33 user nova-compute[75083]:     </interface>
Nov 29 05:47:33 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:47:33 user nova-compute[75083]:       <mac address="fa:16:3e:e4:98:4b"/>
Nov 29 05:47:33 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:47:33 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:47:33 user nova-compute[75083]:       <target dev="tapdd6b4eda-d0"/>
Nov 29 05:47:33 user nova-compute[75083]:     </interface>
Nov 29 05:47:33 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:47:33 user nova-compute[75083]:       <mac address="fa:16:3e:8c:e2:17"/>
Nov 29 05:47:33 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:47:33 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:47:33 user nova-compute[75083]:       <target dev="tap283e3943-59"/>
Nov 29 05:47:33 user nova-compute[75083]:     </interface>
Nov 29 05:47:33 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:47:33 user nova-compute[75083]:       <mac address="fa:16:3e:1a:77:de"/>
Nov 29 05:47:33 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:47:33 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:47:33 user nova-compute[75083]:       <target dev="tapd92f1220-31"/>
Nov 29 05:47:33 user nova-compute[75083]:     </interface>
Nov 29 05:47:33 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:47:33 user nova-compute[75083]:       <mac address="fa:16:3e:f8:e7:46"/>
Nov 29 05:47:33 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:47:33 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:47:33 user nova-compute[75083]:       <target dev="tapc90d0fc0-64"/>
Nov 29 05:47:33 user nova-compute[75083]:     </interface>
Nov 29 05:47:33 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:47:33 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/0f45ac21-017c-4247-b2ae-756ae1c12911/console.log" append="off"/>
Nov 29 05:47:33 user nova-compute[75083]:     </serial>
Nov 29 05:47:33 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:47:33 user nova-compute[75083]:     <video>
Nov 29 05:47:33 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:47:33 user nova-compute[75083]:     </video>
Nov 29 05:47:33 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:47:33 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:47:33 user nova-compute[75083]:     </rng>
Nov 29 05:47:33 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:47:33 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:47:33 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:47:33 user nova-compute[75083]:     </memballoon>
Nov 29 05:47:33 user nova-compute[75083]:   </devices>
Nov 29 05:47:33 user nova-compute[75083]: </domain>
Nov 29 05:47:33 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "address": "fa:16:3e:a9:ac:51", "network": {"id": "9c8a8302-51cb-4107-940f-b5f511d6a9d0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908598171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap750d3bad-3d", "ovs_interfaceid": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "address": "fa:16:3e:a9:ac:51", "network": {"id": "9c8a8302-51cb-4107-940f-b5f511d6a9d0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908598171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap750d3bad-3d", "ovs_interfaceid": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ac:51,bridge_name='br-int',has_traffic_filtering=True,id=750d3bad-3dc1-4a84-afd5-39f7d814da39,network=Network(9c8a8302-51cb-4107-940f-b5f511d6a9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap750d3bad-3d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ac:51,bridge_name='br-int',has_traffic_filtering=True,id=750d3bad-3dc1-4a84-afd5-39f7d814da39,network=Network(9c8a8302-51cb-4107-940f-b5f511d6a9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap750d3bad-3d') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5da5657-99d4-5fff-9bfd-bca9f4c509d5', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[93960218-9169-4c91-8678-762b36ff8c35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3] added
Nov 29 05:47:33 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap750d3bad-3d, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap750d3bad-3d, col_values=(('qos', UUID('6fdd8f8f-8ec5-4f9a-965e-e88abab6163d')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap750d3bad-3d, col_values=(('external_ids', {'iface-id': '750d3bad-3dc1-4a84-afd5-39f7d814da39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:ac:51', 'vm-uuid': '0f45ac21-017c-4247-b2ae-756ae1c12911'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: INFO os_vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ac:51,bridge_name='br-int',has_traffic_filtering=True,id=750d3bad-3dc1-4a84-afd5-39f7d814da39,network=Network(9c8a8302-51cb-4107-940f-b5f511d6a9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap750d3bad-3d')
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1323b7f9-c161-4943-8cf4-123982ca7348", "address": "fa:16:3e:cb:bc:b7", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1323b7f9-c1", "ovs_interfaceid": "1323b7f9-c161-4943-8cf4-123982ca7348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "1323b7f9-c161-4943-8cf4-123982ca7348", "address": "fa:16:3e:cb:bc:b7", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1323b7f9-c1", "ovs_interfaceid": "1323b7f9-c161-4943-8cf4-123982ca7348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:bc:b7,bridge_name='br-int',has_traffic_filtering=True,id=1323b7f9-c161-4943-8cf4-123982ca7348,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1323b7f9-c1') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:bc:b7,bridge_name='br-int',has_traffic_filtering=True,id=1323b7f9-c161-4943-8cf4-123982ca7348,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1323b7f9-c1') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '197afcc5-2a3f-5032-a549-2cc35354fe64', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e90729f-f3ba-4f16-8972-13250c3c1cda]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1323b7f9-c1, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1323b7f9-c1, col_values=(('qos', UUID('ec74283f-6db8-4f5e-8ffe-878bd7f3ba02')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1323b7f9-c1, col_values=(('external_ids', {'iface-id': '1323b7f9-c161-4943-8cf4-123982ca7348', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:bc:b7', 'vm-uuid': '0f45ac21-017c-4247-b2ae-756ae1c12911'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f9bed1-fdba-4d85-a424-5c5066335a9f]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pmrQSZjN {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: INFO os_vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:bc:b7,bridge_name='br-int',has_traffic_filtering=True,id=1323b7f9-c161-4943-8cf4-123982ca7348,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1323b7f9-c1')
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "807ff050-85ba-4543-9516-95ffb6235f90", "address": "fa:16:3e:47:bd:de", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807ff050-85", "ovs_interfaceid": "807ff050-85ba-4543-9516-95ffb6235f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "807ff050-85ba-4543-9516-95ffb6235f90", "address": "fa:16:3e:47:bd:de", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807ff050-85", "ovs_interfaceid": "807ff050-85ba-4543-9516-95ffb6235f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=807ff050-85ba-4543-9516-95ffb6235f90,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap807ff050-85') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=807ff050-85ba-4543-9516-95ffb6235f90,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap807ff050-85') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f6307da-2f2e-58db-962b-7a7ea9a8802c', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pmrQSZjN" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[600e1f85-91ae-464c-ac32-16115a5b80b8]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pmrQSZjN'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap807ff050-85, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap807ff050-85, col_values=(('qos', UUID('110a1c40-63f5-4074-9011-1ed36463e3b4')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap807ff050-85, col_values=(('external_ids', {'iface-id': '807ff050-85ba-4543-9516-95ffb6235f90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:bd:de', 'vm-uuid': '0f45ac21-017c-4247-b2ae-756ae1c12911'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ff2363-8d19-43e7-b509-c75d92aefba1]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aefe657-eec9-4b1e-a32b-f6016461e29d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:33 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:47:33 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:47:33 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:47:33 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:47:33 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:33 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:47:33 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:47:33 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:47:33 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:47:33 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: INFO os_vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=807ff050-85ba-4543-9516-95ffb6235f90,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap807ff050-85')
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd6b4eda-d093-4ed5-b230-acca120a8213", "address": "fa:16:3e:e4:98:4b", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6b4eda-d0", "ovs_interfaceid": "dd6b4eda-d093-4ed5-b230-acca120a8213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "dd6b4eda-d093-4ed5-b230-acca120a8213", "address": "fa:16:3e:e4:98:4b", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6b4eda-d0", "ovs_interfaceid": "dd6b4eda-d093-4ed5-b230-acca120a8213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:98:4b,bridge_name='br-int',has_traffic_filtering=True,id=dd6b4eda-d093-4ed5-b230-acca120a8213,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6b4eda-d0') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:98:4b,bridge_name='br-int',has_traffic_filtering=True,id=dd6b4eda-d093-4ed5-b230-acca120a8213,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6b4eda-d0') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d944148-3658-5e7e-bec6-a7db835568ef', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd6b4eda-d0, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd6b4eda-d0, col_values=(('qos', UUID('717a80fc-9e2c-4572-857f-0489504dbf8b')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd6b4eda-d0, col_values=(('external_ids', {'iface-id': 'dd6b4eda-d093-4ed5-b230-acca120a8213', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:98:4b', 'vm-uuid': '0f45ac21-017c-4247-b2ae-756ae1c12911'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2912d6-1921-481c-8c3c-881882d316bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3, portal: 172.16.0.220,3260]
Nov 29 05:47:33 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3, portal: 172.16.0.220,3260] successful.
Nov 29 05:47:33 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: INFO os_vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:98:4b,bridge_name='br-int',has_traffic_filtering=True,id=dd6b4eda-d093-4ed5-b230-acca120a8213,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6b4eda-d0')
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "address": "fa:16:3e:8c:e2:17", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283e3943-59", "ovs_interfaceid": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "address": "fa:16:3e:8c:e2:17", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283e3943-59", "ovs_interfaceid": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e2:17,bridge_name='br-int',has_traffic_filtering=True,id=283e3943-59e6-4eb2-8485-64e0cc08b4ed,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283e3943-59') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e2:17,bridge_name='br-int',has_traffic_filtering=True,id=283e3943-59e6-4eb2-8485-64e0cc08b4ed,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283e3943-59') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[140b05e1-2f49-4a5e-908c-a314a338f9ee]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2fdeeb97-6eab-55a6-9d7e-65a0618f4c3a', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8061c1-1727-40a5-a7bb-5573d63b3adf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:33 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:47:33 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:47:33 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:47:33 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:47:33 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:47:33 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:47:33 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:47:33 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:47:33 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:47:33 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:47:33 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:47:33 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap283e3943-59, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap283e3943-59, col_values=(('qos', UUID('7ef9518e-a04d-4d14-a295-d5f51be3d788')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap283e3943-59, col_values=(('external_ids', {'iface-id': '283e3943-59e6-4eb2-8485-64e0cc08b4ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:e2:17', 'vm-uuid': '0f45ac21-017c-4247-b2ae-756ae1c12911'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bce2a8d-4140-477c-969c-dc10ecf28c3d]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmrQSZjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: INFO os_vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e2:17,bridge_name='br-int',has_traffic_filtering=True,id=283e3943-59e6-4eb2-8485-64e0cc08b4ed,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283e3943-59')
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d92f1220-3106-4729-91df-22000fd2a29a", "address": "fa:16:3e:1a:77:de", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92f1220-31", "ovs_interfaceid": "d92f1220-3106-4729-91df-22000fd2a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "d92f1220-3106-4729-91df-22000fd2a29a", "address": "fa:16:3e:1a:77:de", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92f1220-31", "ovs_interfaceid": "d92f1220-3106-4729-91df-22000fd2a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:77:de,bridge_name='br-int',has_traffic_filtering=True,id=d92f1220-3106-4729-91df-22000fd2a29a,network=Network(979d0619-d0b6-485f-b7ea-251b510e7647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92f1220-31') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:77:de,bridge_name='br-int',has_traffic_filtering=True,id=d92f1220-3106-4729-91df-22000fd2a29a,network=Network(979d0619-d0b6-485f-b7ea-251b510e7647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92f1220-31') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3bbff3c4-42f7-5820-b2d1-19b45d9a49a1', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd92f1220-31, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd92f1220-31, col_values=(('qos', UUID('e737d3f4-6869-4526-9bbb-e72f29a63a7f')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd92f1220-31, col_values=(('external_ids', {'iface-id': 'd92f1220-3106-4729-91df-22000fd2a29a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:77:de', 'vm-uuid': '0f45ac21-017c-4247-b2ae-756ae1c12911'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: INFO os_vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:77:de,bridge_name='br-int',has_traffic_filtering=True,id=d92f1220-3106-4729-91df-22000fd2a29a,network=Network(979d0619-d0b6-485f-b7ea-251b510e7647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92f1220-31')
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "address": "fa:16:3e:f8:e7:46", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90d0fc0-64", "ovs_interfaceid": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "address": "fa:16:3e:f8:e7:46", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90d0fc0-64", "ovs_interfaceid": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e7:46,bridge_name='br-int',has_traffic_filtering=True,id=c90d0fc0-6432-4f98-8295-af931e20e0b5,network=Network(979d0619-d0b6-485f-b7ea-251b510e7647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc90d0fc0-64') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG os_vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e7:46,bridge_name='br-int',has_traffic_filtering=True,id=c90d0fc0-6432-4f98-8295-af931e20e0b5,network=Network(979d0619-d0b6-485f-b7ea-251b510e7647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc90d0fc0-64') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'acd01148-9c92-58a2-946c-9fdd2f8e1465', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc90d0fc0-64, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc90d0fc0-64, col_values=(('qos', UUID('4308af5b-292f-48ec-a959-ec4d40b91d0c')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc90d0fc0-64, col_values=(('external_ids', {'iface-id': 'c90d0fc0-6432-4f98-8295-af931e20e0b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:e7:46', 'vm-uuid': '0f45ac21-017c-4247-b2ae-756ae1c12911'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:33 user nova-compute[75083]: INFO os_vif [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e7:46,bridge_name='br-int',has_traffic_filtering=True,id=c90d0fc0-6432-4f98-8295-af931e20e0b5,network=Network(979d0619-d0b6-485f-b7ea-251b510e7647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc90d0fc0-64')
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] No BDM found with device name hda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] No VIF found with MAC fa:16:3e:a9:ac:51, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:47:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] No VIF found with MAC fa:16:3e:8c:e2:17, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:47:33 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Using config drive
Nov 29 05:47:34 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Creating config drive at /opt/stack/data/nova/instances/0f45ac21-017c-4247-b2ae-756ae1c12911/disk.config
Nov 29 05:47:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0f45ac21-017c-4247-b2ae-756ae1c12911/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0sizsezu {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0f45ac21-017c-4247-b2ae-756ae1c12911/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0sizsezu" returned: 0 in 0.052s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] <== connect_volume: return (2737ms) {'type': 'block', 'scsi_wwn': '26637316138646537', 'path': '/dev/sdg'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637316138646537', 'path': '/dev/sdg'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91851640-12fe-4910-bc52-dd499dfcb1cf", "address": "fa:16:3e:09:eb:19", "network": {"id": "a5217202-1f29-4714-b72b-12e14124535a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2006028268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91851640-12", "ovs_interfaceid": "91851640-12fe-4910-bc52-dd499dfcb1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "91851640-12fe-4910-bc52-dd499dfcb1cf", "address": "fa:16:3e:09:eb:19", "network": {"id": "a5217202-1f29-4714-b72b-12e14124535a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2006028268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91851640-12", "ovs_interfaceid": "91851640-12fe-4910-bc52-dd499dfcb1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:eb:19,bridge_name='br-int',has_traffic_filtering=True,id=91851640-12fe-4910-bc52-dd499dfcb1cf,network=Network(a5217202-1f29-4714-b72b-12e14124535a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91851640-12') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3b24c5a-0012-4caa-ae37-f752635c9190", "address": "fa:16:3e:33:b9:fa", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b24c5a-00", "ovs_interfaceid": "b3b24c5a-0012-4caa-ae37-f752635c9190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "b3b24c5a-0012-4caa-ae37-f752635c9190", "address": "fa:16:3e:33:b9:fa", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b24c5a-00", "ovs_interfaceid": "b3b24c5a-0012-4caa-ae37-f752635c9190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:b9:fa,bridge_name='br-int',has_traffic_filtering=True,id=b3b24c5a-0012-4caa-ae37-f752635c9190,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3b24c5a-00') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "address": "fa:16:3e:81:a1:d8", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0d6e28-f2", "ovs_interfaceid": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "address": "fa:16:3e:81:a1:d8", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0d6e28-f2", "ovs_interfaceid": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=af0d6e28-f22d-43b7-ba2e-147fcc449a18,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf0d6e28-f2') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "address": "fa:16:3e:95:7c:7d", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c8c3cf-ad", "ovs_interfaceid": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "address": "fa:16:3e:95:7c:7d", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c8c3cf-ad", "ovs_interfaceid": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:7c:7d,bridge_name='br-int',has_traffic_filtering=True,id=a8c8c3cf-ad69-4ba6-81cd-aed9289bc816,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c8c3cf-ad') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "address": "fa:16:3e:78:74:b7", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9cab68-94", "ovs_interfaceid": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "address": "fa:16:3e:78:74:b7", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9cab68-94", "ovs_interfaceid": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=ed9cab68-946e-4ed5-87d7-4f73c2f82ac2,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9cab68-94') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "address": "fa:16:3e:d9:f8:79", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e0f5cbd-0d", "ovs_interfaceid": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "address": "fa:16:3e:d9:f8:79", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e0f5cbd-0d", "ovs_interfaceid": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f8:79,bridge_name='br-int',has_traffic_filtering=True,id=0e0f5cbd-0d8d-40f8-949e-b6ae380534b2,network=Network(e24a73c3-29b8-48bb-8fc0-caed6df02191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e0f5cbd-0d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4c3696b-581b-4f04-831a-44532362bf1b", "address": "fa:16:3e:cc:7e:83", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c3696b-58", "ovs_interfaceid": "f4c3696b-581b-4f04-831a-44532362bf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "f4c3696b-581b-4f04-831a-44532362bf1b", "address": "fa:16:3e:cc:7e:83", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c3696b-58", "ovs_interfaceid": "f4c3696b-581b-4f04-831a-44532362bf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:7e:83,bridge_name='br-int',has_traffic_filtering=True,id=f4c3696b-581b-4f04-831a-44532362bf1b,network=Network(e24a73c3-29b8-48bb-8fc0-caed6df02191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4c3696b-58') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.objects.instance [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lazy-loading 'pci_devices' on Instance uuid e8fe9965-822d-4058-a031-e71b5fb03db4 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:47:34 user nova-compute[75083]:   <uuid>e8fe9965-822d-4058-a031-e71b5fb03db4</uuid>
Nov 29 05:47:34 user nova-compute[75083]:   <name>instance-0000000b</name>
Nov 29 05:47:34 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:47:34 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:47:34 user nova-compute[75083]:   <metadata>
Nov 29 05:47:34 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:47:34 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:47:34 user nova-compute[75083]:       <nova:name>tempest-device-tagging-server-415790641</nova:name>
Nov 29 05:47:34 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:47:26</nova:creationTime>
Nov 29 05:47:34 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:47:34 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:47:34 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:47:34 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:47:34 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:47:34 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:47:34 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:47:34 user nova-compute[75083]:       <nova:owner>
Nov 29 05:47:34 user nova-compute[75083]:         <nova:user uuid="72c70230bafc432daad785bc45c76f82">tempest-TaggedBootDevicesTest_v242-761712321-project-member</nova:user>
Nov 29 05:47:34 user nova-compute[75083]:         <nova:project uuid="66d83eb8afd744209d2f156412f867b8">tempest-TaggedBootDevicesTest_v242-761712321</nova:project>
Nov 29 05:47:34 user nova-compute[75083]:       </nova:owner>
Nov 29 05:47:34 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:47:34 user nova-compute[75083]:       <nova:ports>
Nov 29 05:47:34 user nova-compute[75083]:         <nova:port uuid="91851640-12fe-4910-bc52-dd499dfcb1cf">
Nov 29 05:47:34 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 05:47:34 user nova-compute[75083]:         </nova:port>
Nov 29 05:47:34 user nova-compute[75083]:         <nova:port uuid="b3b24c5a-0012-4caa-ae37-f752635c9190">
Nov 29 05:47:34 user nova-compute[75083]:           <nova:ip type="fixed" address="10.1.1.112" ipVersion="4"/>
Nov 29 05:47:34 user nova-compute[75083]:         </nova:port>
Nov 29 05:47:34 user nova-compute[75083]:         <nova:port uuid="af0d6e28-f22d-43b7-ba2e-147fcc449a18">
Nov 29 05:47:34 user nova-compute[75083]:           <nova:ip type="fixed" address="10.1.1.226" ipVersion="4"/>
Nov 29 05:47:34 user nova-compute[75083]:         </nova:port>
Nov 29 05:47:34 user nova-compute[75083]:         <nova:port uuid="a8c8c3cf-ad69-4ba6-81cd-aed9289bc816">
Nov 29 05:47:34 user nova-compute[75083]:           <nova:ip type="fixed" address="10.1.1.214" ipVersion="4"/>
Nov 29 05:47:34 user nova-compute[75083]:         </nova:port>
Nov 29 05:47:34 user nova-compute[75083]:         <nova:port uuid="ed9cab68-946e-4ed5-87d7-4f73c2f82ac2">
Nov 29 05:47:34 user nova-compute[75083]:           <nova:ip type="fixed" address="10.1.1.107" ipVersion="4"/>
Nov 29 05:47:34 user nova-compute[75083]:         </nova:port>
Nov 29 05:47:34 user nova-compute[75083]:         <nova:port uuid="0e0f5cbd-0d8d-40f8-949e-b6ae380534b2">
Nov 29 05:47:34 user nova-compute[75083]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 05:47:34 user nova-compute[75083]:         </nova:port>
Nov 29 05:47:34 user nova-compute[75083]:         <nova:port uuid="f4c3696b-581b-4f04-831a-44532362bf1b">
Nov 29 05:47:34 user nova-compute[75083]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 05:47:34 user nova-compute[75083]:         </nova:port>
Nov 29 05:47:34 user nova-compute[75083]:       </nova:ports>
Nov 29 05:47:34 user nova-compute[75083]:     </nova:instance>
Nov 29 05:47:34 user nova-compute[75083]:   </metadata>
Nov 29 05:47:34 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:47:34 user nova-compute[75083]:     <system>
Nov 29 05:47:34 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:47:34 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:47:34 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:47:34 user nova-compute[75083]:       <entry name="serial">e8fe9965-822d-4058-a031-e71b5fb03db4</entry>
Nov 29 05:47:34 user nova-compute[75083]:       <entry name="uuid">e8fe9965-822d-4058-a031-e71b5fb03db4</entry>
Nov 29 05:47:34 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:47:34 user nova-compute[75083]:     </system>
Nov 29 05:47:34 user nova-compute[75083]:   </sysinfo>
Nov 29 05:47:34 user nova-compute[75083]:   <os>
Nov 29 05:47:34 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:47:34 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:47:34 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:47:34 user nova-compute[75083]:   </os>
Nov 29 05:47:34 user nova-compute[75083]:   <features>
Nov 29 05:47:34 user nova-compute[75083]:     <acpi/>
Nov 29 05:47:34 user nova-compute[75083]:     <apic/>
Nov 29 05:47:34 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:47:34 user nova-compute[75083]:   </features>
Nov 29 05:47:34 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:47:34 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:47:34 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:47:34 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:47:34 user nova-compute[75083]:   </clock>
Nov 29 05:47:34 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:47:34 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:47:34 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:47:34 user nova-compute[75083]:   </cpu>
Nov 29 05:47:34 user nova-compute[75083]:   <devices>
Nov 29 05:47:34 user nova-compute[75083]:     <disk type="file" device="cdrom">
Nov 29 05:47:34 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 05:47:34 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/e8fe9965-822d-4058-a031-e71b5fb03db4/disk.config"/>
Nov 29 05:47:34 user nova-compute[75083]:       <target dev="hda" bus="ide"/>
Nov 29 05:47:34 user nova-compute[75083]:     </disk>
Nov 29 05:47:34 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 05:47:34 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:47:34 user nova-compute[75083]:       <source dev="/dev/sdc"/>
Nov 29 05:47:34 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:47:34 user nova-compute[75083]:       <serial>e1bd378b-277c-40a6-9292-e87b013b8ba0</serial>
Nov 29 05:47:34 user nova-compute[75083]:     </disk>
Nov 29 05:47:34 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 05:47:34 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:47:34 user nova-compute[75083]:       <source dev="/dev/sde"/>
Nov 29 05:47:34 user nova-compute[75083]:       <target dev="vdb" bus="virtio"/>
Nov 29 05:47:34 user nova-compute[75083]:       <serial>d3950d96-ff2a-493d-8802-3ad5c9a7fd83</serial>
Nov 29 05:47:34 user nova-compute[75083]:     </disk>
Nov 29 05:47:34 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 05:47:34 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:47:34 user nova-compute[75083]:       <source dev="/dev/sdg"/>
Nov 29 05:47:34 user nova-compute[75083]:       <target dev="vdc" bus="virtio"/>
Nov 29 05:47:34 user nova-compute[75083]:       <serial>3114b1ca-f90b-44fa-9c49-fd3c8b7852a3</serial>
Nov 29 05:47:34 user nova-compute[75083]:     </disk>
Nov 29 05:47:34 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:47:34 user nova-compute[75083]:       <mac address="fa:16:3e:09:eb:19"/>
Nov 29 05:47:34 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:47:34 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:47:34 user nova-compute[75083]:       <target dev="tap91851640-12"/>
Nov 29 05:47:34 user nova-compute[75083]:     </interface>
Nov 29 05:47:34 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:47:34 user nova-compute[75083]:       <mac address="fa:16:3e:33:b9:fa"/>
Nov 29 05:47:34 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:47:34 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:47:34 user nova-compute[75083]:       <target dev="tapb3b24c5a-00"/>
Nov 29 05:47:34 user nova-compute[75083]:     </interface>
Nov 29 05:47:34 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:47:34 user nova-compute[75083]:       <mac address="fa:16:3e:81:a1:d8"/>
Nov 29 05:47:34 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:47:34 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:47:34 user nova-compute[75083]:       <target dev="tapaf0d6e28-f2"/>
Nov 29 05:47:34 user nova-compute[75083]:     </interface>
Nov 29 05:47:34 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:47:34 user nova-compute[75083]:       <mac address="fa:16:3e:95:7c:7d"/>
Nov 29 05:47:34 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:47:34 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:47:34 user nova-compute[75083]:       <target dev="tapa8c8c3cf-ad"/>
Nov 29 05:47:34 user nova-compute[75083]:     </interface>
Nov 29 05:47:34 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:47:34 user nova-compute[75083]:       <mac address="fa:16:3e:78:74:b7"/>
Nov 29 05:47:34 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:47:34 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:47:34 user nova-compute[75083]:       <target dev="taped9cab68-94"/>
Nov 29 05:47:34 user nova-compute[75083]:     </interface>
Nov 29 05:47:34 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:47:34 user nova-compute[75083]:       <mac address="fa:16:3e:d9:f8:79"/>
Nov 29 05:47:34 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:47:34 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:47:34 user nova-compute[75083]:       <target dev="tap0e0f5cbd-0d"/>
Nov 29 05:47:34 user nova-compute[75083]:     </interface>
Nov 29 05:47:34 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:47:34 user nova-compute[75083]:       <mac address="fa:16:3e:cc:7e:83"/>
Nov 29 05:47:34 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:47:34 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:47:34 user nova-compute[75083]:       <target dev="tapf4c3696b-58"/>
Nov 29 05:47:34 user nova-compute[75083]:     </interface>
Nov 29 05:47:34 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:47:34 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/e8fe9965-822d-4058-a031-e71b5fb03db4/console.log" append="off"/>
Nov 29 05:47:34 user nova-compute[75083]:     </serial>
Nov 29 05:47:34 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:47:34 user nova-compute[75083]:     <video>
Nov 29 05:47:34 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:47:34 user nova-compute[75083]:     </video>
Nov 29 05:47:34 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:47:34 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:47:34 user nova-compute[75083]:     </rng>
Nov 29 05:47:34 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:47:34 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:47:34 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:47:34 user nova-compute[75083]:     </memballoon>
Nov 29 05:47:34 user nova-compute[75083]:   </devices>
Nov 29 05:47:34 user nova-compute[75083]: </domain>
Nov 29 05:47:34 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91851640-12fe-4910-bc52-dd499dfcb1cf", "address": "fa:16:3e:09:eb:19", "network": {"id": "a5217202-1f29-4714-b72b-12e14124535a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2006028268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91851640-12", "ovs_interfaceid": "91851640-12fe-4910-bc52-dd499dfcb1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "91851640-12fe-4910-bc52-dd499dfcb1cf", "address": "fa:16:3e:09:eb:19", "network": {"id": "a5217202-1f29-4714-b72b-12e14124535a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2006028268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91851640-12", "ovs_interfaceid": "91851640-12fe-4910-bc52-dd499dfcb1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:eb:19,bridge_name='br-int',has_traffic_filtering=True,id=91851640-12fe-4910-bc52-dd499dfcb1cf,network=Network(a5217202-1f29-4714-b72b-12e14124535a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91851640-12') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG os_vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:eb:19,bridge_name='br-int',has_traffic_filtering=True,id=91851640-12fe-4910-bc52-dd499dfcb1cf,network=Network(a5217202-1f29-4714-b72b-12e14124535a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91851640-12') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d6827bd-7b25-5540-8162-f77bd3db306a', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91851640-12, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91851640-12, col_values=(('qos', UUID('f72a47b2-01bb-44d5-8b12-23e1eaabb1ce')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91851640-12, col_values=(('external_ids', {'iface-id': '91851640-12fe-4910-bc52-dd499dfcb1cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:eb:19', 'vm-uuid': 'e8fe9965-822d-4058-a031-e71b5fb03db4'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:34 user nova-compute[75083]: INFO os_vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:eb:19,bridge_name='br-int',has_traffic_filtering=True,id=91851640-12fe-4910-bc52-dd499dfcb1cf,network=Network(a5217202-1f29-4714-b72b-12e14124535a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91851640-12')
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3b24c5a-0012-4caa-ae37-f752635c9190", "address": "fa:16:3e:33:b9:fa", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b24c5a-00", "ovs_interfaceid": "b3b24c5a-0012-4caa-ae37-f752635c9190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "b3b24c5a-0012-4caa-ae37-f752635c9190", "address": "fa:16:3e:33:b9:fa", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b24c5a-00", "ovs_interfaceid": "b3b24c5a-0012-4caa-ae37-f752635c9190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:b9:fa,bridge_name='br-int',has_traffic_filtering=True,id=b3b24c5a-0012-4caa-ae37-f752635c9190,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3b24c5a-00') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG os_vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:b9:fa,bridge_name='br-int',has_traffic_filtering=True,id=b3b24c5a-0012-4caa-ae37-f752635c9190,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3b24c5a-00') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35a27992-7f7c-5134-9230-6175d0ee574b', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3b24c5a-00, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3b24c5a-00, col_values=(('qos', UUID('7eb7f03c-4679-4a2e-ac6a-02a0ce243a7c')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3b24c5a-00, col_values=(('external_ids', {'iface-id': 'b3b24c5a-0012-4caa-ae37-f752635c9190', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:b9:fa', 'vm-uuid': 'e8fe9965-822d-4058-a031-e71b5fb03db4'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:34 user nova-compute[75083]: INFO os_vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:b9:fa,bridge_name='br-int',has_traffic_filtering=True,id=b3b24c5a-0012-4caa-ae37-f752635c9190,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3b24c5a-00')
Nov 29 05:47:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "address": "fa:16:3e:81:a1:d8", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0d6e28-f2", "ovs_interfaceid": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "address": "fa:16:3e:81:a1:d8", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0d6e28-f2", "ovs_interfaceid": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=af0d6e28-f22d-43b7-ba2e-147fcc449a18,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf0d6e28-f2') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG os_vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=af0d6e28-f22d-43b7-ba2e-147fcc449a18,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf0d6e28-f2') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a1008e5-71f2-59f2-98be-c04fb1cffa2e', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf0d6e28-f2, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf0d6e28-f2, col_values=(('qos', UUID('db95cf17-11ad-4732-8181-82b84b8c41c7')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf0d6e28-f2, col_values=(('external_ids', {'iface-id': 'af0d6e28-f22d-43b7-ba2e-147fcc449a18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:a1:d8', 'vm-uuid': 'e8fe9965-822d-4058-a031-e71b5fb03db4'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: INFO os_vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=af0d6e28-f22d-43b7-ba2e-147fcc449a18,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf0d6e28-f2')
Nov 29 05:47:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "address": "fa:16:3e:95:7c:7d", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c8c3cf-ad", "ovs_interfaceid": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "address": "fa:16:3e:95:7c:7d", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c8c3cf-ad", "ovs_interfaceid": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:7c:7d,bridge_name='br-int',has_traffic_filtering=True,id=a8c8c3cf-ad69-4ba6-81cd-aed9289bc816,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c8c3cf-ad') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG os_vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:7c:7d,bridge_name='br-int',has_traffic_filtering=True,id=a8c8c3cf-ad69-4ba6-81cd-aed9289bc816,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c8c3cf-ad') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86ad1699-5d72-55fe-9d06-8007c500ebf1', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8c8c3cf-ad, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8c8c3cf-ad, col_values=(('qos', UUID('1b2c304f-a782-4013-a532-bd4a3dfac26c')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8c8c3cf-ad, col_values=(('external_ids', {'iface-id': 'a8c8c3cf-ad69-4ba6-81cd-aed9289bc816', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:7c:7d', 'vm-uuid': 'e8fe9965-822d-4058-a031-e71b5fb03db4'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: INFO os_vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:7c:7d,bridge_name='br-int',has_traffic_filtering=True,id=a8c8c3cf-ad69-4ba6-81cd-aed9289bc816,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c8c3cf-ad')
Nov 29 05:47:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "address": "fa:16:3e:78:74:b7", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9cab68-94", "ovs_interfaceid": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "address": "fa:16:3e:78:74:b7", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9cab68-94", "ovs_interfaceid": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=ed9cab68-946e-4ed5-87d7-4f73c2f82ac2,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9cab68-94') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG os_vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=ed9cab68-946e-4ed5-87d7-4f73c2f82ac2,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9cab68-94') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e561b77c-83c9-567f-8c42-8b8ff56256bb', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped9cab68-94, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped9cab68-94, col_values=(('qos', UUID('26d01193-cb0b-400d-b4f2-424363ca4a1b')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped9cab68-94, col_values=(('external_ids', {'iface-id': 'ed9cab68-946e-4ed5-87d7-4f73c2f82ac2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:74:b7', 'vm-uuid': 'e8fe9965-822d-4058-a031-e71b5fb03db4'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: INFO os_vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=ed9cab68-946e-4ed5-87d7-4f73c2f82ac2,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9cab68-94')
Nov 29 05:47:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "address": "fa:16:3e:d9:f8:79", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e0f5cbd-0d", "ovs_interfaceid": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "address": "fa:16:3e:d9:f8:79", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e0f5cbd-0d", "ovs_interfaceid": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f8:79,bridge_name='br-int',has_traffic_filtering=True,id=0e0f5cbd-0d8d-40f8-949e-b6ae380534b2,network=Network(e24a73c3-29b8-48bb-8fc0-caed6df02191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e0f5cbd-0d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG os_vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f8:79,bridge_name='br-int',has_traffic_filtering=True,id=0e0f5cbd-0d8d-40f8-949e-b6ae380534b2,network=Network(e24a73c3-29b8-48bb-8fc0-caed6df02191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e0f5cbd-0d') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '632f570b-6d48-5108-8798-159f63916610', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e0f5cbd-0d, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e0f5cbd-0d, col_values=(('qos', UUID('1192b82a-8080-46d7-96d8-f36f526c80ba')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e0f5cbd-0d, col_values=(('external_ids', {'iface-id': '0e0f5cbd-0d8d-40f8-949e-b6ae380534b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:f8:79', 'vm-uuid': 'e8fe9965-822d-4058-a031-e71b5fb03db4'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:36 user nova-compute[75083]: INFO os_vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f8:79,bridge_name='br-int',has_traffic_filtering=True,id=0e0f5cbd-0d8d-40f8-949e-b6ae380534b2,network=Network(e24a73c3-29b8-48bb-8fc0-caed6df02191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e0f5cbd-0d')
Nov 29 05:47:36 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:47:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4c3696b-581b-4f04-831a-44532362bf1b", "address": "fa:16:3e:cc:7e:83", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c3696b-58", "ovs_interfaceid": "f4c3696b-581b-4f04-831a-44532362bf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "f4c3696b-581b-4f04-831a-44532362bf1b", "address": "fa:16:3e:cc:7e:83", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c3696b-58", "ovs_interfaceid": "f4c3696b-581b-4f04-831a-44532362bf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:7e:83,bridge_name='br-int',has_traffic_filtering=True,id=f4c3696b-581b-4f04-831a-44532362bf1b,network=Network(e24a73c3-29b8-48bb-8fc0-caed6df02191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4c3696b-58') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG os_vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:7e:83,bridge_name='br-int',has_traffic_filtering=True,id=f4c3696b-581b-4f04-831a-44532362bf1b,network=Network(e24a73c3-29b8-48bb-8fc0-caed6df02191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4c3696b-58') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f8fc6b0-ae31-550f-9a11-b46a2dfac8c3', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG nova.compute.manager [req-07843e35-6668-485e-8c9a-0422ecbfe3a4 req-fffb4844-7088-4dd6-a8e8-48e9c6c7e329 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-750d3bad-3dc1-4a84-afd5-39f7d814da39 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-07843e35-6668-485e-8c9a-0422ecbfe3a4 req-fffb4844-7088-4dd6-a8e8-48e9c6c7e329 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-07843e35-6668-485e-8c9a-0422ecbfe3a4 req-fffb4844-7088-4dd6-a8e8-48e9c6c7e329 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-07843e35-6668-485e-8c9a-0422ecbfe3a4 req-fffb4844-7088-4dd6-a8e8-48e9c6c7e329 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG nova.compute.manager [req-07843e35-6668-485e-8c9a-0422ecbfe3a4 req-fffb4844-7088-4dd6-a8e8-48e9c6c7e329 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-750d3bad-3dc1-4a84-afd5-39f7d814da39 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:36 user nova-compute[75083]: WARNING nova.compute.manager [req-07843e35-6668-485e-8c9a-0422ecbfe3a4 req-fffb4844-7088-4dd6-a8e8-48e9c6c7e329 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-750d3bad-3dc1-4a84-afd5-39f7d814da39 for instance with vm_state building and task_state spawning.
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4c3696b-58, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4c3696b-58, col_values=(('qos', UUID('423d48ef-e31f-462f-b121-40b2caa99084')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4c3696b-58, col_values=(('external_ids', {'iface-id': 'f4c3696b-581b-4f04-831a-44532362bf1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:7e:83', 'vm-uuid': 'e8fe9965-822d-4058-a031-e71b5fb03db4'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:36 user nova-compute[75083]: INFO os_vif [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:7e:83,bridge_name='br-int',has_traffic_filtering=True,id=f4c3696b-581b-4f04-831a-44532362bf1b,network=Network(e24a73c3-29b8-48bb-8fc0-caed6df02191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4c3696b-58')
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG nova.compute.manager [req-ef8944fa-7e66-44e7-bce7-18df4bdac322 req-45132bfd-5628-41e6-b0d4-8ef4f27ff3c1 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-1323b7f9-c161-4943-8cf4-123982ca7348 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ef8944fa-7e66-44e7-bce7-18df4bdac322 req-45132bfd-5628-41e6-b0d4-8ef4f27ff3c1 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ef8944fa-7e66-44e7-bce7-18df4bdac322 req-45132bfd-5628-41e6-b0d4-8ef4f27ff3c1 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ef8944fa-7e66-44e7-bce7-18df4bdac322 req-45132bfd-5628-41e6-b0d4-8ef4f27ff3c1 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG nova.compute.manager [req-ef8944fa-7e66-44e7-bce7-18df4bdac322 req-45132bfd-5628-41e6-b0d4-8ef4f27ff3c1 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-1323b7f9-c161-4943-8cf4-123982ca7348 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:36 user nova-compute[75083]: WARNING nova.compute.manager [req-ef8944fa-7e66-44e7-bce7-18df4bdac322 req-45132bfd-5628-41e6-b0d4-8ef4f27ff3c1 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-1323b7f9-c161-4943-8cf4-123982ca7348 for instance with vm_state building and task_state spawning.
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] No BDM found with device name hda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] No VIF found with MAC fa:16:3e:09:eb:19, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] No VIF found with MAC fa:16:3e:78:74:b7, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:47:36 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Using config drive
Nov 29 05:47:36 user nova-compute[75083]: DEBUG nova.compute.manager [req-0eec5378-e0eb-4393-af97-42b604845130 req-ab10e429-b109-4ce9-9f58-52f5d7b57f90 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-807ff050-85ba-4543-9516-95ffb6235f90 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0eec5378-e0eb-4393-af97-42b604845130 req-ab10e429-b109-4ce9-9f58-52f5d7b57f90 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0eec5378-e0eb-4393-af97-42b604845130 req-ab10e429-b109-4ce9-9f58-52f5d7b57f90 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0eec5378-e0eb-4393-af97-42b604845130 req-ab10e429-b109-4ce9-9f58-52f5d7b57f90 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG nova.compute.manager [req-0eec5378-e0eb-4393-af97-42b604845130 req-ab10e429-b109-4ce9-9f58-52f5d7b57f90 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-807ff050-85ba-4543-9516-95ffb6235f90 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:36 user nova-compute[75083]: WARNING nova.compute.manager [req-0eec5378-e0eb-4393-af97-42b604845130 req-ab10e429-b109-4ce9-9f58-52f5d7b57f90 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-807ff050-85ba-4543-9516-95ffb6235f90 for instance with vm_state building and task_state spawning.
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:37 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Creating config drive at /opt/stack/data/nova/instances/e8fe9965-822d-4058-a031-e71b5fb03db4/disk.config
Nov 29 05:47:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e8fe9965-822d-4058-a031-e71b5fb03db4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3s6ufjan {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e8fe9965-822d-4058-a031-e71b5fb03db4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3s6ufjan" returned: 0 in 0.074s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-e52fbed1-c630-42cd-9b07-490a2edd0062 req-97dd1b77-ec50-4260-adf0-7b219b975a1c service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-750d3bad-3dc1-4a84-afd5-39f7d814da39 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e52fbed1-c630-42cd-9b07-490a2edd0062 req-97dd1b77-ec50-4260-adf0-7b219b975a1c service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e52fbed1-c630-42cd-9b07-490a2edd0062 req-97dd1b77-ec50-4260-adf0-7b219b975a1c service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e52fbed1-c630-42cd-9b07-490a2edd0062 req-97dd1b77-ec50-4260-adf0-7b219b975a1c service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-e52fbed1-c630-42cd-9b07-490a2edd0062 req-97dd1b77-ec50-4260-adf0-7b219b975a1c service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-750d3bad-3dc1-4a84-afd5-39f7d814da39 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:38 user nova-compute[75083]: WARNING nova.compute.manager [req-e52fbed1-c630-42cd-9b07-490a2edd0062 req-97dd1b77-ec50-4260-adf0-7b219b975a1c service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-750d3bad-3dc1-4a84-afd5-39f7d814da39 for instance with vm_state building and task_state spawning.
Nov 29 05:47:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-1323b7f9-c161-4943-8cf4-123982ca7348 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-1323b7f9-c161-4943-8cf4-123982ca7348 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:38 user nova-compute[75083]: WARNING nova.compute.manager [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-1323b7f9-c161-4943-8cf4-123982ca7348 for instance with vm_state building and task_state spawning.
Nov 29 05:47:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-dd6b4eda-d093-4ed5-b230-acca120a8213 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-dd6b4eda-d093-4ed5-b230-acca120a8213 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:38 user nova-compute[75083]: WARNING nova.compute.manager [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-dd6b4eda-d093-4ed5-b230-acca120a8213 for instance with vm_state building and task_state spawning.
Nov 29 05:47:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-dd6b4eda-d093-4ed5-b230-acca120a8213 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-dd6b4eda-d093-4ed5-b230-acca120a8213 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:38 user nova-compute[75083]: WARNING nova.compute.manager [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-dd6b4eda-d093-4ed5-b230-acca120a8213 for instance with vm_state building and task_state spawning.
Nov 29 05:47:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-d92f1220-3106-4729-91df-22000fd2a29a {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-d92f1220-3106-4729-91df-22000fd2a29a {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:38 user nova-compute[75083]: WARNING nova.compute.manager [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-d92f1220-3106-4729-91df-22000fd2a29a for instance with vm_state building and task_state spawning.
Nov 29 05:47:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-d92f1220-3106-4729-91df-22000fd2a29a {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-d92f1220-3106-4729-91df-22000fd2a29a {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:38 user nova-compute[75083]: WARNING nova.compute.manager [req-f0c5c0f7-ff2d-444f-ab0b-8f9e96f563cc req-f7651bdf-49c5-4e06-a8db-3879c84eaf17 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-d92f1220-3106-4729-91df-22000fd2a29a for instance with vm_state building and task_state spawning.
Nov 29 05:47:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG nova.compute.manager [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-807ff050-85ba-4543-9516-95ffb6235f90 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG nova.compute.manager [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-807ff050-85ba-4543-9516-95ffb6235f90 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:39 user nova-compute[75083]: WARNING nova.compute.manager [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-807ff050-85ba-4543-9516-95ffb6235f90 for instance with vm_state building and task_state spawning.
Nov 29 05:47:39 user nova-compute[75083]: DEBUG nova.compute.manager [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-283e3943-59e6-4eb2-8485-64e0cc08b4ed {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG nova.compute.manager [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-283e3943-59e6-4eb2-8485-64e0cc08b4ed {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:39 user nova-compute[75083]: WARNING nova.compute.manager [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-283e3943-59e6-4eb2-8485-64e0cc08b4ed for instance with vm_state building and task_state spawning.
Nov 29 05:47:39 user nova-compute[75083]: DEBUG nova.compute.manager [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-283e3943-59e6-4eb2-8485-64e0cc08b4ed {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG nova.compute.manager [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-283e3943-59e6-4eb2-8485-64e0cc08b4ed {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:39 user nova-compute[75083]: WARNING nova.compute.manager [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-283e3943-59e6-4eb2-8485-64e0cc08b4ed for instance with vm_state building and task_state spawning.
Nov 29 05:47:39 user nova-compute[75083]: DEBUG nova.compute.manager [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-c90d0fc0-6432-4f98-8295-af931e20e0b5 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG nova.compute.manager [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-c90d0fc0-6432-4f98-8295-af931e20e0b5 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:39 user nova-compute[75083]: WARNING nova.compute.manager [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-c90d0fc0-6432-4f98-8295-af931e20e0b5 for instance with vm_state building and task_state spawning.
Nov 29 05:47:39 user nova-compute[75083]: DEBUG nova.compute.manager [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-c90d0fc0-6432-4f98-8295-af931e20e0b5 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG nova.compute.manager [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-c90d0fc0-6432-4f98-8295-af931e20e0b5 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:39 user nova-compute[75083]: WARNING nova.compute.manager [req-f988fa4a-08c0-4da1-ab2b-33be5b56bab9 req-8e6aaa72-dff7-423d-b275-654ad263ddf5 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-c90d0fc0-6432-4f98-8295-af931e20e0b5 for instance with vm_state building and task_state spawning.
Nov 29 05:47:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-91851640-12fe-4910-bc52-dd499dfcb1cf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-91851640-12fe-4910-bc52-dd499dfcb1cf {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:40 user nova-compute[75083]: WARNING nova.compute.manager [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-91851640-12fe-4910-bc52-dd499dfcb1cf for instance with vm_state building and task_state spawning.
Nov 29 05:47:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-91851640-12fe-4910-bc52-dd499dfcb1cf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-91851640-12fe-4910-bc52-dd499dfcb1cf {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:40 user nova-compute[75083]: WARNING nova.compute.manager [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-91851640-12fe-4910-bc52-dd499dfcb1cf for instance with vm_state building and task_state spawning.
Nov 29 05:47:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-b3b24c5a-0012-4caa-ae37-f752635c9190 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-b3b24c5a-0012-4caa-ae37-f752635c9190 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:41 user nova-compute[75083]: WARNING nova.compute.manager [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-b3b24c5a-0012-4caa-ae37-f752635c9190 for instance with vm_state building and task_state spawning.
Nov 29 05:47:41 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-b3b24c5a-0012-4caa-ae37-f752635c9190 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-b3b24c5a-0012-4caa-ae37-f752635c9190 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:41 user nova-compute[75083]: WARNING nova.compute.manager [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-b3b24c5a-0012-4caa-ae37-f752635c9190 for instance with vm_state building and task_state spawning.
Nov 29 05:47:41 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-af0d6e28-f22d-43b7-ba2e-147fcc449a18 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-af0d6e28-f22d-43b7-ba2e-147fcc449a18 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:41 user nova-compute[75083]: WARNING nova.compute.manager [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-af0d6e28-f22d-43b7-ba2e-147fcc449a18 for instance with vm_state building and task_state spawning.
Nov 29 05:47:41 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-af0d6e28-f22d-43b7-ba2e-147fcc449a18 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-af0d6e28-f22d-43b7-ba2e-147fcc449a18 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:41 user nova-compute[75083]: WARNING nova.compute.manager [req-ea2f008c-009f-4af7-9a4b-6773fa622cb2 req-d3984825-deca-45f7-95fb-91f4f466553d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-af0d6e28-f22d-43b7-ba2e-147fcc449a18 for instance with vm_state building and task_state spawning.
Nov 29 05:47:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG nova.compute.manager [req-2ac2845b-164a-4cff-accf-567b40e785f7 req-d12ce8a9-b415-41db-b8f6-e14fbc95e675 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-0e0f5cbd-0d8d-40f8-949e-b6ae380534b2 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2ac2845b-164a-4cff-accf-567b40e785f7 req-d12ce8a9-b415-41db-b8f6-e14fbc95e675 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2ac2845b-164a-4cff-accf-567b40e785f7 req-d12ce8a9-b415-41db-b8f6-e14fbc95e675 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2ac2845b-164a-4cff-accf-567b40e785f7 req-d12ce8a9-b415-41db-b8f6-e14fbc95e675 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG nova.compute.manager [req-2ac2845b-164a-4cff-accf-567b40e785f7 req-d12ce8a9-b415-41db-b8f6-e14fbc95e675 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-0e0f5cbd-0d8d-40f8-949e-b6ae380534b2 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:41 user nova-compute[75083]: WARNING nova.compute.manager [req-2ac2845b-164a-4cff-accf-567b40e785f7 req-d12ce8a9-b415-41db-b8f6-e14fbc95e675 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-0e0f5cbd-0d8d-40f8-949e-b6ae380534b2 for instance with vm_state building and task_state spawning.
Nov 29 05:47:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:47:41 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Instance spawned successfully.
Nov 29 05:47:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:47:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:41 user nova-compute[75083]: INFO nova.compute.manager [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Took 15.47 seconds to spawn the instance on the hypervisor.
Nov 29 05:47:41 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:47:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:42 user nova-compute[75083]: INFO nova.compute.manager [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Took 43.76 seconds to build instance.
Nov 29 05:47:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fda9a6ba-1e4a-4013-aa4d-83bc93a2b605 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.923s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-a8c8c3cf-ad69-4ba6-81cd-aed9289bc816 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-a8c8c3cf-ad69-4ba6-81cd-aed9289bc816 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:43 user nova-compute[75083]: WARNING nova.compute.manager [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-a8c8c3cf-ad69-4ba6-81cd-aed9289bc816 for instance with vm_state building and task_state spawning.
Nov 29 05:47:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-a8c8c3cf-ad69-4ba6-81cd-aed9289bc816 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-a8c8c3cf-ad69-4ba6-81cd-aed9289bc816 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:43 user nova-compute[75083]: WARNING nova.compute.manager [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-a8c8c3cf-ad69-4ba6-81cd-aed9289bc816 for instance with vm_state building and task_state spawning.
Nov 29 05:47:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-ed9cab68-946e-4ed5-87d7-4f73c2f82ac2 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-ed9cab68-946e-4ed5-87d7-4f73c2f82ac2 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:43 user nova-compute[75083]: WARNING nova.compute.manager [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-ed9cab68-946e-4ed5-87d7-4f73c2f82ac2 for instance with vm_state building and task_state spawning.
Nov 29 05:47:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-ed9cab68-946e-4ed5-87d7-4f73c2f82ac2 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-ed9cab68-946e-4ed5-87d7-4f73c2f82ac2 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:43 user nova-compute[75083]: WARNING nova.compute.manager [req-d476c675-a11c-4a72-8234-7f115e0443b4 req-bc81ec7f-2207-4b90-b46d-ff1816d64326 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-ed9cab68-946e-4ed5-87d7-4f73c2f82ac2 for instance with vm_state building and task_state spawning.
Nov 29 05:47:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-be12aa2a-21cc-45e4-b393-3d55d4acf818 req-592c0e4d-c7f0-4c93-b965-a91851c09626 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-0e0f5cbd-0d8d-40f8-949e-b6ae380534b2 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-be12aa2a-21cc-45e4-b393-3d55d4acf818 req-592c0e4d-c7f0-4c93-b965-a91851c09626 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-be12aa2a-21cc-45e4-b393-3d55d4acf818 req-592c0e4d-c7f0-4c93-b965-a91851c09626 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-be12aa2a-21cc-45e4-b393-3d55d4acf818 req-592c0e4d-c7f0-4c93-b965-a91851c09626 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-be12aa2a-21cc-45e4-b393-3d55d4acf818 req-592c0e4d-c7f0-4c93-b965-a91851c09626 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-0e0f5cbd-0d8d-40f8-949e-b6ae380534b2 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:43 user nova-compute[75083]: WARNING nova.compute.manager [req-be12aa2a-21cc-45e4-b393-3d55d4acf818 req-592c0e4d-c7f0-4c93-b965-a91851c09626 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-0e0f5cbd-0d8d-40f8-949e-b6ae380534b2 for instance with vm_state building and task_state spawning.
Nov 29 05:47:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-be12aa2a-21cc-45e4-b393-3d55d4acf818 req-592c0e4d-c7f0-4c93-b965-a91851c09626 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-f4c3696b-581b-4f04-831a-44532362bf1b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-be12aa2a-21cc-45e4-b393-3d55d4acf818 req-592c0e4d-c7f0-4c93-b965-a91851c09626 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-be12aa2a-21cc-45e4-b393-3d55d4acf818 req-592c0e4d-c7f0-4c93-b965-a91851c09626 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-be12aa2a-21cc-45e4-b393-3d55d4acf818 req-592c0e4d-c7f0-4c93-b965-a91851c09626 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-be12aa2a-21cc-45e4-b393-3d55d4acf818 req-592c0e4d-c7f0-4c93-b965-a91851c09626 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-f4c3696b-581b-4f04-831a-44532362bf1b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:43 user nova-compute[75083]: WARNING nova.compute.manager [req-be12aa2a-21cc-45e4-b393-3d55d4acf818 req-592c0e4d-c7f0-4c93-b965-a91851c09626 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-f4c3696b-581b-4f04-831a-44532362bf1b for instance with vm_state building and task_state spawning.
Nov 29 05:47:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-be12aa2a-21cc-45e4-b393-3d55d4acf818 req-592c0e4d-c7f0-4c93-b965-a91851c09626 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-f4c3696b-581b-4f04-831a-44532362bf1b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-be12aa2a-21cc-45e4-b393-3d55d4acf818 req-592c0e4d-c7f0-4c93-b965-a91851c09626 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-be12aa2a-21cc-45e4-b393-3d55d4acf818 req-592c0e4d-c7f0-4c93-b965-a91851c09626 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-be12aa2a-21cc-45e4-b393-3d55d4acf818 req-592c0e4d-c7f0-4c93-b965-a91851c09626 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-be12aa2a-21cc-45e4-b393-3d55d4acf818 req-592c0e4d-c7f0-4c93-b965-a91851c09626 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-f4c3696b-581b-4f04-831a-44532362bf1b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:47:43 user nova-compute[75083]: WARNING nova.compute.manager [req-be12aa2a-21cc-45e4-b393-3d55d4acf818 req-592c0e4d-c7f0-4c93-b965-a91851c09626 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-f4c3696b-581b-4f04-831a-44532362bf1b for instance with vm_state building and task_state spawning.
Nov 29 05:47:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:44 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:47:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:47:44 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Instance spawned successfully.
Nov 29 05:47:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:47:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:47:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:47:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:47:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:47:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:47:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:47:44 user nova-compute[75083]: INFO nova.compute.manager [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Took 17.64 seconds to spawn the instance on the hypervisor.
Nov 29 05:47:44 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:47:44 user nova-compute[75083]: INFO nova.compute.manager [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Took 45.92 seconds to build instance.
Nov 29 05:47:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ad70170d-e308-4f8b-9e55-11e5f4e5a293 tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.033s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:52 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:47:52 user nova-compute[75083]: DEBUG nova.compute.manager [req-02cd8cd5-8d98-4b58-8d63-5f3edac59d6b req-addfe270-253a-4d4d-bce1-966cd413e992 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received event network-changed-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:52 user nova-compute[75083]: DEBUG nova.compute.manager [req-02cd8cd5-8d98-4b58-8d63-5f3edac59d6b req-addfe270-253a-4d4d-bce1-966cd413e992 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Refreshing instance network info cache due to event network-changed-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:47:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-02cd8cd5-8d98-4b58-8d63-5f3edac59d6b req-addfe270-253a-4d4d-bce1-966cd413e992 service nova] Acquiring lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:47:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-02cd8cd5-8d98-4b58-8d63-5f3edac59d6b req-addfe270-253a-4d4d-bce1-966cd413e992 service nova] Acquired lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:47:52 user nova-compute[75083]: DEBUG nova.network.neutron [req-02cd8cd5-8d98-4b58-8d63-5f3edac59d6b req-addfe270-253a-4d4d-bce1-966cd413e992 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Refreshing network info cache for port 1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:47:53 user nova-compute[75083]: DEBUG nova.network.neutron [req-02cd8cd5-8d98-4b58-8d63-5f3edac59d6b req-addfe270-253a-4d4d-bce1-966cd413e992 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Updated VIF entry in instance network info cache for port 1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:47:53 user nova-compute[75083]: DEBUG nova.network.neutron [req-02cd8cd5-8d98-4b58-8d63-5f3edac59d6b req-addfe270-253a-4d4d-bce1-966cd413e992 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Updating instance_info_cache with network_info: [{"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:47:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-02cd8cd5-8d98-4b58-8d63-5f3edac59d6b req-addfe270-253a-4d4d-bce1-966cd413e992 service nova] Releasing lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:47:53 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:47:53 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:47:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:53 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 05:47:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:47:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:47:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:47:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:47:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:47:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:47:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:47:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Acquiring lock "303f0c67-e197-4d49-b131-8c99d50d7fe1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "303f0c67-e197-4d49-b131-8c99d50d7fe1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:57 user nova-compute[75083]: DEBUG nova.objects.instance [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lazy-loading 'flavor' on Instance uuid 303f0c67-e197-4d49-b131-8c99d50d7fe1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:47:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "303f0c67-e197-4d49-b131-8c99d50d7fe1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-eb9569b5-03c7-40d0-8e31-422b6cf749c3 req-ea8320df-90bc-4e69-98d2-4a6686c0ade7 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received event network-changed-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:47:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-eb9569b5-03c7-40d0-8e31-422b6cf749c3 req-ea8320df-90bc-4e69-98d2-4a6686c0ade7 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Refreshing instance network info cache due to event network-changed-b4ddf4bb-5def-4760-8d1b-f020942dedf8. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:47:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-eb9569b5-03c7-40d0-8e31-422b6cf749c3 req-ea8320df-90bc-4e69-98d2-4a6686c0ade7 service nova] Acquiring lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:47:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-eb9569b5-03c7-40d0-8e31-422b6cf749c3 req-ea8320df-90bc-4e69-98d2-4a6686c0ade7 service nova] Acquired lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:47:57 user nova-compute[75083]: DEBUG nova.network.neutron [req-eb9569b5-03c7-40d0-8e31-422b6cf749c3 req-ea8320df-90bc-4e69-98d2-4a6686c0ade7 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Refreshing network info cache for port b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Acquiring lock "303f0c67-e197-4d49-b131-8c99d50d7fe1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "303f0c67-e197-4d49-b131-8c99d50d7fe1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:58 user nova-compute[75083]: INFO nova.compute.manager [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Attaching volume ae41e1f1-d9a2-4fef-a1e1-421abc811b39 to /dev/vdb
Nov 29 05:47:58 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:47:58 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:47:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=6934MB free_disk=25.512290954589844GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG os_brick.utils [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adfe5ba-a325-49f6-8e27-9cb850895269]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance e6d49806-cecd-473a-b92f-9255868d35c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 303f0c67-e197-4d49-b131-8c99d50d7fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance ee1bba24-17d0-4fc3-8bff-1337d86cc9be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 47437526-c4e4-4a15-ba9b-51bbae17c77b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 161c6455-90ce-4c40-a33e-7f582989135d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 0414bda1-7b04-40ba-a693-44be9296e432 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance ae18699b-d0cf-44b5-8467-a112fd154580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b2f88b2e-0244-4e18-98ae-21861b02db3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 12989829-1b4c-4aaf-ad24-b30488c4e472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 0f45ac21-017c-4247-b2ae-756ae1c12911 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance e8fe9965-822d-4058-a031-e71b5fb03db4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.101s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dad9f07-c1dd-44c1-aac2-9abfe8901dba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf38b675-a22c-4c20-a2db-b2ccae4bb21a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cbc4a9-d7f4-46bc-b594-14f2d0f040df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:47:58 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:47:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2759b1b-e64f-43d5-a37a-8863c3c73adf]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG os_brick.utils [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] <== get_connector_properties: return (258ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Updating existing volume attachment record: 87e37f65-681e-4dd6-b6ff-5c1a8928b594 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:47:58 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:47:59 user nova-compute[75083]: DEBUG nova.network.neutron [req-eb9569b5-03c7-40d0-8e31-422b6cf749c3 req-ea8320df-90bc-4e69-98d2-4a6686c0ade7 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Updated VIF entry in instance network info cache for port b4ddf4bb-5def-4760-8d1b-f020942dedf8. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:47:59 user nova-compute[75083]: DEBUG nova.network.neutron [req-eb9569b5-03c7-40d0-8e31-422b6cf749c3 req-ea8320df-90bc-4e69-98d2-4a6686c0ade7 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Updating instance_info_cache with network_info: [{"id": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "address": "fa:16:3e:76:b7:47", "network": {"id": "0e6492fc-5e8d-4df7-8fac-2da472312c4d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d625d0d60faf4a4f9073df250039f58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ddf4bb-5d", "ovs_interfaceid": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:47:59 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:47:59 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 05:47:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.715s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:47:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-eb9569b5-03c7-40d0-8e31-422b6cf749c3 req-ea8320df-90bc-4e69-98d2-4a6686c0ade7 service nova] Releasing lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:47:59 user nova-compute[75083]: INFO nova.compute.manager [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] instance snapshotting
Nov 29 05:47:59 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Beginning live snapshot process
Nov 29 05:47:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json -f qcow2 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:47:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json -f qcow2" returned: 0 in 0.205s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:47:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json -f qcow2 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:48:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:48:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:48:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 05:48:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.451s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxbgj4n9v/2acdfeb542ea4175b1404fb6c98fe81e.delta 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-303f0c67-e197-4d49-b131-8c99d50d7fe1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:48:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-303f0c67-e197-4d49-b131-8c99d50d7fe1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:48:00 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 05:48:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "e6d49806-cecd-473a-b92f-9255868d35c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:00 user nova-compute[75083]: DEBUG nova.objects.instance [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'flavor' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "e6d49806-cecd-473a-b92f-9255868d35c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.143s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxbgj4n9v/2acdfeb542ea4175b1404fb6c98fe81e.delta 1073741824" returned: 0 in 0.207s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:00 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 05:48:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75083) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 29 05:48:00 user nova-compute[75083]: INFO nova.virt.libvirt.host [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] UEFI support detected
Nov 29 05:48:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "e6d49806-cecd-473a-b92f-9255868d35c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:00 user nova-compute[75083]: INFO nova.compute.manager [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Attaching volume e200b1ae-3a3c-42f0-af89-b218ba46537e to /dev/vdb
Nov 29 05:48:01 user nova-compute[75083]: DEBUG os_brick.utils [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[06409e16-ad62-440c-a4ff-8b2ccae4c8a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d913093c-83da-4f4e-90f7-0080a3d3b870]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3693bf3-e09d-46d2-8ceb-d3058f35de2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e2bbcf-24ec-4b97-8851-069ee5bf8edd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Updating instance_info_cache with network_info: [{"id": "344d545f-7d42-4750-ae3d-30a3ad813148", "address": "fa:16:3e:81:bd:94", "network": {"id": "a9af19ff-0d4a-44f2-bf46-87edaef88f2d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1807000996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e318e045fa44629111941384871983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344d545f-7d", "ovs_interfaceid": "344d545f-7d42-4750-ae3d-30a3ad813148", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:48:01 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:48:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f689844c-0a9c-4cb9-906a-8bca5066e974]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG os_brick.utils [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Updating existing volume attachment record: 7ce2fae9-626b-4495-80e4-8b415ad2a295 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-303f0c67-e197-4d49-b131-8c99d50d7fe1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:48:01 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 05:48:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:48:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] COPY block job progress, current cursor: 8388608 final cursor: 75497472 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:48:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] COPY block job progress, current cursor: 13697024 final cursor: 75628544 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:48:03 user nova-compute[75083]: DEBUG nova.compute.manager [req-e6699329-025f-4311-a768-d2020f8cd680 req-2c9cd00a-26bd-4fd3-bb8f-d351fa2777f4 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received event network-changed-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:03 user nova-compute[75083]: DEBUG nova.compute.manager [req-e6699329-025f-4311-a768-d2020f8cd680 req-2c9cd00a-26bd-4fd3-bb8f-d351fa2777f4 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Refreshing instance network info cache due to event network-changed-8c103582-6856-45ff-ac2b-7a30d3138c75. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:48:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e6699329-025f-4311-a768-d2020f8cd680 req-2c9cd00a-26bd-4fd3-bb8f-d351fa2777f4 service nova] Acquiring lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:48:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e6699329-025f-4311-a768-d2020f8cd680 req-2c9cd00a-26bd-4fd3-bb8f-d351fa2777f4 service nova] Acquired lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:48:03 user nova-compute[75083]: DEBUG nova.network.neutron [req-e6699329-025f-4311-a768-d2020f8cd680 req-2c9cd00a-26bd-4fd3-bb8f-d351fa2777f4 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Refreshing network info cache for port 8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:48:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] COPY block job progress, current cursor: 75628544 final cursor: 75628544 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:48:03 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 05:48:04 user nova-compute[75083]: DEBUG nova.network.neutron [req-e6699329-025f-4311-a768-d2020f8cd680 req-2c9cd00a-26bd-4fd3-bb8f-d351fa2777f4 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Updated VIF entry in instance network info cache for port 8c103582-6856-45ff-ac2b-7a30d3138c75. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:48:04 user nova-compute[75083]: DEBUG nova.network.neutron [req-e6699329-025f-4311-a768-d2020f8cd680 req-2c9cd00a-26bd-4fd3-bb8f-d351fa2777f4 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Updating instance_info_cache with network_info: [{"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:48:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e6699329-025f-4311-a768-d2020f8cd680 req-2c9cd00a-26bd-4fd3-bb8f-d351fa2777f4 service nova] Releasing lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:48:04 user nova-compute[75083]: DEBUG nova.privsep.utils [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75083) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 05:48:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxbgj4n9v/2acdfeb542ea4175b1404fb6c98fe81e.delta /opt/stack/data/nova/instances/snapshots/tmpxbgj4n9v/2acdfeb542ea4175b1404fb6c98fe81e {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:05 user nova-compute[75083]: DEBUG nova.compute.manager [req-2a9504b5-9b20-481c-bcdf-51fc2c64944b req-fada9938-941d-43a0-af10-f280bb6ef8ec service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Received event network-changed-188d4866-21b0-4a1e-a17a-c0c82e849726 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:05 user nova-compute[75083]: DEBUG nova.compute.manager [req-2a9504b5-9b20-481c-bcdf-51fc2c64944b req-fada9938-941d-43a0-af10-f280bb6ef8ec service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Refreshing instance network info cache due to event network-changed-188d4866-21b0-4a1e-a17a-c0c82e849726. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:48:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2a9504b5-9b20-481c-bcdf-51fc2c64944b req-fada9938-941d-43a0-af10-f280bb6ef8ec service nova] Acquiring lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:48:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2a9504b5-9b20-481c-bcdf-51fc2c64944b req-fada9938-941d-43a0-af10-f280bb6ef8ec service nova] Acquired lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:48:05 user nova-compute[75083]: DEBUG nova.network.neutron [req-2a9504b5-9b20-481c-bcdf-51fc2c64944b req-fada9938-941d-43a0-af10-f280bb6ef8ec service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Refreshing network info cache for port 188d4866-21b0-4a1e-a17a-c0c82e849726 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:48:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxbgj4n9v/2acdfeb542ea4175b1404fb6c98fe81e.delta /opt/stack/data/nova/instances/snapshots/tmpxbgj4n9v/2acdfeb542ea4175b1404fb6c98fe81e" returned: 0 in 1.411s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:05 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Snapshot extracted, beginning image upload
Nov 29 05:48:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:06 user nova-compute[75083]: DEBUG nova.network.neutron [req-2a9504b5-9b20-481c-bcdf-51fc2c64944b req-fada9938-941d-43a0-af10-f280bb6ef8ec service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Updated VIF entry in instance network info cache for port 188d4866-21b0-4a1e-a17a-c0c82e849726. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:48:06 user nova-compute[75083]: DEBUG nova.network.neutron [req-2a9504b5-9b20-481c-bcdf-51fc2c64944b req-fada9938-941d-43a0-af10-f280bb6ef8ec service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Updating instance_info_cache with network_info: [{"id": "188d4866-21b0-4a1e-a17a-c0c82e849726", "address": "fa:16:3e:a8:14:4a", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d4866-21", "ovs_interfaceid": "188d4866-21b0-4a1e-a17a-c0c82e849726", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:48:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2a9504b5-9b20-481c-bcdf-51fc2c64944b req-fada9938-941d-43a0-af10-f280bb6ef8ec service nova] Releasing lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:48:08 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Snapshot image upload complete
Nov 29 05:48:08 user nova-compute[75083]: INFO nova.compute.manager [None req-f4d9fc0b-3896-42b6-9861-f20b28abf318 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Took 9.64 seconds to snapshot the instance on the hypervisor.
Nov 29 05:48:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "47437526-c4e4-4a15-ba9b-51bbae17c77b" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:09 user nova-compute[75083]: INFO nova.compute.manager [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Shelving
Nov 29 05:48:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:09 user nova-compute[75083]: DEBUG nova.compute.manager [req-88d9dcec-b4a7-48d0-946a-2da6ae48ffe2 req-8f9c860e-5b73-490d-9eb9-e69c20631b87 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received event network-vif-unplugged-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-88d9dcec-b4a7-48d0-946a-2da6ae48ffe2 req-8f9c860e-5b73-490d-9eb9-e69c20631b87 service nova] Acquiring lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-88d9dcec-b4a7-48d0-946a-2da6ae48ffe2 req-8f9c860e-5b73-490d-9eb9-e69c20631b87 service nova] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-88d9dcec-b4a7-48d0-946a-2da6ae48ffe2 req-8f9c860e-5b73-490d-9eb9-e69c20631b87 service nova] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:09 user nova-compute[75083]: DEBUG nova.compute.manager [req-88d9dcec-b4a7-48d0-946a-2da6ae48ffe2 req-8f9c860e-5b73-490d-9eb9-e69c20631b87 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] No waiting events found dispatching network-vif-unplugged-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:09 user nova-compute[75083]: WARNING nova.compute.manager [req-88d9dcec-b4a7-48d0-946a-2da6ae48ffe2 req-8f9c860e-5b73-490d-9eb9-e69c20631b87 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received unexpected event network-vif-unplugged-8c103582-6856-45ff-ac2b-7a30d3138c75 for instance with vm_state active and task_state shelving.
Nov 29 05:48:09 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Instance destroyed successfully.
Nov 29 05:48:10 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Beginning cold snapshot process
Nov 29 05:48:10 user nova-compute[75083]: DEBUG nova.privsep.utils [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75083) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 05:48:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk /opt/stack/data/nova/instances/snapshots/tmpp8lkw7tc/84adb9b43ac544159e3740d0e4f344c2 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk /opt/stack/data/nova/instances/snapshots/tmpp8lkw7tc/84adb9b43ac544159e3740d0e4f344c2" returned: 0 in 0.791s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:11 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Snapshot extracted, beginning image upload
Nov 29 05:48:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:11 user nova-compute[75083]: DEBUG nova.compute.manager [req-01c9b701-630e-4ad8-bac4-c362810b06e6 req-253c0da8-eaf3-4b9e-a7b7-6599e21ae1f6 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received event network-vif-plugged-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-01c9b701-630e-4ad8-bac4-c362810b06e6 req-253c0da8-eaf3-4b9e-a7b7-6599e21ae1f6 service nova] Acquiring lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-01c9b701-630e-4ad8-bac4-c362810b06e6 req-253c0da8-eaf3-4b9e-a7b7-6599e21ae1f6 service nova] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-01c9b701-630e-4ad8-bac4-c362810b06e6 req-253c0da8-eaf3-4b9e-a7b7-6599e21ae1f6 service nova] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:11 user nova-compute[75083]: DEBUG nova.compute.manager [req-01c9b701-630e-4ad8-bac4-c362810b06e6 req-253c0da8-eaf3-4b9e-a7b7-6599e21ae1f6 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] No waiting events found dispatching network-vif-plugged-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:11 user nova-compute[75083]: WARNING nova.compute.manager [req-01c9b701-630e-4ad8-bac4-c362810b06e6 req-253c0da8-eaf3-4b9e-a7b7-6599e21ae1f6 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received unexpected event network-vif-plugged-8c103582-6856-45ff-ac2b-7a30d3138c75 for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 05:48:13 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Snapshot image upload complete
Nov 29 05:48:13 user nova-compute[75083]: DEBUG nova.compute.manager [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:48:13 user nova-compute[75083]: INFO nova.compute.manager [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Shelve offloading
Nov 29 05:48:13 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Instance destroyed successfully.
Nov 29 05:48:13 user nova-compute[75083]: DEBUG nova.compute.manager [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:48:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:48:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquired lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:48:13 user nova-compute[75083]: DEBUG nova.network.neutron [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:48:14 user nova-compute[75083]: DEBUG nova.network.neutron [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Updating instance_info_cache with network_info: [{"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:48:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Releasing lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:48:14 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Instance destroyed successfully.
Nov 29 05:48:14 user nova-compute[75083]: DEBUG nova.objects.instance [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'resources' on Instance uuid 47437526-c4e4-4a15-ba9b-51bbae17c77b {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-265924046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-265924046',id=4,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9NfR5g6BHWgn8iHt68HXMvMqojnsSO+GsTi9O2T9R8+QSKnFuCWKp/x2ygTv5FkO6YZWsNIF2DV0Sb3TLFZytdS0uwbMQGN94Yb7Idf4fw6TKFh/TgmCvwWzSqCHn5Tw==',key_name='tempest-keypair-1939493904',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d1c63c54083f4a0eba38539e7c196d61',ramdisk_id='',reservation_id='r-1epz6053',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-961204558',owner_user_name='tempest-AttachVolumeShelveTestJSON-961204558-project-member',shelved_at='2023-11-29T05:48:13.798770',shelved_host='user',shelved_image_id='d5b7e520-b0c0-4cfd-b004-0b56e2b9895a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:48:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4e6b7adfb1b469ab5c6c3f26633272a',uuid=47437526-c4e4-4a15-ba9b-51bbae17c77b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:48:14 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converting VIF {"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:48:14 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:74:88,bridge_name='br-int',has_traffic_filtering=True,id=8c103582-6856-45ff-ac2b-7a30d3138c75,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c103582-68') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:48:14 user nova-compute[75083]: DEBUG os_vif [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:74:88,bridge_name='br-int',has_traffic_filtering=True,id=8c103582-6856-45ff-ac2b-7a30d3138c75,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c103582-68') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:48:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c103582-68, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:14 user nova-compute[75083]: DEBUG nova.compute.manager [req-b9679b63-a13c-4514-84e8-5304d9b35994 req-c3baa9fb-9f74-44c6-b15d-cad61df4f130 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received event network-changed-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:14 user nova-compute[75083]: DEBUG nova.compute.manager [req-b9679b63-a13c-4514-84e8-5304d9b35994 req-c3baa9fb-9f74-44c6-b15d-cad61df4f130 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Refreshing instance network info cache due to event network-changed-8c103582-6856-45ff-ac2b-7a30d3138c75. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:48:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b9679b63-a13c-4514-84e8-5304d9b35994 req-c3baa9fb-9f74-44c6-b15d-cad61df4f130 service nova] Acquiring lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:48:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b9679b63-a13c-4514-84e8-5304d9b35994 req-c3baa9fb-9f74-44c6-b15d-cad61df4f130 service nova] Acquired lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:48:14 user nova-compute[75083]: DEBUG nova.network.neutron [req-b9679b63-a13c-4514-84e8-5304d9b35994 req-c3baa9fb-9f74-44c6-b15d-cad61df4f130 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Refreshing network info cache for port 8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:48:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=273eb747-7af6-46fd-9c57-621599b54ef3) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:14 user nova-compute[75083]: INFO os_vif [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:74:88,bridge_name='br-int',has_traffic_filtering=True,id=8c103582-6856-45ff-ac2b-7a30d3138c75,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c103582-68')
Nov 29 05:48:14 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Deleting instance files /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b_del
Nov 29 05:48:14 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Deletion of /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b_del complete
Nov 29 05:48:15 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Deleted allocations for instance 47437526-c4e4-4a15-ba9b-51bbae17c77b
Nov 29 05:48:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:15 user nova-compute[75083]: DEBUG nova.objects.instance [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'numa_topology' on Instance uuid 47437526-c4e4-4a15-ba9b-51bbae17c77b {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:15 user nova-compute[75083]: DEBUG nova.objects.base [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Object Instance<47437526-c4e4-4a15-ba9b-51bbae17c77b> lazy-loaded attributes: resources,numa_topology {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:48:15 user nova-compute[75083]: DEBUG nova.network.neutron [req-b9679b63-a13c-4514-84e8-5304d9b35994 req-c3baa9fb-9f74-44c6-b15d-cad61df4f130 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Updated VIF entry in instance network info cache for port 8c103582-6856-45ff-ac2b-7a30d3138c75. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:48:15 user nova-compute[75083]: DEBUG nova.network.neutron [req-b9679b63-a13c-4514-84e8-5304d9b35994 req-c3baa9fb-9f74-44c6-b15d-cad61df4f130 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Updating instance_info_cache with network_info: [{"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8c103582-68", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:48:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b9679b63-a13c-4514-84e8-5304d9b35994 req-c3baa9fb-9f74-44c6-b15d-cad61df4f130 service nova] Releasing lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:48:15 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:48:15 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:48:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-80871dd6-c3e2-4556-ab10-fb4b9b29ce5e tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.372s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTvsjtVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:17 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:17 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:17 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e2b87c-90ed-4453-ba2e-9cba819727da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:48:17 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBfoehTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:17 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b990138-725c-4d71-959d-d891cc62a587]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39] added
Nov 29 05:48:17 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e094b948-c0a7-4f37-8553-450a88ab967c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[207bfd85-03b0-4591-abb0-71ed630329d3]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pTvsjtVS {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pTvsjtVS" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8dea3c-945b-49d2-b9a3-cbe1538f2c49]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pTvsjtVS'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[109854e8-c6f4-499c-9e3d-3727c15c5f30]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad004569-7c4a-4d66-b76c-9f95f024fc14]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:17 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:17 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf84d889-ae75-41a0-ac57-14383e6c9c18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39, portal: 172.16.0.220,3260]
Nov 29 05:48:17 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39, portal: 172.16.0.220,3260] successful.
Nov 29 05:48:17 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[58044743-4afe-4552-9e6c-e3df79e63bc1]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30598d3-c249-4bc8-9bd1-c936fb955134]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 (non-flash)
Nov 29 05:48:17 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:17 user nova-compute[75083]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 (non-flash)
Nov 29 05:48:17 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f08475d-16dd-4fba-a58d-c5353ef75106]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:48:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTvsjtVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:48:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-f2c39278-f4e6-4dca-a7c0-8f858d26fb1b req-060cd564-33df-4938-921a-6c682cdcd77b service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Received event network-changed-6c418847-5bf6-4315-9acd-c743ce87f36c {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-f2c39278-f4e6-4dca-a7c0-8f858d26fb1b req-060cd564-33df-4938-921a-6c682cdcd77b service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Refreshing instance network info cache due to event network-changed-6c418847-5bf6-4315-9acd-c743ce87f36c. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:48:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f2c39278-f4e6-4dca-a7c0-8f858d26fb1b req-060cd564-33df-4938-921a-6c682cdcd77b service nova] Acquiring lock "refresh_cache-0414bda1-7b04-40ba-a693-44be9296e432" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:48:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f2c39278-f4e6-4dca-a7c0-8f858d26fb1b req-060cd564-33df-4938-921a-6c682cdcd77b service nova] Acquired lock "refresh_cache-0414bda1-7b04-40ba-a693-44be9296e432" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:48:18 user nova-compute[75083]: DEBUG nova.network.neutron [req-f2c39278-f4e6-4dca-a7c0-8f858d26fb1b req-060cd564-33df-4938-921a-6c682cdcd77b service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Refreshing network info cache for port 6c418847-5bf6-4315-9acd-c743ce87f36c {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:48:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26265376536363932', 'path': '/dev/sdh'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265376536363932', 'path': '/dev/sdh'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:48:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.349s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:18 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:18 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:48:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG nova.objects.instance [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lazy-loading 'flavor' on Instance uuid 303f0c67-e197-4d49-b131-8c99d50d7fe1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[36288d83-8cca-47b3-8680-13748a5ed079]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:48:19 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 05:48:19 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:48:19 user nova-compute[75083]:   <source dev="/dev/sdh"/>
Nov 29 05:48:19 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:48:19 user nova-compute[75083]:   <serial>ae41e1f1-d9a2-4fef-a1e1-421abc811b39</serial>
Nov 29 05:48:19 user nova-compute[75083]: </disk>
Nov 29 05:48:19 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18e50d8-6579-46d2-a70f-eac98df59a56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e] added
Nov 29 05:48:19 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1678305a-1b62-452f-acc2-2953c347564a]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b16f735-d15f-4dd2-a772-4ccc7aa1bd4c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KBfoehTa {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KBfoehTa" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29794d8-542a-46d0-843e-9b155168fd51]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KBfoehTa'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG nova.network.neutron [req-f2c39278-f4e6-4dca-a7c0-8f858d26fb1b req-060cd564-33df-4938-921a-6c682cdcd77b service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Updated VIF entry in instance network info cache for port 6c418847-5bf6-4315-9acd-c743ce87f36c. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG nova.network.neutron [req-f2c39278-f4e6-4dca-a7c0-8f858d26fb1b req-060cd564-33df-4938-921a-6c682cdcd77b service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Updating instance_info_cache with network_info: [{"id": "6c418847-5bf6-4315-9acd-c743ce87f36c", "address": "fa:16:3e:1e:c8:98", "network": {"id": "e5e61cc2-ec29-4baa-af6c-216f426467a4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-481090086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "471762377c1f451ab78d898e89ed83e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c418847-5b", "ovs_interfaceid": "6c418847-5bf6-4315-9acd-c743ce87f36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f2c39278-f4e6-4dca-a7c0-8f858d26fb1b req-060cd564-33df-4938-921a-6c682cdcd77b service nova] Releasing lock "refresh_cache-0414bda1-7b04-40ba-a693-44be9296e432" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65e62ec-1f99-4910-b462-0552e04f2d7a]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b32879-cc92-4027-a07c-6c3ba8305b70]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 (non-flash)
Nov 29 05:48:19 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 (non-flash)
Nov 29 05:48:19 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[deae535f-a5ed-4043-9063-e747773bea44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e, portal: 172.16.0.220,3260]
Nov 29 05:48:19 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e, portal: 172.16.0.220,3260] successful.
Nov 29 05:48:19 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4a7480-14b7-4d99-acb9-5a9d8c64a8ff]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a686c0-84e3-4564-8d55-c9d3a4aa40a4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:19 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 (non-flash)
Nov 29 05:48:19 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:19 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51aea3b-1600-4b9d-9586-b858960a48e6]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: None {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] No VIF found with MAC fa:16:3e:81:bd:94, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-99351541-0c91-4d41-87f8-db175816db6a tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "303f0c67-e197-4d49-b131-8c99d50d7fe1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.284s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:20 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:48:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBfoehTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:48:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] <== connect_volume: return (2711ms) {'type': 'block', 'scsi_wwn': '23730613431363365', 'path': '/dev/sdi'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730613431363365', 'path': '/dev/sdi'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:48:20 user nova-compute[75083]: DEBUG nova.objects.instance [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'flavor' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 05:48:20 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:48:20 user nova-compute[75083]:   <source dev="/dev/sdi"/>
Nov 29 05:48:20 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:48:20 user nova-compute[75083]:   <serial>e200b1ae-3a3c-42f0-af89-b218ba46537e</serial>
Nov 29 05:48:20 user nova-compute[75083]: </disk>
Nov 29 05:48:20 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 05:48:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Acquiring lock "303f0c67-e197-4d49-b131-8c99d50d7fe1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "303f0c67-e197-4d49-b131-8c99d50d7fe1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Acquiring lock "303f0c67-e197-4d49-b131-8c99d50d7fe1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "303f0c67-e197-4d49-b131-8c99d50d7fe1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "303f0c67-e197-4d49-b131-8c99d50d7fe1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:20 user nova-compute[75083]: INFO nova.compute.manager [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Terminating instance
Nov 29 05:48:20 user nova-compute[75083]: DEBUG nova.compute.manager [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:48:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:48:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:48:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] No VIF found with MAC fa:16:3e:7a:b6:78, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:48:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4e26d098-0b88-4864-b169-5a40d987f231 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "e6d49806-cecd-473a-b92f-9255868d35c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.114s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG nova.compute.manager [req-d87e3c1b-19d6-4b5d-88b6-b4ebaaef76d4 req-d9392bd7-80ba-452d-8a8b-c372c012aa50 service nova] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Received event network-vif-unplugged-344d545f-7d42-4750-ae3d-30a3ad813148 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d87e3c1b-19d6-4b5d-88b6-b4ebaaef76d4 req-d9392bd7-80ba-452d-8a8b-c372c012aa50 service nova] Acquiring lock "303f0c67-e197-4d49-b131-8c99d50d7fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d87e3c1b-19d6-4b5d-88b6-b4ebaaef76d4 req-d9392bd7-80ba-452d-8a8b-c372c012aa50 service nova] Lock "303f0c67-e197-4d49-b131-8c99d50d7fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d87e3c1b-19d6-4b5d-88b6-b4ebaaef76d4 req-d9392bd7-80ba-452d-8a8b-c372c012aa50 service nova] Lock "303f0c67-e197-4d49-b131-8c99d50d7fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG nova.compute.manager [req-d87e3c1b-19d6-4b5d-88b6-b4ebaaef76d4 req-d9392bd7-80ba-452d-8a8b-c372c012aa50 service nova] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] No waiting events found dispatching network-vif-unplugged-344d545f-7d42-4750-ae3d-30a3ad813148 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG nova.compute.manager [req-d87e3c1b-19d6-4b5d-88b6-b4ebaaef76d4 req-d9392bd7-80ba-452d-8a8b-c372c012aa50 service nova] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Received event network-vif-unplugged-344d545f-7d42-4750-ae3d-30a3ad813148 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Acquiring lock "0414bda1-7b04-40ba-a693-44be9296e432" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "0414bda1-7b04-40ba-a693-44be9296e432" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG nova.objects.instance [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lazy-loading 'flavor' on Instance uuid 0414bda1-7b04-40ba-a693-44be9296e432 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "0414bda1-7b04-40ba-a693-44be9296e432" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Acquiring lock "0414bda1-7b04-40ba-a693-44be9296e432" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "0414bda1-7b04-40ba-a693-44be9296e432" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:21 user nova-compute[75083]: INFO nova.compute.manager [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Attaching volume f1dc8da6-b493-4667-9f50-96f86b0f9193 to /dev/sdc
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.utils [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:21 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Instance destroyed successfully.
Nov 29 05:48:21 user nova-compute[75083]: DEBUG nova.objects.instance [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lazy-loading 'resources' on Instance uuid 303f0c67-e197-4d49-b131-8c99d50d7fe1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[73412b70-8430-40e3-ab59-641d0440d0ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1400391578',display_name='tempest-DeleteServersTestJSON-server-1400391578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1400391578',id=2,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93e318e045fa44629111941384871983',ramdisk_id='',reservation_id='r-yjvg60tb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1212515133',owner_user_name='tempest-DeleteServersTestJSON-1212515133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:46:19Z,user_data=None,user_id='58f6a378692741b0a63926ada864137c',uuid=303f0c67-e197-4d49-b131-8c99d50d7fe1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "344d545f-7d42-4750-ae3d-30a3ad813148", "address": "fa:16:3e:81:bd:94", "network": {"id": "a9af19ff-0d4a-44f2-bf46-87edaef88f2d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1807000996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e318e045fa44629111941384871983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344d545f-7d", "ovs_interfaceid": "344d545f-7d42-4750-ae3d-30a3ad813148", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Converting VIF {"id": "344d545f-7d42-4750-ae3d-30a3ad813148", "address": "fa:16:3e:81:bd:94", "network": {"id": "a9af19ff-0d4a-44f2-bf46-87edaef88f2d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1807000996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e318e045fa44629111941384871983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344d545f-7d", "ovs_interfaceid": "344d545f-7d42-4750-ae3d-30a3ad813148", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:bd:94,bridge_name='br-int',has_traffic_filtering=True,id=344d545f-7d42-4750-ae3d-30a3ad813148,network=Network(a9af19ff-0d4a-44f2-bf46-87edaef88f2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap344d545f-7d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_vif [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:bd:94,bridge_name='br-int',has_traffic_filtering=True,id=344d545f-7d42-4750-ae3d-30a3ad813148,network=Network(a9af19ff-0d4a-44f2-bf46-87edaef88f2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap344d545f-7d') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d014cf8-bbd6-4056-ba0e-855c6e5a7341]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap344d545f-7d, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e09aa9ce-674e-4144-ad24-f5a1cd1f2ad1) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cb00e2-fb28-4730-bc5d-5fcf054f4132]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:21 user nova-compute[75083]: INFO os_vif [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:bd:94,bridge_name='br-int',has_traffic_filtering=True,id=344d545f-7d42-4750-ae3d-30a3ad813148,network=Network(a9af19ff-0d4a-44f2-bf46-87edaef88f2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap344d545f-7d')
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0f82c5-1b5b-4464-9ee2-603e7de783d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTvsjtVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:21 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:48:21 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[19724dce-6387-44e4-a17b-354f7a602afc]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.utils [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Updating existing volume attachment record: 584d01d5-f775-4c51-821c-dd07190bcdd5 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac8b1f1-de92-4d12-b9a1-e778631fee1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:48:21 user nova-compute[75083]: No targets found.
Nov 29 05:48:21 user nova-compute[75083]: iSNS:
Nov 29 05:48:21 user nova-compute[75083]: No targets found.
Nov 29 05:48:21 user nova-compute[75083]: STATIC:
Nov 29 05:48:21 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0
Nov 29 05:48:21 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:21 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:21 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39
Nov 29 05:48:21 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:21 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:21 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3
Nov 29 05:48:21 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:21 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:21 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e
Nov 29 05:48:21 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:21 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:21 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c
Nov 29 05:48:21 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:21 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:21 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a
Nov 29 05:48:21 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:21 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:21 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83
Nov 29 05:48:21 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:21 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:21 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726
Nov 29 05:48:21 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:21 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:21 user nova-compute[75083]: FIRMWARE:
Nov 29 05:48:21 user nova-compute[75083]: No targets found.
Nov 29 05:48:21 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:48:21 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:48:21 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbf6064-0172-4412-b196-879bbcd20eef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f7c3d5-31b0-4ae7-9f58-15f7c1c87917]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:21 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:21 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:21 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:21 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:21 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:21 user nova-compute[75083]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 (non-flash)
Nov 29 05:48:21 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:21 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:21 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:21 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:21 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:21 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:21 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:21 user nova-compute[75083]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 (non-flash)
Nov 29 05:48:21 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:21 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0dc9b9f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39'): ({'sdh'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Removing single pathed devices sdh {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18cbf3c-4dd9-4f6d-ad54-9fbb4c99a19e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-eda2a654-868d-48d2-80eb-5e055be48a68 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-eda2a654-868d-48d2-80eb-5e055be48a68 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "e6d49806-cecd-473a-b92f-9255868d35c7" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG nova.compute.manager [None req-eda2a654-868d-48d2-80eb-5e055be48a68 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG nova.compute.manager [None req-eda2a654-868d-48d2-80eb-5e055be48a68 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75083) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG nova.objects.instance [None req-eda2a654-868d-48d2-80eb-5e055be48a68 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'flavor' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b45a3b-45fc-4770-8dca-88cb64580ce2]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Flushing IO for device /dev/sdh {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee8dddd-ad50-4f97-80d2-58325e7eccf5]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[98164010-1d5c-4610-ab50-547f72dd5cf4]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] SCSI volumes sdh have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3714a4cd-df10-4eed-9c3c-3bf0a167cfdb]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:22 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a163eea-3ee3-4650-bdad-1efab66e9b60]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39, portal: 172.16.0.220,3260]
Nov 29 05:48:22 user nova-compute[75083]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39, portal: 172.16.0.220,3260] successful.
Nov 29 05:48:22 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae41e1f1-d9a2-4fef-a1e1-421abc811b39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:22 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6359f27-b6bf-4885-a0fa-833d3121fede]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] <== disconnect_volume: return (398ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:48:22 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Deleting instance files /opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1_del
Nov 29 05:48:22 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Deletion of /opt/stack/data/nova/instances/303f0c67-e197-4d49-b131-8c99d50d7fe1_del complete
Nov 29 05:48:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:22 user nova-compute[75083]: INFO nova.compute.manager [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Took 1.42 seconds to destroy the instance on the hypervisor.
Nov 29 05:48:22 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 05:48:22 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 05:48:22 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 05:48:22 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Instance destroyed successfully.
Nov 29 05:48:22 user nova-compute[75083]: DEBUG nova.compute.manager [None req-eda2a654-868d-48d2-80eb-5e055be48a68 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:48:22 user nova-compute[75083]: DEBUG nova.compute.manager [req-9f1b612e-fd1d-4c0c-8ec3-142e0c9a62e3 req-a7a6c623-da5b-40f1-b877-1ee85e4218d8 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received event network-vif-unplugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9f1b612e-fd1d-4c0c-8ec3-142e0c9a62e3 req-a7a6c623-da5b-40f1-b877-1ee85e4218d8 service nova] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9f1b612e-fd1d-4c0c-8ec3-142e0c9a62e3 req-a7a6c623-da5b-40f1-b877-1ee85e4218d8 service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9f1b612e-fd1d-4c0c-8ec3-142e0c9a62e3 req-a7a6c623-da5b-40f1-b877-1ee85e4218d8 service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:22 user nova-compute[75083]: DEBUG nova.compute.manager [req-9f1b612e-fd1d-4c0c-8ec3-142e0c9a62e3 req-a7a6c623-da5b-40f1-b877-1ee85e4218d8 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] No waiting events found dispatching network-vif-unplugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:22 user nova-compute[75083]: WARNING nova.compute.manager [req-9f1b612e-fd1d-4c0c-8ec3-142e0c9a62e3 req-a7a6c623-da5b-40f1-b877-1ee85e4218d8 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received unexpected event network-vif-unplugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 for instance with vm_state active and task_state powering-off.
Nov 29 05:48:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-eda2a654-868d-48d2-80eb-5e055be48a68 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "e6d49806-cecd-473a-b92f-9255868d35c7" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.935s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-0ba9f867-f275-44fb-966f-5c43e9a5289f req-17e7a91a-6bb9-4f13-9499-35354d90af54 service nova] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Received event network-vif-plugged-344d545f-7d42-4750-ae3d-30a3ad813148 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0ba9f867-f275-44fb-966f-5c43e9a5289f req-17e7a91a-6bb9-4f13-9499-35354d90af54 service nova] Acquiring lock "303f0c67-e197-4d49-b131-8c99d50d7fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0ba9f867-f275-44fb-966f-5c43e9a5289f req-17e7a91a-6bb9-4f13-9499-35354d90af54 service nova] Lock "303f0c67-e197-4d49-b131-8c99d50d7fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0ba9f867-f275-44fb-966f-5c43e9a5289f req-17e7a91a-6bb9-4f13-9499-35354d90af54 service nova] Lock "303f0c67-e197-4d49-b131-8c99d50d7fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-0ba9f867-f275-44fb-966f-5c43e9a5289f req-17e7a91a-6bb9-4f13-9499-35354d90af54 service nova] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] No waiting events found dispatching network-vif-plugged-344d545f-7d42-4750-ae3d-30a3ad813148 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:23 user nova-compute[75083]: WARNING nova.compute.manager [req-0ba9f867-f275-44fb-966f-5c43e9a5289f req-17e7a91a-6bb9-4f13-9499-35354d90af54 service nova] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Received unexpected event network-vif-plugged-344d545f-7d42-4750-ae3d-30a3ad813148 for instance with vm_state active and task_state deleting.
Nov 29 05:48:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-0ba9f867-f275-44fb-966f-5c43e9a5289f req-17e7a91a-6bb9-4f13-9499-35354d90af54 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Received event network-changed-576fd898-62e6-4bf7-a914-6b94081176b1 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-0ba9f867-f275-44fb-966f-5c43e9a5289f req-17e7a91a-6bb9-4f13-9499-35354d90af54 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Refreshing instance network info cache due to event network-changed-576fd898-62e6-4bf7-a914-6b94081176b1. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0ba9f867-f275-44fb-966f-5c43e9a5289f req-17e7a91a-6bb9-4f13-9499-35354d90af54 service nova] Acquiring lock "refresh_cache-ae18699b-d0cf-44b5-8467-a112fd154580" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0ba9f867-f275-44fb-966f-5c43e9a5289f req-17e7a91a-6bb9-4f13-9499-35354d90af54 service nova] Acquired lock "refresh_cache-ae18699b-d0cf-44b5-8467-a112fd154580" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG nova.network.neutron [req-0ba9f867-f275-44fb-966f-5c43e9a5289f req-17e7a91a-6bb9-4f13-9499-35354d90af54 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Refreshing network info cache for port 576fd898-62e6-4bf7-a914-6b94081176b1 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Acquiring lock "ae18699b-d0cf-44b5-8467-a112fd154580" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "ae18699b-d0cf-44b5-8467-a112fd154580" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG nova.objects.instance [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lazy-loading 'flavor' on Instance uuid ae18699b-d0cf-44b5-8467-a112fd154580 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "ae18699b-d0cf-44b5-8467-a112fd154580" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Acquiring lock "ae18699b-d0cf-44b5-8467-a112fd154580" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "ae18699b-d0cf-44b5-8467-a112fd154580" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:23 user nova-compute[75083]: INFO nova.compute.manager [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Attaching volume 74982c7f-1ac4-4d4f-b76c-521e310f1780 to /dev/vdb
Nov 29 05:48:23 user nova-compute[75083]: DEBUG os_brick.utils [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7685354-4e33-40d2-afd7-b47842675494]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ac1f01-6b3d-4d2b-b8a2-610a90fda2d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG nova.network.neutron [req-0ba9f867-f275-44fb-966f-5c43e9a5289f req-17e7a91a-6bb9-4f13-9499-35354d90af54 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Updated VIF entry in instance network info cache for port 576fd898-62e6-4bf7-a914-6b94081176b1. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG nova.network.neutron [req-0ba9f867-f275-44fb-966f-5c43e9a5289f req-17e7a91a-6bb9-4f13-9499-35354d90af54 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Updating instance_info_cache with network_info: [{"id": "576fd898-62e6-4bf7-a914-6b94081176b1", "address": "fa:16:3e:4f:5a:84", "network": {"id": "e98dee6b-18b4-41c2-af52-23b9bead051d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-91142156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7f2ae08bd241fcaa60e97d864545f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576fd898-62", "ovs_interfaceid": "576fd898-62e6-4bf7-a914-6b94081176b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0ba9f867-f275-44fb-966f-5c43e9a5289f req-17e7a91a-6bb9-4f13-9499-35354d90af54 service nova] Releasing lock "refresh_cache-ae18699b-d0cf-44b5-8467-a112fd154580" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee4cb2e-07e1-4f5b-bd14-df31bb4c154f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7219b35d-bc1f-4f48-8afb-d4646c80bfdb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:48:23 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:48:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bceac9-67fe-4e96-a198-8835c72b439f]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG os_brick.utils [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Updating existing volume attachment record: e4826b9d-40e1-4035-8130-cb48a706fbe9 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:48:23 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:48:23 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Took 1.67 seconds to deallocate network for instance.
Nov 29 05:48:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-af3725a8-19bc-4ed1-b0c6-9a76d0d4c256 req-4e25446b-15da-40d3-976a-87a12d294183 service nova] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Received event network-vif-deleted-344d545f-7d42-4750-ae3d-30a3ad813148 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquiring lock "interface-b2f88b2e-0244-4e18-98ae-21861b02db3a-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "interface-b2f88b2e-0244-4e18-98ae-21861b02db3a-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:24 user nova-compute[75083]: DEBUG nova.objects.instance [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lazy-loading 'flavor' on Instance uuid b2f88b2e-0244-4e18-98ae-21861b02db3a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:24 user nova-compute[75083]: INFO nova.compute.manager [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] [instance: 303f0c67-e197-4d49-b131-8c99d50d7fe1] Took 0.89 seconds to detach 1 volumes for instance.
Nov 29 05:48:24 user nova-compute[75083]: DEBUG nova.compute.manager [req-e90a60b4-99a6-400c-b011-d473a2786f4f req-d7a1bc78-1d87-4043-b3a0-1719ba8eb6bd service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e90a60b4-99a6-400c-b011-d473a2786f4f req-d7a1bc78-1d87-4043-b3a0-1719ba8eb6bd service nova] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e90a60b4-99a6-400c-b011-d473a2786f4f req-d7a1bc78-1d87-4043-b3a0-1719ba8eb6bd service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e90a60b4-99a6-400c-b011-d473a2786f4f req-d7a1bc78-1d87-4043-b3a0-1719ba8eb6bd service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:24 user nova-compute[75083]: DEBUG nova.compute.manager [req-e90a60b4-99a6-400c-b011-d473a2786f4f req-d7a1bc78-1d87-4043-b3a0-1719ba8eb6bd service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] No waiting events found dispatching network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:24 user nova-compute[75083]: WARNING nova.compute.manager [req-e90a60b4-99a6-400c-b011-d473a2786f4f req-d7a1bc78-1d87-4043-b3a0-1719ba8eb6bd service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received unexpected event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 for instance with vm_state stopped and task_state None.
Nov 29 05:48:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:24 user nova-compute[75083]: DEBUG nova.objects.instance [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lazy-loading 'pci_requests' on Instance uuid b2f88b2e-0244-4e18-98ae-21861b02db3a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:24 user nova-compute[75083]: DEBUG nova.objects.base [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Object Instance<b2f88b2e-0244-4e18-98ae-21861b02db3a> lazy-loaded attributes: flavor,pci_requests {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:48:24 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:48:25 user nova-compute[75083]: DEBUG nova.policy [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c746113481e4d179fba6e77efcee7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916664e2bf04c018daedae140735f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:48:25 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:48:25 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:48:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:25 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Deleted allocations for instance 303f0c67-e197-4d49-b131-8c99d50d7fe1
Nov 29 05:48:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5169e7bf-27cb-4125-b16e-45fc87f2c021 tempest-DeleteServersTestJSON-1212515133 tempest-DeleteServersTestJSON-1212515133-project-member] Lock "303f0c67-e197-4d49-b131-8c99d50d7fe1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.719s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:25 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Successfully created port: 90ffff8c-4211-4ef0-b043-f632e883962b {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:48:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-e47fda46-32d5-41f3-84b5-2d8632b1d8c7 req-602e6b06-ebe7-4c06-9aaa-55e195536992 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received event network-changed-9ac8517e-5bf8-41ec-839e-40dcffd8a7ac {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-e47fda46-32d5-41f3-84b5-2d8632b1d8c7 req-602e6b06-ebe7-4c06-9aaa-55e195536992 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Refreshing instance network info cache due to event network-changed-9ac8517e-5bf8-41ec-839e-40dcffd8a7ac. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:48:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e47fda46-32d5-41f3-84b5-2d8632b1d8c7 req-602e6b06-ebe7-4c06-9aaa-55e195536992 service nova] Acquiring lock "refresh_cache-b2f88b2e-0244-4e18-98ae-21861b02db3a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:48:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e47fda46-32d5-41f3-84b5-2d8632b1d8c7 req-602e6b06-ebe7-4c06-9aaa-55e195536992 service nova] Acquired lock "refresh_cache-b2f88b2e-0244-4e18-98ae-21861b02db3a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:48:26 user nova-compute[75083]: DEBUG nova.network.neutron [req-e47fda46-32d5-41f3-84b5-2d8632b1d8c7 req-602e6b06-ebe7-4c06-9aaa-55e195536992 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Refreshing network info cache for port 9ac8517e-5bf8-41ec-839e-40dcffd8a7ac {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:48:26 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Successfully updated port: 90ffff8c-4211-4ef0-b043-f632e883962b {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:48:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquiring lock "refresh_cache-b2f88b2e-0244-4e18-98ae-21861b02db3a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:48:26 user nova-compute[75083]: DEBUG nova.network.neutron [req-e47fda46-32d5-41f3-84b5-2d8632b1d8c7 req-602e6b06-ebe7-4c06-9aaa-55e195536992 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Updated VIF entry in instance network info cache for port 9ac8517e-5bf8-41ec-839e-40dcffd8a7ac. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:48:26 user nova-compute[75083]: DEBUG nova.network.neutron [req-e47fda46-32d5-41f3-84b5-2d8632b1d8c7 req-602e6b06-ebe7-4c06-9aaa-55e195536992 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Updating instance_info_cache with network_info: [{"id": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "address": "fa:16:3e:b3:28:72", "network": {"id": "acfa7005-35a1-408e-a897-5920887137b3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-302522629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac8517e-5b", "ovs_interfaceid": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:48:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e47fda46-32d5-41f3-84b5-2d8632b1d8c7 req-602e6b06-ebe7-4c06-9aaa-55e195536992 service nova] Releasing lock "refresh_cache-b2f88b2e-0244-4e18-98ae-21861b02db3a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:48:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquired lock "refresh_cache-b2f88b2e-0244-4e18-98ae-21861b02db3a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:48:26 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:48:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Updating instance_info_cache with network_info: [{"id": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "address": "fa:16:3e:b3:28:72", "network": {"id": "acfa7005-35a1-408e-a897-5920887137b3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-302522629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac8517e-5b", "ovs_interfaceid": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90ffff8c-4211-4ef0-b043-f632e883962b", "address": "fa:16:3e:37:88:c5", "network": {"id": "a1790ee1-80c8-4a22-81b3-abbf42053cef", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-830898710", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ffff8c-42", "ovs_interfaceid": "90ffff8c-4211-4ef0-b043-f632e883962b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Releasing lock "refresh_cache-b2f88b2e-0244-4e18-98ae-21861b02db3a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-435233267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-435233267',id=8,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVo1YmBFLd3yYkAIW3JoUP4JziHChmMQVX+ttBFc7qW+T8emUJzEuqgOO60aMaVCz4WsSuNB1wNEq+HNrQ09nJNiqezTzIp51WzgrWGg90AnD0HNS2LM7B+NhJDHUeq3A==',key_name='tempest-keypair-489296993',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8916664e2bf04c018daedae140735f3a',ramdisk_id='',reservation_id='r-mli56wj6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2091340319',owner_user_name='tempest-TaggedAttachmentsTest-2091340319-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:46:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c746113481e4d179fba6e77efcee7a2',uuid=b2f88b2e-0244-4e18-98ae-21861b02db3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90ffff8c-4211-4ef0-b043-f632e883962b", "address": "fa:16:3e:37:88:c5", "network": {"id": "a1790ee1-80c8-4a22-81b3-abbf42053cef", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-830898710", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ffff8c-42", "ovs_interfaceid": "90ffff8c-4211-4ef0-b043-f632e883962b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Converting VIF {"id": "90ffff8c-4211-4ef0-b043-f632e883962b", "address": "fa:16:3e:37:88:c5", "network": {"id": "a1790ee1-80c8-4a22-81b3-abbf42053cef", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-830898710", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ffff8c-42", "ovs_interfaceid": "90ffff8c-4211-4ef0-b043-f632e883962b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:88:c5,bridge_name='br-int',has_traffic_filtering=True,id=90ffff8c-4211-4ef0-b043-f632e883962b,network=Network(a1790ee1-80c8-4a22-81b3-abbf42053cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ffff8c-42') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG os_vif [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:88:c5,bridge_name='br-int',has_traffic_filtering=True,id=90ffff8c-4211-4ef0-b043-f632e883962b,network=Network(a1790ee1-80c8-4a22-81b3-abbf42053cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ffff8c-42') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f906dec-e5b6-5444-952f-dbe07dd37cab', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90ffff8c-42, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90ffff8c-42, col_values=(('qos', UUID('19328f40-47aa-4565-b7cb-cea1cb32f7cf')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90ffff8c-42, col_values=(('external_ids', {'iface-id': '90ffff8c-4211-4ef0-b043-f632e883962b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:88:c5', 'vm-uuid': 'b2f88b2e-0244-4e18-98ae-21861b02db3a'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:27 user nova-compute[75083]: INFO os_vif [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:88:c5,bridge_name='br-int',has_traffic_filtering=True,id=90ffff8c-4211-4ef0-b043-f632e883962b,network=Network(a1790ee1-80c8-4a22-81b3-abbf42053cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ffff8c-42')
Nov 29 05:48:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-435233267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-435233267',id=8,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVo1YmBFLd3yYkAIW3JoUP4JziHChmMQVX+ttBFc7qW+T8emUJzEuqgOO60aMaVCz4WsSuNB1wNEq+HNrQ09nJNiqezTzIp51WzgrWGg90AnD0HNS2LM7B+NhJDHUeq3A==',key_name='tempest-keypair-489296993',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8916664e2bf04c018daedae140735f3a',ramdisk_id='',reservation_id='r-mli56wj6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2091340319',owner_user_name='tempest-TaggedAttachmentsTest-2091340319-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:46:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c746113481e4d179fba6e77efcee7a2',uuid=b2f88b2e-0244-4e18-98ae-21861b02db3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90ffff8c-4211-4ef0-b043-f632e883962b", "address": "fa:16:3e:37:88:c5", "network": {"id": "a1790ee1-80c8-4a22-81b3-abbf42053cef", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-830898710", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ffff8c-42", "ovs_interfaceid": "90ffff8c-4211-4ef0-b043-f632e883962b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Converting VIF {"id": "90ffff8c-4211-4ef0-b043-f632e883962b", "address": "fa:16:3e:37:88:c5", "network": {"id": "a1790ee1-80c8-4a22-81b3-abbf42053cef", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-830898710", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ffff8c-42", "ovs_interfaceid": "90ffff8c-4211-4ef0-b043-f632e883962b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:88:c5,bridge_name='br-int',has_traffic_filtering=True,id=90ffff8c-4211-4ef0-b043-f632e883962b,network=Network(a1790ee1-80c8-4a22-81b3-abbf42053cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ffff8c-42') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] attach device xml: <interface type="ethernet">
Nov 29 05:48:27 user nova-compute[75083]:   <mac address="fa:16:3e:37:88:c5"/>
Nov 29 05:48:27 user nova-compute[75083]:   <model type="virtio"/>
Nov 29 05:48:27 user nova-compute[75083]:   <mtu size="1442"/>
Nov 29 05:48:27 user nova-compute[75083]:   <target dev="tap90ffff8c-42"/>
Nov 29 05:48:27 user nova-compute[75083]: </interface>
Nov 29 05:48:27 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG nova.compute.manager [req-3c1b8496-d49f-4763-89df-e670152e4500 req-cddf721b-1586-4bab-97f0-93055b0d1809 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received event network-vif-plugged-90ffff8c-4211-4ef0-b043-f632e883962b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3c1b8496-d49f-4763-89df-e670152e4500 req-cddf721b-1586-4bab-97f0-93055b0d1809 service nova] Acquiring lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3c1b8496-d49f-4763-89df-e670152e4500 req-cddf721b-1586-4bab-97f0-93055b0d1809 service nova] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3c1b8496-d49f-4763-89df-e670152e4500 req-cddf721b-1586-4bab-97f0-93055b0d1809 service nova] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG nova.compute.manager [req-3c1b8496-d49f-4763-89df-e670152e4500 req-cddf721b-1586-4bab-97f0-93055b0d1809 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] No waiting events found dispatching network-vif-plugged-90ffff8c-4211-4ef0-b043-f632e883962b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:27 user nova-compute[75083]: WARNING nova.compute.manager [req-3c1b8496-d49f-4763-89df-e670152e4500 req-cddf721b-1586-4bab-97f0-93055b0d1809 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received unexpected event network-vif-plugged-90ffff8c-4211-4ef0-b043-f632e883962b for instance with vm_state active and task_state None.
Nov 29 05:48:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] No BDM found with device name hda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] No VIF found with MAC fa:16:3e:b3:28:72, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:48:27 user nova-compute[75083]:   <nova:package version="0.0.0"/>
Nov 29 05:48:27 user nova-compute[75083]:   <nova:name>tempest-device-tagging-server-435233267</nova:name>
Nov 29 05:48:27 user nova-compute[75083]:   <nova:creationTime>2023-11-29 05:48:27</nova:creationTime>
Nov 29 05:48:27 user nova-compute[75083]:   <nova:flavor name="m1.tiny">
Nov 29 05:48:27 user nova-compute[75083]:     <nova:memory>512</nova:memory>
Nov 29 05:48:27 user nova-compute[75083]:     <nova:disk>1</nova:disk>
Nov 29 05:48:27 user nova-compute[75083]:     <nova:swap>0</nova:swap>
Nov 29 05:48:27 user nova-compute[75083]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:48:27 user nova-compute[75083]:     <nova:vcpus>1</nova:vcpus>
Nov 29 05:48:27 user nova-compute[75083]:   </nova:flavor>
Nov 29 05:48:27 user nova-compute[75083]:   <nova:owner>
Nov 29 05:48:27 user nova-compute[75083]:     <nova:user uuid="9c746113481e4d179fba6e77efcee7a2">tempest-TaggedAttachmentsTest-2091340319-project-member</nova:user>
Nov 29 05:48:27 user nova-compute[75083]:     <nova:project uuid="8916664e2bf04c018daedae140735f3a">tempest-TaggedAttachmentsTest-2091340319</nova:project>
Nov 29 05:48:27 user nova-compute[75083]:   </nova:owner>
Nov 29 05:48:27 user nova-compute[75083]:   <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:48:27 user nova-compute[75083]:   <nova:ports>
Nov 29 05:48:27 user nova-compute[75083]:     <nova:port uuid="9ac8517e-5bf8-41ec-839e-40dcffd8a7ac">
Nov 29 05:48:27 user nova-compute[75083]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 05:48:27 user nova-compute[75083]:     </nova:port>
Nov 29 05:48:27 user nova-compute[75083]:     <nova:port uuid="90ffff8c-4211-4ef0-b043-f632e883962b">
Nov 29 05:48:27 user nova-compute[75083]:       <nova:ip type="fixed" address="10.10.10.54" ipVersion="4"/>
Nov 29 05:48:27 user nova-compute[75083]:     </nova:port>
Nov 29 05:48:27 user nova-compute[75083]:   </nova:ports>
Nov 29 05:48:27 user nova-compute[75083]: </nova:instance>
Nov 29 05:48:27 user nova-compute[75083]:  {{(pid=75083) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 05:48:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f1592017-acb3-4b1a-8921-c9468bbecb4e tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "interface-b2f88b2e-0244-4e18-98ae-21861b02db3a-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.270s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-6f4bad99-6a15-467c-91a5-60b3521621b8 req-439a2be5-2eca-4017-b058-ab66dda374b0 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received event network-changed-90ffff8c-4211-4ef0-b043-f632e883962b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-6f4bad99-6a15-467c-91a5-60b3521621b8 req-439a2be5-2eca-4017-b058-ab66dda374b0 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Refreshing instance network info cache due to event network-changed-90ffff8c-4211-4ef0-b043-f632e883962b. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6f4bad99-6a15-467c-91a5-60b3521621b8 req-439a2be5-2eca-4017-b058-ab66dda374b0 service nova] Acquiring lock "refresh_cache-b2f88b2e-0244-4e18-98ae-21861b02db3a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6f4bad99-6a15-467c-91a5-60b3521621b8 req-439a2be5-2eca-4017-b058-ab66dda374b0 service nova] Acquired lock "refresh_cache-b2f88b2e-0244-4e18-98ae-21861b02db3a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG nova.network.neutron [req-6f4bad99-6a15-467c-91a5-60b3521621b8 req-439a2be5-2eca-4017-b058-ab66dda374b0 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Refreshing network info cache for port 90ffff8c-4211-4ef0-b043-f632e883962b {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquiring lock "b2f88b2e-0244-4e18-98ae-21861b02db3a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG nova.objects.instance [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lazy-loading 'flavor' on Instance uuid b2f88b2e-0244-4e18-98ae-21861b02db3a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG nova.network.neutron [req-6f4bad99-6a15-467c-91a5-60b3521621b8 req-439a2be5-2eca-4017-b058-ab66dda374b0 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Updated VIF entry in instance network info cache for port 90ffff8c-4211-4ef0-b043-f632e883962b. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG nova.network.neutron [req-6f4bad99-6a15-467c-91a5-60b3521621b8 req-439a2be5-2eca-4017-b058-ab66dda374b0 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Updating instance_info_cache with network_info: [{"id": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "address": "fa:16:3e:b3:28:72", "network": {"id": "acfa7005-35a1-408e-a897-5920887137b3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-302522629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac8517e-5b", "ovs_interfaceid": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90ffff8c-4211-4ef0-b043-f632e883962b", "address": "fa:16:3e:37:88:c5", "network": {"id": "a1790ee1-80c8-4a22-81b3-abbf42053cef", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-830898710", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ffff8c-42", "ovs_interfaceid": "90ffff8c-4211-4ef0-b043-f632e883962b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquiring lock "b2f88b2e-0244-4e18-98ae-21861b02db3a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:28 user nova-compute[75083]: INFO nova.compute.manager [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Attaching volume 3126857d-d314-4ec6-90c7-aa46375c25b0 to /dev/vdb
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6f4bad99-6a15-467c-91a5-60b3521621b8 req-439a2be5-2eca-4017-b058-ab66dda374b0 service nova] Releasing lock "refresh_cache-b2f88b2e-0244-4e18-98ae-21861b02db3a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG os_brick.utils [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[99145794-80e3-4e82-b4d2-58961d74620e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f55c4f5-ba0e-4f66-98ed-23e53fbe4085]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dddd14-7867-4ec3-a4ad-ccfefccfab2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[322a6d85-f6b7-4153-89c1-2f59928c1d6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:48:28 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:48:28 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c557c1de-abaf-4216-aede-a1d085bc8b61]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG os_brick.utils [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:28 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Updating existing volume attachment record: 45e3e73d-27d5-4bd9-89e1-d1d3e693fe96 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:48:29 user nova-compute[75083]: DEBUG nova.compute.manager [req-7ab266f0-185b-42bc-9bca-1adf0e11057b req-3cd355d5-11ed-4a04-a9ad-ef04838efd8f service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received event network-vif-plugged-90ffff8c-4211-4ef0-b043-f632e883962b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7ab266f0-185b-42bc-9bca-1adf0e11057b req-3cd355d5-11ed-4a04-a9ad-ef04838efd8f service nova] Acquiring lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7ab266f0-185b-42bc-9bca-1adf0e11057b req-3cd355d5-11ed-4a04-a9ad-ef04838efd8f service nova] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7ab266f0-185b-42bc-9bca-1adf0e11057b req-3cd355d5-11ed-4a04-a9ad-ef04838efd8f service nova] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:29 user nova-compute[75083]: DEBUG nova.compute.manager [req-7ab266f0-185b-42bc-9bca-1adf0e11057b req-3cd355d5-11ed-4a04-a9ad-ef04838efd8f service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] No waiting events found dispatching network-vif-plugged-90ffff8c-4211-4ef0-b043-f632e883962b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:29 user nova-compute[75083]: WARNING nova.compute.manager [req-7ab266f0-185b-42bc-9bca-1adf0e11057b req-3cd355d5-11ed-4a04-a9ad-ef04838efd8f service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received unexpected event network-vif-plugged-90ffff8c-4211-4ef0-b043-f632e883962b for instance with vm_state active and task_state None.
Nov 29 05:48:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yAuTBSmh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:30 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:30 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:30 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc3b805-482b-4843-b1a3-c2ddae446e57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:48:30 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[12325811-dc48-470b-9cee-8f714fee01aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193] added
Nov 29 05:48:30 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6b1b10-6700-4034-a5f1-0209c1e7056e]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[112ea056-ba54-4d2c-9e1b-32b291d24c37]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yAuTBSmh {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yAuTBSmh" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14bca58-ffe2-4f58-8de0-d7ce9efedcc4]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yAuTBSmh'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d963b8-d979-4101-b2de-dbfaf530d09c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a5d43e-b8c6-49ba-b961-eb4ebf32ab4a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:30 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:30 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:30 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:30 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:30 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:30 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:30 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:30 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:30 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:30 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:30 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:30 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:30 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:30 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1d6eb3-3039-4cd9-8348-f711d89bdfea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193, portal: 172.16.0.220,3260]
Nov 29 05:48:30 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193, portal: 172.16.0.220,3260] successful.
Nov 29 05:48:30 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4682701-94dd-4907-ac65-2b2d466b7f48]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:31 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[437965ea-40d0-4a68-a453-25ba241b9f92]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:31 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:31 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:31 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:31 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:31 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:31 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:31 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:31 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:31 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:31 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:31 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:31 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:31 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:31 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:31 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:31 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:48:31 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:48:31 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:48:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:31 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[46524e7f-4c25-4c73-9a73-c2801d8d688a]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:31 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:48:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yAuTBSmh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23462616537373439', 'path': '/dev/sdh'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462616537373439', 'path': '/dev/sdh'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG nova.objects.instance [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lazy-loading 'flavor' on Instance uuid 0414bda1-7b04-40ba-a693-44be9296e432 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 05:48:32 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:48:32 user nova-compute[75083]:   <source dev="/dev/sdh"/>
Nov 29 05:48:32 user nova-compute[75083]:   <target dev="sdc" bus="scsi"/>
Nov 29 05:48:32 user nova-compute[75083]:   <serial>f1dc8da6-b493-4667-9f50-96f86b0f9193</serial>
Nov 29 05:48:32 user nova-compute[75083]:   <address type="drive" controller="0" unit="2"/>
Nov 29 05:48:32 user nova-compute[75083]: </disk>
Nov 29 05:48:32 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viLUoyJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:32 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:32 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:32 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b04735-3685-4921-bc96-7e22292cb3c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:48:32 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d9910c-284f-4def-920c-46269741ba93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780] added
Nov 29 05:48:32 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e656540-ce43-4a70-9b08-4247b13d3712]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a17a0ef-306c-4430-a03d-a127e3c3316c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG nova.compute.manager [req-a8e33fc8-d44a-4fc7-a404-75579f63a299 req-d686dc32-887f-433e-b664-9012ab3666f9 service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Received event network-changed-ccdce1d3-0ef3-437b-aaab-383bc235b27f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG nova.compute.manager [req-a8e33fc8-d44a-4fc7-a404-75579f63a299 req-d686dc32-887f-433e-b664-9012ab3666f9 service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Refreshing instance network info cache due to event network-changed-ccdce1d3-0ef3-437b-aaab-383bc235b27f. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a8e33fc8-d44a-4fc7-a404-75579f63a299 req-d686dc32-887f-433e-b664-9012ab3666f9 service nova] Acquiring lock "refresh_cache-12989829-1b4c-4aaf-ad24-b30488c4e472" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a8e33fc8-d44a-4fc7-a404-75579f63a299 req-d686dc32-887f-433e-b664-9012ab3666f9 service nova] Acquired lock "refresh_cache-12989829-1b4c-4aaf-ad24-b30488c4e472" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG nova.network.neutron [req-a8e33fc8-d44a-4fc7-a404-75579f63a299 req-d686dc32-887f-433e-b664-9012ab3666f9 service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Refreshing network info cache for port ccdce1d3-0ef3-437b-aaab-383bc235b27f {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v viLUoyJT {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v viLUoyJT" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f3a856-8716-4476-acfa-e17123179a00]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'viLUoyJT'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af5eb40-c582-4672-ac75-c9b96bcb699b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] No BDM found with device name sda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] No VIF found with MAC fa:16:3e:1e:c8:98, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2f605e-f8da-48c4-a817-99a3c349de13]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:32 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:32 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ed6c53-de9a-4f79-b441-35cf8d97b93d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780, portal: 172.16.0.220,3260]
Nov 29 05:48:32 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780, portal: 172.16.0.220,3260] successful.
Nov 29 05:48:32 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[affc92d6-5608-4c90-90f6-0364312def0c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c9dedba7-aa5d-4000-8f39-e5a6b23b882c tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "0414bda1-7b04-40ba-a693-44be9296e432" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.301s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51b1fd6-e4bc-4ef8-b2fa-b6b10a1cb784]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:32 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:32 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:32 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cdd00b-9dfd-4611-a3ae-3f06d9c6f661]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viLUoyJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Acquiring lock "12989829-1b4c-4aaf-ad24-b30488c4e472" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Lock "12989829-1b4c-4aaf-ad24-b30488c4e472" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:32 user nova-compute[75083]: DEBUG nova.objects.instance [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Lazy-loading 'flavor' on Instance uuid 12989829-1b4c-4aaf-ad24-b30488c4e472 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Lock "12989829-1b4c-4aaf-ad24-b30488c4e472" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG nova.network.neutron [req-a8e33fc8-d44a-4fc7-a404-75579f63a299 req-d686dc32-887f-433e-b664-9012ab3666f9 service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Updated VIF entry in instance network info cache for port ccdce1d3-0ef3-437b-aaab-383bc235b27f. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG nova.network.neutron [req-a8e33fc8-d44a-4fc7-a404-75579f63a299 req-d686dc32-887f-433e-b664-9012ab3666f9 service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Updating instance_info_cache with network_info: [{"id": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "address": "fa:16:3e:47:af:1e", "network": {"id": "7b7dbeb9-8470-4f69-9c8d-537c75e4c009", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-386572162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228d74739f504c8aa3a034742390113c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccdce1d3-0e", "ovs_interfaceid": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a8e33fc8-d44a-4fc7-a404-75579f63a299 req-d686dc32-887f-433e-b664-9012ab3666f9 service nova] Releasing lock "refresh_cache-12989829-1b4c-4aaf-ad24-b30488c4e472" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Acquiring lock "12989829-1b4c-4aaf-ad24-b30488c4e472" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Lock "12989829-1b4c-4aaf-ad24-b30488c4e472" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:33 user nova-compute[75083]: INFO nova.compute.manager [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Attaching volume 9756f050-c5b1-4427-963b-f92f8e9fad8e to /dev/vdb
Nov 29 05:48:33 user nova-compute[75083]: DEBUG os_brick.utils [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[37728d2c-50f1-4066-9f44-eae1d19204bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa19098-a2f3-4073-b538-4dddc54397a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a9c9a5-956e-4555-b1e4-c722e1f0c9fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6916c73a-c0cc-48b5-874d-3501dd2da3ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:48:33 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11b4d12-af02-4a40-b319-e0dc14c3f929]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG os_brick.utils [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Updating existing volume attachment record: 28369d68-2a8a-4dc8-a7fb-419dcc84ba04 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Acquiring lock "0414bda1-7b04-40ba-a693-44be9296e432" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "0414bda1-7b04-40ba-a693-44be9296e432" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:33 user nova-compute[75083]: INFO nova.compute.manager [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Detaching volume f1dc8da6-b493-4667-9f50-96f86b0f9193
Nov 29 05:48:33 user nova-compute[75083]: INFO nova.virt.block_device [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Attempting to driver detach volume f1dc8da6-b493-4667-9f50-96f86b0f9193 from mountpoint /dev/sdc
Nov 29 05:48:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Attempting to detach device sdc from instance 0414bda1-7b04-40ba-a693-44be9296e432 from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:48:33 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:48:33 user nova-compute[75083]:   <source dev="/dev/sdh"/>
Nov 29 05:48:33 user nova-compute[75083]:   <target dev="sdc" bus="scsi"/>
Nov 29 05:48:33 user nova-compute[75083]:   <serial>f1dc8da6-b493-4667-9f50-96f86b0f9193</serial>
Nov 29 05:48:33 user nova-compute[75083]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 05:48:33 user nova-compute[75083]: </disk>
Nov 29 05:48:33 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:48:33 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Successfully detached device sdc from instance 0414bda1-7b04-40ba-a693-44be9296e432 from the persistent domain config.
Nov 29 05:48:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 0414bda1-7b04-40ba-a693-44be9296e432 from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:48:33 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:48:33 user nova-compute[75083]:   <source dev="/dev/sdh"/>
Nov 29 05:48:33 user nova-compute[75083]:   <target dev="sdc" bus="scsi"/>
Nov 29 05:48:33 user nova-compute[75083]:   <serial>f1dc8da6-b493-4667-9f50-96f86b0f9193</serial>
Nov 29 05:48:33 user nova-compute[75083]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 05:48:33 user nova-compute[75083]: </disk>
Nov 29 05:48:33 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '26539666534623433', 'path': '/dev/sdj'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539666534623433', 'path': '/dev/sdj'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG nova.objects.instance [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lazy-loading 'flavor' on Instance uuid ae18699b-d0cf-44b5-8467-a112fd154580 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 05:48:33 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:48:33 user nova-compute[75083]:   <source dev="/dev/sdj"/>
Nov 29 05:48:33 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:48:33 user nova-compute[75083]:   <serial>74982c7f-1ac4-4d4f-b76c-521e310f1780</serial>
Nov 29 05:48:33 user nova-compute[75083]: </disk>
Nov 29 05:48:33 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 05:48:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 0414bda1-7b04-40ba-a693-44be9296e432 {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 05:48:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:48:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:48:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] No VIF found with MAC fa:16:3e:4f:5a:84, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:48:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-12a0c5f3-1715-45b6-8bb6-7ec9ad21ecb7 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "ae18699b-d0cf-44b5-8467-a112fd154580" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.309s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Acquiring lock "ae18699b-d0cf-44b5-8467-a112fd154580" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Lock "ae18699b-d0cf-44b5-8467-a112fd154580" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG os_brick.utils [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6812c9-cb54-4264-b3f1-aa90de16b90e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b6a2f0-22bf-4039-9bb4-5de9b8011bac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd15b122-20f6-4e74-af6e-091fb6f6727a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda1aa33-8b38-4ebf-a9ef-8d4420cabbdb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:48:35 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:48:35 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38c18bb-a150-4486-9bff-e5ad6ee90e09]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:48:35 user nova-compute[75083]: DEBUG os_brick.utils [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:35 user nova-compute[75083]: INFO nova.compute.manager [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Swapping volume 74982c7f-1ac4-4d4f-b76c-521e310f1780 for bcdfc365-b96d-40ac-a012-96484a067113
Nov 29 05:48:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HzyIPCAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:37 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:37 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:37 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[635dfb31-98d0-4de2-87b1-ba786d1c27c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:48:37 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f077645-0f6f-481c-b9f1-3a0d911a774e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0] added
Nov 29 05:48:37 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f87f5c-17e8-4e87-ad85-d4ad701da4a7]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a80c78-897a-422a-917a-71de4f0b46a9]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HzyIPCAT {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HzyIPCAT" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[255ce86e-a9de-4d9b-8958-f273ae04c6f2]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HzyIPCAT'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ccc9dd-09d8-47ff-ba68-ef2bbd9f8f12]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[324e65a8-8c25-4003-8c5f-4b0e9ddb4652]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:37 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:37 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4916a555-7d23-44b8-a887-dee159688e91]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0, portal: 172.16.0.220,3260]
Nov 29 05:48:37 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0, portal: 172.16.0.220,3260] successful.
Nov 29 05:48:37 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dce5c88-053b-4553-930b-24c9d708d755]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c23a704-83bf-425b-af0c-4d8f23a6c483]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:37 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:37 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:37 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f737e08d-8f37-4778-9303-5d57ca93f79b]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:48:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HzyIPCAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:48:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23761313235653331', 'path': '/dev/sdk'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761313235653331', 'path': '/dev/sdk'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:48:39 user nova-compute[75083]: DEBUG nova.objects.instance [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lazy-loading 'flavor' on Instance uuid b2f88b2e-0244-4e18-98ae-21861b02db3a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 05:48:39 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:48:39 user nova-compute[75083]:   <source dev="/dev/sdk"/>
Nov 29 05:48:39 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:48:39 user nova-compute[75083]:   <serial>3126857d-d314-4ec6-90c7-aa46375c25b0</serial>
Nov 29 05:48:39 user nova-compute[75083]: </disk>
Nov 29 05:48:39 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 05:48:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:48:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] No BDM found with device name hda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:48:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] No VIF found with MAC fa:16:3e:b3:28:72, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:48:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-949970a0-7f0f-4084-b905-47b0a13be265 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.108s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquiring lock "b2f88b2e-0244-4e18-98ae-21861b02db3a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:40 user nova-compute[75083]: INFO nova.compute.manager [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Detaching volume 3126857d-d314-4ec6-90c7-aa46375c25b0
Nov 29 05:48:40 user nova-compute[75083]: INFO nova.virt.block_device [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Attempting to driver detach volume 3126857d-d314-4ec6-90c7-aa46375c25b0 from mountpoint /dev/vdb
Nov 29 05:48:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Attempting to detach device vdb from instance b2f88b2e-0244-4e18-98ae-21861b02db3a from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 05:48:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:48:40 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:48:40 user nova-compute[75083]:   <source dev="/dev/sdk"/>
Nov 29 05:48:40 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:48:40 user nova-compute[75083]:   <serial>3126857d-d314-4ec6-90c7-aa46375c25b0</serial>
Nov 29 05:48:40 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 05:48:40 user nova-compute[75083]: </disk>
Nov 29 05:48:40 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:48:40 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Successfully detached device vdb from instance b2f88b2e-0244-4e18-98ae-21861b02db3a from the persistent domain config.
Nov 29 05:48:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b2f88b2e-0244-4e18-98ae-21861b02db3a from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 05:48:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:48:40 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:48:40 user nova-compute[75083]:   <source dev="/dev/sdk"/>
Nov 29 05:48:40 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:48:40 user nova-compute[75083]:   <serial>3126857d-d314-4ec6-90c7-aa46375c25b0</serial>
Nov 29 05:48:40 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 05:48:40 user nova-compute[75083]: </disk>
Nov 29 05:48:40 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:48:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b2f88b2e-0244-4e18-98ae-21861b02db3a {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kTMJeCmc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:42 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:42 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:42 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06aee05-7b6e-4e4c-ab6e-747234ae7b12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:48:42 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccda87a-6dd1-4ac3-b084-30de1883bad6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e] added
Nov 29 05:48:42 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71d310f-c9c8-4115-b009-357183b9461a]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b3e8f3-59e1-446c-a5b7-4e16846b52c3]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kTMJeCmc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kTMJeCmc" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[70eec63b-e19f-4854-afc9-9a64609009d7]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kTMJeCmc'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.087s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff9941e-b9a1-4352-83f5-3ad9551c72b1]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc43891-ed8e-46bf-bdf1-8bc82dfae340]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:42 user nova-compute[75083]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:48:42 user nova-compute[75083]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:42 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:42 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:42 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:42 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:42 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:42 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:42 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:42 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:42 user nova-compute[75083]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:48:42 user nova-compute[75083]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:42 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:42 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:42 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:42 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:42 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:42 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:42 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:42 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[59952228-d801-4b32-a028-c375fb8f1d90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e, portal: 172.16.0.220,3260]
Nov 29 05:48:43 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e, portal: 172.16.0.220,3260] successful.
Nov 29 05:48:43 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9df1070-5e78-4611-884b-88521b739830]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23d63be-2019-4c53-85be-a4da500cb30d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:43 user nova-compute[75083]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:48:43 user nova-compute[75083]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:43 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:48:43 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:43 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:43 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:43 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:43 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:43 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:43 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:43 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:43 user nova-compute[75083]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:48:43 user nova-compute[75083]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:43 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:48:43 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:43 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:43 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:43 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:43 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:43 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:43 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:43 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[af946f37-10ed-482a-af9d-6efacf389003]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:48:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kTMJeCmc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:48:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '23138303539653931', 'path': '/dev/sdl'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138303539653931', 'path': '/dev/sdl'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:48:44 user nova-compute[75083]: DEBUG nova.objects.instance [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Lazy-loading 'flavor' on Instance uuid 12989829-1b4c-4aaf-ad24-b30488c4e472 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] attach device xml: <disk type="block" device="disk">
Nov 29 05:48:44 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:48:44 user nova-compute[75083]:   <source dev="/dev/sdl"/>
Nov 29 05:48:44 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:48:44 user nova-compute[75083]:   <serial>9756f050-c5b1-4427-963b-f92f8e9fad8e</serial>
Nov 29 05:48:44 user nova-compute[75083]: </disk>
Nov 29 05:48:44 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 05:48:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:48:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:48:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] No VIF found with MAC fa:16:3e:47:af:1e, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:48:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-13b5ab72-c98b-4d21-ad93-83c9b5b798dd tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Lock "12989829-1b4c-4aaf-ad24-b30488c4e472" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.321s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voYpWmRj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ae18699b-d0cf-44b5-8467-a112fd154580', 'attached_at': '', 'detached_at': '', 'volume_id': 'bcdfc365-b96d-40ac-a012-96484a067113', 'serial': 'bcdfc365-b96d-40ac-a012-96484a067113'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viLUoyJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'ae18699b-d0cf-44b5-8467-a112fd154580', 'attached_at': '', 'detached_at': '', 'volume_id': '74982c7f-1ac4-4d4f-b76c-521e310f1780', 'serial'} {{(pid=75083) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voYpWmRj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:45 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:45 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:45 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9077528f-16f9-4697-8ed5-1dbf8e0e5263]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:48:45 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fc877b-9f31-4a03-9bda-03a3ed54700e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113] added
Nov 29 05:48:45 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c34d47-a32d-4ab0-a17a-9b1c71a6d3c9]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c83722-60a9-4c95-958b-2e2685ba851b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v voYpWmRj {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v voYpWmRj" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[521da894-796b-4f94-8ef3-5e504b756bce]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'voYpWmRj'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c269343-e8e9-48f0-bdad-fa76cd564254]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c798028c-1bbf-44fc-90a6-0821e6cdd4b2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:45 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:45 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fae0475-9c21-4383-98d3-32cb8e9651ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113, portal: 172.16.0.220,3260]
Nov 29 05:48:45 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113, portal: 172.16.0.220,3260] successful.
Nov 29 05:48:45 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[726af734-80e5-4dca-9838-0913d9cec535]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d926a1-6cd3-4bd8-bb58-39f24604719a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:45 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:45 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:45 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] HCTL ('44', '-', '-', 0) found on session 14 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Scanning host 44 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d553cc85-5956-4caa-93bb-dcd7b5e76eea]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Searching for a device in session 14 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voYpWmRj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-43848846-d463-4747-bfb2-13c5f838ca03 tempest-VolumesAssistedSnapshotsTest-477176858 tempest-VolumesAssistedSnapshotsTest-477176858-project] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] volume_snapshot_create: create_info: {'snapshot_id': '86335c46-6596-4154-9bdf-a09cdf10be26', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75083) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-43848846-d463-4747-bfb2-13c5f838ca03 tempest-VolumesAssistedSnapshotsTest-477176858 tempest-VolumesAssistedSnapshotsTest-477176858-project] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] snap xml: <domainsnapshot>
Nov 29 05:48:45 user nova-compute[75083]:   <disks>
Nov 29 05:48:45 user nova-compute[75083]:     <disk name="/dev/sdl" snapshot="external" type="file">
Nov 29 05:48:45 user nova-compute[75083]:       <source file="/dev/new_file"/>
Nov 29 05:48:45 user nova-compute[75083]:     </disk>
Nov 29 05:48:45 user nova-compute[75083]:     <disk name="vda" snapshot="no"/>
Nov 29 05:48:45 user nova-compute[75083]:   </disks>
Nov 29 05:48:45 user nova-compute[75083]: </domainsnapshot>
Nov 29 05:48:45 user nova-compute[75083]:  {{(pid=75083) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG nova.objects.instance [None req-43848846-d463-4747-bfb2-13c5f838ca03 tempest-VolumesAssistedSnapshotsTest-477176858 tempest-VolumesAssistedSnapshotsTest-477176858-project] Lazy-loading 'system_metadata' on Instance uuid 12989829-1b4c-4aaf-ad24-b30488c4e472 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:45 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-43848846-d463-4747-bfb2-13c5f838ca03 tempest-VolumesAssistedSnapshotsTest-477176858 tempest-VolumesAssistedSnapshotsTest-477176858-project] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [None req-43848846-d463-4747-bfb2-13c5f838ca03 tempest-VolumesAssistedSnapshotsTest-477176858 tempest-VolumesAssistedSnapshotsTest-477176858-project] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Traceback (most recent call last):
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]     rv = execute(f, *args, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]     six.reraise(c, e, tb)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]     raise value
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]     rv = meth(*args, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] 
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [None req-43848846-d463-4747-bfb2-13c5f838ca03 tempest-VolumesAssistedSnapshotsTest-477176858 tempest-VolumesAssistedSnapshotsTest-477176858-project] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Traceback (most recent call last):
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]     self._volume_snapshot_create(context, instance, guest,
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]     rv = execute(f, *args, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]     six.reraise(c, e, tb)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]     raise value
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]     rv = meth(*args, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] 
Nov 29 05:48:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-4c4e8ada-bf27-4ece-8649-2a4c9492e7aa tempest-VolumesAssistedSnapshotsTest-477176858 tempest-VolumesAssistedSnapshotsTest-477176858-project] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] volume_snapshot_delete: delete_info: {'volume_id': '9756f050-c5b1-4427-963b-f92f8e9fad8e'} {{(pid=75083) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [None req-4c4e8ada-bf27-4ece-8649-2a4c9492e7aa tempest-VolumesAssistedSnapshotsTest-477176858 tempest-VolumesAssistedSnapshotsTest-477176858-project] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Traceback (most recent call last):
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472]     if delete_info['type'] != 'qcow2':
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] KeyError: 'type'
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] 
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [None req-43848846-d463-4747-bfb2-13c5f838ca03 tempest-VolumesAssistedSnapshotsTest-477176858 tempest-VolumesAssistedSnapshotsTest-477176858-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 86335c46-6596-4154-9bdf-a09cdf10be26 could not be found.
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     raise value
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver 
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver 
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 86335c46-6596-4154-9bdf-a09cdf10be26 could not be found. (HTTP 404) (Request-ID: req-6a38871e-38ea-4cd0-b106-a14bcb418212)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver 
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver 
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 86335c46-6596-4154-9bdf-a09cdf10be26 could not be found.
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver 
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server [None req-43848846-d463-4747-bfb2-13c5f838ca03 tempest-VolumesAssistedSnapshotsTest-477176858 tempest-VolumesAssistedSnapshotsTest-477176858-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     raise value
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server 
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver [None req-4c4e8ada-bf27-4ece-8649-2a4c9492e7aa tempest-VolumesAssistedSnapshotsTest-477176858 tempest-VolumesAssistedSnapshotsTest-477176858-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver 
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver 
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-84104b33-4e03-4354-9141-17b1536061aa)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver 
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver 
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 05:48:45 user nova-compute[75083]: ERROR nova.virt.libvirt.driver 
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server [None req-4c4e8ada-bf27-4ece-8649-2a4c9492e7aa tempest-VolumesAssistedSnapshotsTest-477176858 tempest-VolumesAssistedSnapshotsTest-477176858-project] Exception during message handling: KeyError: 'type'
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 29 05:48:45 user nova-compute[75083]: ERROR oslo_messaging.rpc.server 
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Acquiring lock "12989829-1b4c-4aaf-ad24-b30488c4e472" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Lock "12989829-1b4c-4aaf-ad24-b30488c4e472" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:45 user nova-compute[75083]: INFO nova.compute.manager [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Detaching volume 9756f050-c5b1-4427-963b-f92f8e9fad8e
Nov 29 05:48:46 user nova-compute[75083]: INFO nova.virt.block_device [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Attempting to driver detach volume 9756f050-c5b1-4427-963b-f92f8e9fad8e from mountpoint /dev/vdb
Nov 29 05:48:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Attempting to detach device vdb from instance 12989829-1b4c-4aaf-ad24-b30488c4e472 from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 05:48:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 05:48:46 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:48:46 user nova-compute[75083]:   <source dev="/dev/sdl"/>
Nov 29 05:48:46 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:48:46 user nova-compute[75083]:   <serial>9756f050-c5b1-4427-963b-f92f8e9fad8e</serial>
Nov 29 05:48:46 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 05:48:46 user nova-compute[75083]: </disk>
Nov 29 05:48:46 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:48:46 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Successfully detached device vdb from instance 12989829-1b4c-4aaf-ad24-b30488c4e472 from the persistent domain config.
Nov 29 05:48:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 12989829-1b4c-4aaf-ad24-b30488c4e472 from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 05:48:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 05:48:46 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:48:46 user nova-compute[75083]:   <source dev="/dev/sdl"/>
Nov 29 05:48:46 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:48:46 user nova-compute[75083]:   <serial>9756f050-c5b1-4427-963b-f92f8e9fad8e</serial>
Nov 29 05:48:46 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 05:48:46 user nova-compute[75083]: </disk>
Nov 29 05:48:46 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:48:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '26431623763313038', 'path': '/dev/sdm'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431623763313038', 'path': '/dev/sdm'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:48:46 user nova-compute[75083]: DEBUG nova.objects.instance [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Lazy-loading 'flavor' on Instance uuid ae18699b-d0cf-44b5-8467-a112fd154580 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 12989829-1b4c-4aaf-ad24-b30488c4e472 {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 05:48:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:48:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] COPY block job progress, current cursor: 176160768 final cursor: 1073741824 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:48:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] COPY block job progress, current cursor: 321912832 final cursor: 1073741824 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:48:48 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] COPY block job progress, current cursor: 507510784 final cursor: 1073741824 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:48:48 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] COPY block job progress, current cursor: 610271232 final cursor: 1073741824 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:48:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] COPY block job progress, current cursor: 785383424 final cursor: 1073741824 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:48:49 user nova-compute[75083]: DEBUG nova.compute.manager [req-994ee4d3-a909-4926-b861-87dbdc6c7b6d req-a6ab267a-5354-44a1-a8c9-a02968ee505c service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-changed-750d3bad-3dc1-4a84-afd5-39f7d814da39 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:49 user nova-compute[75083]: DEBUG nova.compute.manager [req-994ee4d3-a909-4926-b861-87dbdc6c7b6d req-a6ab267a-5354-44a1-a8c9-a02968ee505c service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Refreshing instance network info cache due to event network-changed-750d3bad-3dc1-4a84-afd5-39f7d814da39. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:48:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-994ee4d3-a909-4926-b861-87dbdc6c7b6d req-a6ab267a-5354-44a1-a8c9-a02968ee505c service nova] Acquiring lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:48:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-994ee4d3-a909-4926-b861-87dbdc6c7b6d req-a6ab267a-5354-44a1-a8c9-a02968ee505c service nova] Acquired lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:48:49 user nova-compute[75083]: DEBUG nova.network.neutron [req-994ee4d3-a909-4926-b861-87dbdc6c7b6d req-a6ab267a-5354-44a1-a8c9-a02968ee505c service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Refreshing network info cache for port 750d3bad-3dc1-4a84-afd5-39f7d814da39 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:48:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] COPY block job progress, current cursor: 943718400 final cursor: 1073741824 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG nova.compute.manager [req-9ce0eb8a-2008-4acc-95ff-f1f4e8ee0768 req-780863de-a9c3-444b-88f8-5e51bf5e0932 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-changed-91851640-12fe-4910-bc52-dd499dfcb1cf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG nova.compute.manager [req-9ce0eb8a-2008-4acc-95ff-f1f4e8ee0768 req-780863de-a9c3-444b-88f8-5e51bf5e0932 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Refreshing instance network info cache due to event network-changed-91851640-12fe-4910-bc52-dd499dfcb1cf. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9ce0eb8a-2008-4acc-95ff-f1f4e8ee0768 req-780863de-a9c3-444b-88f8-5e51bf5e0932 service nova] Acquiring lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9ce0eb8a-2008-4acc-95ff-f1f4e8ee0768 req-780863de-a9c3-444b-88f8-5e51bf5e0932 service nova] Acquired lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG nova.network.neutron [req-9ce0eb8a-2008-4acc-95ff-f1f4e8ee0768 req-780863de-a9c3-444b-88f8-5e51bf5e0932 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Refreshing network info cache for port 91851640-12fe-4910-bc52-dd499dfcb1cf {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG nova.network.neutron [req-994ee4d3-a909-4926-b861-87dbdc6c7b6d req-a6ab267a-5354-44a1-a8c9-a02968ee505c service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Updated VIF entry in instance network info cache for port 750d3bad-3dc1-4a84-afd5-39f7d814da39. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG nova.network.neutron [req-994ee4d3-a909-4926-b861-87dbdc6c7b6d req-a6ab267a-5354-44a1-a8c9-a02968ee505c service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Updating instance_info_cache with network_info: [{"id": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "address": "fa:16:3e:a9:ac:51", "network": {"id": "9c8a8302-51cb-4107-940f-b5f511d6a9d0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908598171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap750d3bad-3d", "ovs_interfaceid": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1323b7f9-c161-4943-8cf4-123982ca7348", "address": "fa:16:3e:cb:bc:b7", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1323b7f9-c1", "ovs_interfaceid": "1323b7f9-c161-4943-8cf4-123982ca7348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "807ff050-85ba-4543-9516-95ffb6235f90", "address": "fa:16:3e:47:bd:de", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807ff050-85", "ovs_interfaceid": "807ff050-85ba-4543-9516-95ffb6235f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd6b4eda-d093-4ed5-b230-acca120a8213", "address": "fa:16:3e:e4:98:4b", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6b4eda-d0", "ovs_interfaceid": "dd6b4eda-d093-4ed5-b230-acca120a8213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "address": "fa:16:3e:8c:e2:17", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283e3943-59", "ovs_interfaceid": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d92f1220-3106-4729-91df-22000fd2a29a", "address": "fa:16:3e:1a:77:de", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92f1220-31", "ovs_interfaceid": "d92f1220-3106-4729-91df-22000fd2a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "address": "fa:16:3e:f8:e7:46", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90d0fc0-64", "ovs_interfaceid": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-994ee4d3-a909-4926-b861-87dbdc6c7b6d req-a6ab267a-5354-44a1-a8c9-a02968ee505c service nova] Releasing lock "refresh_cache-0f45ac21-017c-4247-b2ae-756ae1c12911" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viLUoyJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:50 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:50 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1678dbab-5ab8-4f97-bceb-92a67592e48c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:48:50 user nova-compute[75083]: No targets found.
Nov 29 05:48:50 user nova-compute[75083]: iSNS:
Nov 29 05:48:50 user nova-compute[75083]: No targets found.
Nov 29 05:48:50 user nova-compute[75083]: STATIC:
Nov 29 05:48:50 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193
Nov 29 05:48:50 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:50 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:50 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e
Nov 29 05:48:50 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:50 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:50 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113
Nov 29 05:48:50 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:50 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:50 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0
Nov 29 05:48:50 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:50 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:50 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3
Nov 29 05:48:50 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:50 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:50 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e
Nov 29 05:48:50 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:50 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:50 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c
Nov 29 05:48:50 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:50 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:50 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0
Nov 29 05:48:50 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:50 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:50 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a
Nov 29 05:48:50 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:50 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:50 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83
Nov 29 05:48:50 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:50 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:50 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780
Nov 29 05:48:50 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:50 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:50 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726
Nov 29 05:48:50 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:50 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:50 user nova-compute[75083]: FIRMWARE:
Nov 29 05:48:50 user nova-compute[75083]: No targets found.
Nov 29 05:48:50 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:48:50 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:48:50 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44cfcc3-b2db-46e5-84ca-8f3c0f0d2b17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG nova.network.neutron [req-9ce0eb8a-2008-4acc-95ff-f1f4e8ee0768 req-780863de-a9c3-444b-88f8-5e51bf5e0932 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Updated VIF entry in instance network info cache for port 91851640-12fe-4910-bc52-dd499dfcb1cf. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG nova.network.neutron [req-9ce0eb8a-2008-4acc-95ff-f1f4e8ee0768 req-780863de-a9c3-444b-88f8-5e51bf5e0932 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Updating instance_info_cache with network_info: [{"id": "91851640-12fe-4910-bc52-dd499dfcb1cf", "address": "fa:16:3e:09:eb:19", "network": {"id": "a5217202-1f29-4714-b72b-12e14124535a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2006028268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91851640-12", "ovs_interfaceid": "91851640-12fe-4910-bc52-dd499dfcb1cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3b24c5a-0012-4caa-ae37-f752635c9190", "address": "fa:16:3e:33:b9:fa", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b24c5a-00", "ovs_interfaceid": "b3b24c5a-0012-4caa-ae37-f752635c9190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "address": "fa:16:3e:81:a1:d8", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0d6e28-f2", "ovs_interfaceid": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "address": "fa:16:3e:95:7c:7d", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c8c3cf-ad", "ovs_interfaceid": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "address": "fa:16:3e:78:74:b7", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9cab68-94", "ovs_interfaceid": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "address": "fa:16:3e:d9:f8:79", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e0f5cbd-0d", "ovs_interfaceid": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4c3696b-581b-4f04-831a-44532362bf1b", "address": "fa:16:3e:cc:7e:83", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c3696b-58", "ovs_interfaceid": "f4c3696b-581b-4f04-831a-44532362bf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c29437-21e6-495e-a4bb-eadd8b1336cb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:50 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:50 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:50 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0d8119bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780'): ({'sdj'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Removing single pathed devices sdj {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9ce0eb8a-2008-4acc-95ff-f1f4e8ee0768 req-780863de-a9c3-444b-88f8-5e51bf5e0932 service nova] Releasing lock "refresh_cache-e8fe9965-822d-4058-a031-e71b5fb03db4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee4b424-8c1d-4836-aa50-4eb0a09a593e]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf8a4a5-b650-4ea6-9878-efd3f5ad8c23]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Flushing IO for device /dev/sdj {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a9da00-0e75-4545-a99a-9973af2ace90]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.042s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e989a19-6dce-4cbf-9e8c-ef4c7920d09c]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] SCSI volumes sdj have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5fcd95-0a9b-48d8-88a8-2ec40e415778]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7f6e73-a5b8-43fe-b6b0-cfde6af23023]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780, portal: 172.16.0.220,3260]
Nov 29 05:48:50 user nova-compute[75083]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780, portal: 172.16.0.220,3260] successful.
Nov 29 05:48:50 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9ef79c-4c35-4ac6-ab28-fdd9de82c749]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] <== disconnect_volume: return (378ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:48:51 user nova-compute[75083]: DEBUG nova.compute.manager [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voYpWmRj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, 'status': 'reserved', 'instance': 'ae18699b-d0cf-44b5-8467-a112fd154580', 'attached_at': '', 'detached_at': '', 'volume_id': 'bcdfc365-b96d-40ac-a012-96484a067113', 'serial'} {{(pid=75083) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 29 05:48:51 user nova-compute[75083]: DEBUG nova.compute.manager [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] swap_volume: removing Cinder connection for volume 74982c7f-1ac4-4d4f-b76c-521e310f1780 {{(pid=75083) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 29 05:48:51 user nova-compute[75083]: DEBUG nova.compute.manager [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] swap_volume: Updating volume 74982c7f-1ac4-4d4f-b76c-521e310f1780 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "voYpWmRj", "auth_password": "TP94JeOZoxkubd", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdm", "volume_id": "bcdfc365-b96d-40ac-a012-96484a067113"}, "status": "reserved", "instance": "ae18699b-d0cf-44b5-8467-a112fd154580", "attached_at": "", "detached_at": "", "volume_id": "bcdfc365-b96d-40ac-a012-96484a067113", "serial": "bcdfc365-b96d-40ac-a012-96484a067113"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'bcdfc365-b96d-40ac-a012-96484a067113', 'no_device': None, 'attachment_id': 'e4337fb3-3d17-4efa-8638-44d2d7dd4075'} {{(pid=75083) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 29 05:48:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-055d7066-e300-425d-951e-d92e877d7455 tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Lock "ae18699b-d0cf-44b5-8467-a112fd154580" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.241s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:52 user nova-compute[75083]: INFO nova.compute.manager [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Terminating instance
Nov 29 05:48:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Acquiring lock "ae18699b-d0cf-44b5-8467-a112fd154580" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Lock "ae18699b-d0cf-44b5-8467-a112fd154580" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG os_brick.utils [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[722161a6-1b83-406a-9ef7-90763b267bb9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93ebcc7-14c4-4164-947a-74007bd1008c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10b7d61-704c-40fb-9278-f3896172520f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8284fd56-b8ba-47bf-9fed-7fc9e0ff048e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:48:52 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b8642d-f674-42c2-8911-c5dcfbde6fa4]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:52 user nova-compute[75083]: INFO nova.compute.manager [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Terminating instance
Nov 29 05:48:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG os_brick.utils [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:52 user nova-compute[75083]: INFO nova.compute.manager [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Swapping volume bcdfc365-b96d-40ac-a012-96484a067113 for 74982c7f-1ac4-4d4f-b76c-521e310f1780
Nov 29 05:48:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG nova.compute.manager [req-5e03ae40-fbe6-46ce-aead-480eb55f9e1f req-8f37be29-0df3-4255-9ecb-c6740e93da0d service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-unplugged-750d3bad-3dc1-4a84-afd5-39f7d814da39 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e03ae40-fbe6-46ce-aead-480eb55f9e1f req-8f37be29-0df3-4255-9ecb-c6740e93da0d service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e03ae40-fbe6-46ce-aead-480eb55f9e1f req-8f37be29-0df3-4255-9ecb-c6740e93da0d service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e03ae40-fbe6-46ce-aead-480eb55f9e1f req-8f37be29-0df3-4255-9ecb-c6740e93da0d service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG nova.compute.manager [req-5e03ae40-fbe6-46ce-aead-480eb55f9e1f req-8f37be29-0df3-4255-9ecb-c6740e93da0d service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-unplugged-750d3bad-3dc1-4a84-afd5-39f7d814da39 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG nova.compute.manager [req-5e03ae40-fbe6-46ce-aead-480eb55f9e1f req-8f37be29-0df3-4255-9ecb-c6740e93da0d service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-unplugged-750d3bad-3dc1-4a84-afd5-39f7d814da39 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG nova.compute.manager [req-b469c151-eeb2-4a85-a83e-217438ad9478 req-e09e81e5-8af9-4ff7-8b03-57c99637cf01 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-unplugged-1323b7f9-c161-4943-8cf4-123982ca7348 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b469c151-eeb2-4a85-a83e-217438ad9478 req-e09e81e5-8af9-4ff7-8b03-57c99637cf01 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b469c151-eeb2-4a85-a83e-217438ad9478 req-e09e81e5-8af9-4ff7-8b03-57c99637cf01 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b469c151-eeb2-4a85-a83e-217438ad9478 req-e09e81e5-8af9-4ff7-8b03-57c99637cf01 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG nova.compute.manager [req-b469c151-eeb2-4a85-a83e-217438ad9478 req-e09e81e5-8af9-4ff7-8b03-57c99637cf01 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-unplugged-1323b7f9-c161-4943-8cf4-123982ca7348 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:52 user nova-compute[75083]: DEBUG nova.compute.manager [req-b469c151-eeb2-4a85-a83e-217438ad9478 req-e09e81e5-8af9-4ff7-8b03-57c99637cf01 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-unplugged-1323b7f9-c161-4943-8cf4-123982ca7348 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:48:53 user nova-compute[75083]: DEBUG nova.compute.manager [req-e003cc2e-1d1b-47de-a100-f032424239eb req-b2a43af0-725f-44cf-a87b-f345c15efcdf service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-unplugged-807ff050-85ba-4543-9516-95ffb6235f90 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e003cc2e-1d1b-47de-a100-f032424239eb req-b2a43af0-725f-44cf-a87b-f345c15efcdf service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e003cc2e-1d1b-47de-a100-f032424239eb req-b2a43af0-725f-44cf-a87b-f345c15efcdf service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e003cc2e-1d1b-47de-a100-f032424239eb req-b2a43af0-725f-44cf-a87b-f345c15efcdf service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:53 user nova-compute[75083]: DEBUG nova.compute.manager [req-e003cc2e-1d1b-47de-a100-f032424239eb req-b2a43af0-725f-44cf-a87b-f345c15efcdf service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-unplugged-807ff050-85ba-4543-9516-95ffb6235f90 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:53 user nova-compute[75083]: DEBUG nova.compute.manager [req-e003cc2e-1d1b-47de-a100-f032424239eb req-b2a43af0-725f-44cf-a87b-f345c15efcdf service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-unplugged-807ff050-85ba-4543-9516-95ffb6235f90 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:48:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:54 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 0414bda1-7b04-40ba-a693-44be9296e432 is timed out.
Nov 29 05:48:54 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Successfully detached device sdc from instance 0414bda1-7b04-40ba-a693-44be9296e432 from the live domain config.
Nov 29 05:48:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yAuTBSmh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:54 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:54 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0a573a-666f-4a68-84f0-476ec6e3de66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:48:54 user nova-compute[75083]: No targets found.
Nov 29 05:48:54 user nova-compute[75083]: iSNS:
Nov 29 05:48:54 user nova-compute[75083]: No targets found.
Nov 29 05:48:54 user nova-compute[75083]: STATIC:
Nov 29 05:48:54 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193
Nov 29 05:48:54 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:54 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:54 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e
Nov 29 05:48:54 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:54 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:54 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113
Nov 29 05:48:54 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:54 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:54 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0
Nov 29 05:48:54 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:54 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:54 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3
Nov 29 05:48:54 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:54 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:54 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e
Nov 29 05:48:54 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:54 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:54 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c
Nov 29 05:48:54 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:54 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:54 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0
Nov 29 05:48:54 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:54 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:54 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a
Nov 29 05:48:54 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:54 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:54 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83
Nov 29 05:48:54 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:54 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:54 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726
Nov 29 05:48:54 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:54 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:54 user nova-compute[75083]: FIRMWARE:
Nov 29 05:48:54 user nova-compute[75083]: No targets found.
Nov 29 05:48:54 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:48:54 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:48:54 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bd5804-9958-493a-bfe4-6ebcd4c25117]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.119s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4200905-7f5e-4e65-bfb7-afb56c19073e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:54 user nova-compute[75083]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:54 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:48:54 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:48:54 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:54 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:54 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:54 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:54 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:54 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:54 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:54 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 (non-flash)
Nov 29 05:48:54 user nova-compute[75083]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:54 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:48:54 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:48:54 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:54 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:54 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:54 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:54 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:54 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:54 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:54 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0e4f53880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193'): ({'sdh'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Removing single pathed devices sdh {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3cc461-1417-4733-8f1a-7b110ff5b465]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[93415c35-ab24-4097-a21b-c4c28882c9ef]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Flushing IO for device /dev/sdh {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[993ef75d-0cb8-4324-995f-ffa493a0cf3c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.211s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9795489f-70c2-48e5-b565-b044b8965392]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] SCSI volumes sdh have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23462616537373439', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_94fe1b53') {{(pid=86165) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 05:48:54 user nova-compute[75083]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23462616537373439
Nov 29 05:48:54 user nova-compute[75083]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_94fe1b53
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2533da8a-9c49-477c-8fa8-57ecc67eeef8]: (4, None) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f292ae-e3e7-4a3b-a600-f95f7556a7dd]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:54 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Instance destroyed successfully.
Nov 29 05:48:54 user nova-compute[75083]: DEBUG nova.objects.instance [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lazy-loading 'resources' on Instance uuid e8fe9965-822d-4058-a031-e71b5fb03db4 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:47:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:47:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91851640-12fe-4910-bc52-dd499dfcb1cf", "address": "fa:16:3e:09:eb:19", "network": {"id": "a5217202-1f29-4714-b72b-12e14124535a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2006028268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91851640-12", "ovs_interfaceid": "91851640-12fe-4910-bc52-dd499dfcb1cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "91851640-12fe-4910-bc52-dd499dfcb1cf", "address": "fa:16:3e:09:eb:19", "network": {"id": "a5217202-1f29-4714-b72b-12e14124535a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2006028268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91851640-12", "ovs_interfaceid": "91851640-12fe-4910-bc52-dd499dfcb1cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:eb:19,bridge_name='br-int',has_traffic_filtering=True,id=91851640-12fe-4910-bc52-dd499dfcb1cf,network=Network(a5217202-1f29-4714-b72b-12e14124535a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91851640-12') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG os_vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:eb:19,bridge_name='br-int',has_traffic_filtering=True,id=91851640-12fe-4910-bc52-dd499dfcb1cf,network=Network(a5217202-1f29-4714-b72b-12e14124535a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91851640-12') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91851640-12, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:54 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Instance destroyed successfully.
Nov 29 05:48:54 user nova-compute[75083]: DEBUG nova.objects.instance [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lazy-loading 'resources' on Instance uuid 0f45ac21-017c-4247-b2ae-756ae1c12911 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:47:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:47:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "address": "fa:16:3e:a9:ac:51", "network": {"id": "9c8a8302-51cb-4107-940f-b5f511d6a9d0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908598171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap750d3bad-3d", "ovs_interfaceid": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "address": "fa:16:3e:a9:ac:51", "network": {"id": "9c8a8302-51cb-4107-940f-b5f511d6a9d0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908598171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap750d3bad-3d", "ovs_interfaceid": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:ac:51,bridge_name='br-int',has_traffic_filtering=True,id=750d3bad-3dc1-4a84-afd5-39f7d814da39,network=Network(9c8a8302-51cb-4107-940f-b5f511d6a9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap750d3bad-3d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG os_vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:ac:51,bridge_name='br-int',has_traffic_filtering=True,id=750d3bad-3dc1-4a84-afd5-39f7d814da39,network=Network(9c8a8302-51cb-4107-940f-b5f511d6a9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap750d3bad-3d') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 --logout" returned: 0 in 0.109s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ff6047-26e4-4308-982e-e3c9edb655b4]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193, portal: 172.16.0.220,3260]
Nov 29 05:48:54 user nova-compute[75083]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193, portal: 172.16.0.220,3260] successful.
Nov 29 05:48:54 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:54 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-e12834aa-a95e-46d2-93b8-c9cc79d71d72 req-d377b7c6-50ee-4508-9127-159fcca00661 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-750d3bad-3dc1-4a84-afd5-39f7d814da39 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e12834aa-a95e-46d2-93b8-c9cc79d71d72 req-d377b7c6-50ee-4508-9127-159fcca00661 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e12834aa-a95e-46d2-93b8-c9cc79d71d72 req-d377b7c6-50ee-4508-9127-159fcca00661 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e12834aa-a95e-46d2-93b8-c9cc79d71d72 req-d377b7c6-50ee-4508-9127-159fcca00661 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-e12834aa-a95e-46d2-93b8-c9cc79d71d72 req-d377b7c6-50ee-4508-9127-159fcca00661 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-750d3bad-3dc1-4a84-afd5-39f7d814da39 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:55 user nova-compute[75083]: WARNING nova.compute.manager [req-e12834aa-a95e-46d2-93b8-c9cc79d71d72 req-d377b7c6-50ee-4508-9127-159fcca00661 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-750d3bad-3dc1-4a84-afd5-39f7d814da39 for instance with vm_state active and task_state deleting.
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1dc8da6-b493-4667-9f50-96f86b0f9193 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.067s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f654a5-ea1f-4bd3-b47d-6e069364db98]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-1323b7f9-c161-4943-8cf4-123982ca7348 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-1323b7f9-c161-4943-8cf4-123982ca7348 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:55 user nova-compute[75083]: WARNING nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-1323b7f9-c161-4943-8cf4-123982ca7348 for instance with vm_state active and task_state deleting.
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-unplugged-91851640-12fe-4910-bc52-dd499dfcb1cf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-unplugged-91851640-12fe-4910-bc52-dd499dfcb1cf {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-unplugged-91851640-12fe-4910-bc52-dd499dfcb1cf for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-91851640-12fe-4910-bc52-dd499dfcb1cf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-91851640-12fe-4910-bc52-dd499dfcb1cf {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:55 user nova-compute[75083]: WARNING nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-91851640-12fe-4910-bc52-dd499dfcb1cf for instance with vm_state active and task_state deleting.
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-unplugged-b3b24c5a-0012-4caa-ae37-f752635c9190 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-unplugged-b3b24c5a-0012-4caa-ae37-f752635c9190 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-unplugged-b3b24c5a-0012-4caa-ae37-f752635c9190 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-b3b24c5a-0012-4caa-ae37-f752635c9190 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-b3b24c5a-0012-4caa-ae37-f752635c9190 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:55 user nova-compute[75083]: WARNING nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-b3b24c5a-0012-4caa-ae37-f752635c9190 for instance with vm_state active and task_state deleting.
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-unplugged-dd6b4eda-d093-4ed5-b230-acca120a8213 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-unplugged-dd6b4eda-d093-4ed5-b230-acca120a8213 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-unplugged-dd6b4eda-d093-4ed5-b230-acca120a8213 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-dd6b4eda-d093-4ed5-b230-acca120a8213 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-dd6b4eda-d093-4ed5-b230-acca120a8213 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:55 user nova-compute[75083]: WARNING nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-dd6b4eda-d093-4ed5-b230-acca120a8213 for instance with vm_state active and task_state deleting.
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-unplugged-d92f1220-3106-4729-91df-22000fd2a29a {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-unplugged-d92f1220-3106-4729-91df-22000fd2a29a {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-8f96075f-0888-45fc-9059-a5ff02513612 req-e5a01aa9-772f-4815-8790-13479ffe6ed2 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-unplugged-d92f1220-3106-4729-91df-22000fd2a29a for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.838s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] <== disconnect_volume: return (840ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap750d3bad-3d, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-807ff050-85ba-4543-9516-95ffb6235f90 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-807ff050-85ba-4543-9516-95ffb6235f90 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:55 user nova-compute[75083]: WARNING nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-807ff050-85ba-4543-9516-95ffb6235f90 for instance with vm_state active and task_state deleting.
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-unplugged-283e3943-59e6-4eb2-8485-64e0cc08b4ed {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-unplugged-283e3943-59e6-4eb2-8485-64e0cc08b4ed {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-unplugged-283e3943-59e6-4eb2-8485-64e0cc08b4ed for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-283e3943-59e6-4eb2-8485-64e0cc08b4ed {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-283e3943-59e6-4eb2-8485-64e0cc08b4ed {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:55 user nova-compute[75083]: WARNING nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-283e3943-59e6-4eb2-8485-64e0cc08b4ed for instance with vm_state active and task_state deleting.
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-unplugged-0e0f5cbd-0d8d-40f8-949e-b6ae380534b2 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-unplugged-0e0f5cbd-0d8d-40f8-949e-b6ae380534b2 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-unplugged-0e0f5cbd-0d8d-40f8-949e-b6ae380534b2 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-0e0f5cbd-0d8d-40f8-949e-b6ae380534b2 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-0e0f5cbd-0d8d-40f8-949e-b6ae380534b2 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:55 user nova-compute[75083]: WARNING nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-0e0f5cbd-0d8d-40f8-949e-b6ae380534b2 for instance with vm_state active and task_state deleting.
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-unplugged-c90d0fc0-6432-4f98-8295-af931e20e0b5 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-unplugged-c90d0fc0-6432-4f98-8295-af931e20e0b5 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-unplugged-c90d0fc0-6432-4f98-8295-af931e20e0b5 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-c90d0fc0-6432-4f98-8295-af931e20e0b5 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-c90d0fc0-6432-4f98-8295-af931e20e0b5 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:55 user nova-compute[75083]: WARNING nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-c90d0fc0-6432-4f98-8295-af931e20e0b5 for instance with vm_state active and task_state deleting.
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-unplugged-f4c3696b-581b-4f04-831a-44532362bf1b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-unplugged-f4c3696b-581b-4f04-831a-44532362bf1b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-unplugged-f4c3696b-581b-4f04-831a-44532362bf1b for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-f4c3696b-581b-4f04-831a-44532362bf1b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-f4c3696b-581b-4f04-831a-44532362bf1b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:55 user nova-compute[75083]: WARNING nova.compute.manager [req-53b5db6b-c41c-4cd8-bb12-24d66a7984b9 req-0f1abe1a-e862-4679-830e-12e919e49903 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-f4c3696b-581b-4f04-831a-44532362bf1b for instance with vm_state active and task_state deleting.
Nov 29 05:48:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f72a47b2-01bb-44d5-8b12-23e1eaabb1ce) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6fdd8f8f-8ec5-4f9a-965e-e88abab6163d) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 05:48:55 user nova-compute[75083]: INFO os_vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:eb:19,bridge_name='br-int',has_traffic_filtering=True,id=91851640-12fe-4910-bc52-dd499dfcb1cf,network=Network(a5217202-1f29-4714-b72b-12e14124535a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91851640-12')
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:47:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:47:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3b24c5a-0012-4caa-ae37-f752635c9190", "address": "fa:16:3e:33:b9:fa", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b24c5a-00", "ovs_interfaceid": "b3b24c5a-0012-4caa-ae37-f752635c9190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "b3b24c5a-0012-4caa-ae37-f752635c9190", "address": "fa:16:3e:33:b9:fa", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b24c5a-00", "ovs_interfaceid": "b3b24c5a-0012-4caa-ae37-f752635c9190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:b9:fa,bridge_name='br-int',has_traffic_filtering=True,id=b3b24c5a-0012-4caa-ae37-f752635c9190,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3b24c5a-00') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG os_vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:b9:fa,bridge_name='br-int',has_traffic_filtering=True,id=b3b24c5a-0012-4caa-ae37-f752635c9190,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3b24c5a-00') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3b24c5a-00, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:55 user nova-compute[75083]: INFO os_vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:ac:51,bridge_name='br-int',has_traffic_filtering=True,id=750d3bad-3dc1-4a84-afd5-39f7d814da39,network=Network(9c8a8302-51cb-4107-940f-b5f511d6a9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap750d3bad-3d')
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:47:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:47:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1323b7f9-c161-4943-8cf4-123982ca7348", "address": "fa:16:3e:cb:bc:b7", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1323b7f9-c1", "ovs_interfaceid": "1323b7f9-c161-4943-8cf4-123982ca7348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "1323b7f9-c161-4943-8cf4-123982ca7348", "address": "fa:16:3e:cb:bc:b7", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1323b7f9-c1", "ovs_interfaceid": "1323b7f9-c161-4943-8cf4-123982ca7348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:bc:b7,bridge_name='br-int',has_traffic_filtering=True,id=1323b7f9-c161-4943-8cf4-123982ca7348,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1323b7f9-c1') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG os_vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:bc:b7,bridge_name='br-int',has_traffic_filtering=True,id=1323b7f9-c161-4943-8cf4-123982ca7348,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1323b7f9-c1') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:48:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1323b7f9-c1, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Updating instance_info_cache with network_info: [{"id": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "address": "fa:16:3e:76:b7:47", "network": {"id": "0e6492fc-5e8d-4df7-8fac-2da472312c4d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d625d0d60faf4a4f9073df250039f58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ddf4bb-5d", "ovs_interfaceid": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7eb7f03c-4679-4a2e-ac6a-02a0ce243a7c) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG nova.objects.instance [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lazy-loading 'flavor' on Instance uuid 0414bda1-7b04-40ba-a693-44be9296e432 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-560b76a0-4620-47d9-9254-cddb031e761d tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "0414bda1-7b04-40ba-a693-44be9296e432" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.709s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec74283f-6db8-4f5e-8ffe-878bd7f3ba02) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: INFO os_vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:b9:fa,bridge_name='br-int',has_traffic_filtering=True,id=b3b24c5a-0012-4caa-ae37-f752635c9190,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3b24c5a-00')
Nov 29 05:48:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:47:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:47:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "address": "fa:16:3e:81:a1:d8", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0d6e28-f2", "ovs_interfaceid": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "address": "fa:16:3e:81:a1:d8", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0d6e28-f2", "ovs_interfaceid": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=af0d6e28-f22d-43b7-ba2e-147fcc449a18,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf0d6e28-f2') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG os_vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=af0d6e28-f22d-43b7-ba2e-147fcc449a18,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf0d6e28-f2') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf0d6e28-f2, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: INFO os_vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:bc:b7,bridge_name='br-int',has_traffic_filtering=True,id=1323b7f9-c161-4943-8cf4-123982ca7348,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1323b7f9-c1')
Nov 29 05:48:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:47:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:47:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "807ff050-85ba-4543-9516-95ffb6235f90", "address": "fa:16:3e:47:bd:de", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807ff050-85", "ovs_interfaceid": "807ff050-85ba-4543-9516-95ffb6235f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "807ff050-85ba-4543-9516-95ffb6235f90", "address": "fa:16:3e:47:bd:de", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807ff050-85", "ovs_interfaceid": "807ff050-85ba-4543-9516-95ffb6235f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=807ff050-85ba-4543-9516-95ffb6235f90,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap807ff050-85') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG os_vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=807ff050-85ba-4543-9516-95ffb6235f90,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap807ff050-85') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap807ff050-85, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db95cf17-11ad-4732-8181-82b84b8c41c7) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=110a1c40-63f5-4074-9011-1ed36463e3b4) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:56 user nova-compute[75083]: INFO os_vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=af0d6e28-f22d-43b7-ba2e-147fcc449a18,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf0d6e28-f2')
Nov 29 05:48:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:47:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:47:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "address": "fa:16:3e:95:7c:7d", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c8c3cf-ad", "ovs_interfaceid": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "address": "fa:16:3e:95:7c:7d", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c8c3cf-ad", "ovs_interfaceid": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:7c:7d,bridge_name='br-int',has_traffic_filtering=True,id=a8c8c3cf-ad69-4ba6-81cd-aed9289bc816,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c8c3cf-ad') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG os_vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:7c:7d,bridge_name='br-int',has_traffic_filtering=True,id=a8c8c3cf-ad69-4ba6-81cd-aed9289bc816,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c8c3cf-ad') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8c8c3cf-ad, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:56 user nova-compute[75083]: INFO os_vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=807ff050-85ba-4543-9516-95ffb6235f90,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap807ff050-85')
Nov 29 05:48:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:47:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:47:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd6b4eda-d093-4ed5-b230-acca120a8213", "address": "fa:16:3e:e4:98:4b", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6b4eda-d0", "ovs_interfaceid": "dd6b4eda-d093-4ed5-b230-acca120a8213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "dd6b4eda-d093-4ed5-b230-acca120a8213", "address": "fa:16:3e:e4:98:4b", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6b4eda-d0", "ovs_interfaceid": "dd6b4eda-d093-4ed5-b230-acca120a8213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:98:4b,bridge_name='br-int',has_traffic_filtering=True,id=dd6b4eda-d093-4ed5-b230-acca120a8213,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6b4eda-d0') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG os_vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:98:4b,bridge_name='br-int',has_traffic_filtering=True,id=dd6b4eda-d093-4ed5-b230-acca120a8213,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6b4eda-d0') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd6b4eda-d0, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b2c304f-a782-4013-a532-bd4a3dfac26c) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=717a80fc-9e2c-4572-857f-0489504dbf8b) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: INFO os_vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:7c:7d,bridge_name='br-int',has_traffic_filtering=True,id=a8c8c3cf-ad69-4ba6-81cd-aed9289bc816,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c8c3cf-ad')
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:47:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:47:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "address": "fa:16:3e:78:74:b7", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9cab68-94", "ovs_interfaceid": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "address": "fa:16:3e:78:74:b7", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9cab68-94", "ovs_interfaceid": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=ed9cab68-946e-4ed5-87d7-4f73c2f82ac2,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9cab68-94') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG os_vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=ed9cab68-946e-4ed5-87d7-4f73c2f82ac2,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9cab68-94') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-plugged-d92f1220-3106-4729-91df-22000fd2a29a {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Acquiring lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] No waiting events found dispatching network-vif-plugged-d92f1220-3106-4729-91df-22000fd2a29a {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:57 user nova-compute[75083]: WARNING nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received unexpected event network-vif-plugged-d92f1220-3106-4729-91df-22000fd2a29a for instance with vm_state active and task_state deleting.
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-unplugged-a8c8c3cf-ad69-4ba6-81cd-aed9289bc816 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-unplugged-a8c8c3cf-ad69-4ba6-81cd-aed9289bc816 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-unplugged-a8c8c3cf-ad69-4ba6-81cd-aed9289bc816 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-a8c8c3cf-ad69-4ba6-81cd-aed9289bc816 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-a8c8c3cf-ad69-4ba6-81cd-aed9289bc816 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:57 user nova-compute[75083]: WARNING nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-a8c8c3cf-ad69-4ba6-81cd-aed9289bc816 for instance with vm_state active and task_state deleting.
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-unplugged-af0d6e28-f22d-43b7-ba2e-147fcc449a18 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-unplugged-af0d6e28-f22d-43b7-ba2e-147fcc449a18 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-unplugged-af0d6e28-f22d-43b7-ba2e-147fcc449a18 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-af0d6e28-f22d-43b7-ba2e-147fcc449a18 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-af0d6e28-f22d-43b7-ba2e-147fcc449a18 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:57 user nova-compute[75083]: WARNING nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-af0d6e28-f22d-43b7-ba2e-147fcc449a18 for instance with vm_state active and task_state deleting.
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-unplugged-ed9cab68-946e-4ed5-87d7-4f73c2f82ac2 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-unplugged-ed9cab68-946e-4ed5-87d7-4f73c2f82ac2 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-unplugged-ed9cab68-946e-4ed5-87d7-4f73c2f82ac2 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-plugged-ed9cab68-946e-4ed5-87d7-4f73c2f82ac2 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Acquiring lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] No waiting events found dispatching network-vif-plugged-ed9cab68-946e-4ed5-87d7-4f73c2f82ac2 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:57 user nova-compute[75083]: WARNING nova.compute.manager [req-511661b6-4703-44ba-bdc0-21550de56858 req-0f6d0fbe-a6cd-483f-8b9b-145225fb5498 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received unexpected event network-vif-plugged-ed9cab68-946e-4ed5-87d7-4f73c2f82ac2 for instance with vm_state active and task_state deleting.
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped9cab68-94, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:57 user nova-compute[75083]: INFO os_vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:98:4b,bridge_name='br-int',has_traffic_filtering=True,id=dd6b4eda-d093-4ed5-b230-acca120a8213,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6b4eda-d0')
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:47:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:47:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "address": "fa:16:3e:8c:e2:17", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283e3943-59", "ovs_interfaceid": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "address": "fa:16:3e:8c:e2:17", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283e3943-59", "ovs_interfaceid": "283e3943-59e6-4eb2-8485-64e0cc08b4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e2:17,bridge_name='br-int',has_traffic_filtering=True,id=283e3943-59e6-4eb2-8485-64e0cc08b4ed,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283e3943-59') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG os_vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e2:17,bridge_name='br-int',has_traffic_filtering=True,id=283e3943-59e6-4eb2-8485-64e0cc08b4ed,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283e3943-59') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap283e3943-59, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26d01193-cb0b-400d-b4f2-424363ca4a1b) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ef9518e-a04d-4d14-a295-d5f51be3d788) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: INFO os_vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=ed9cab68-946e-4ed5-87d7-4f73c2f82ac2,network=Network(8c731c2c-3bf6-4025-853d-e23e4f91a530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9cab68-94')
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:47:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:47:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "address": "fa:16:3e:d9:f8:79", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e0f5cbd-0d", "ovs_interfaceid": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "address": "fa:16:3e:d9:f8:79", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e0f5cbd-0d", "ovs_interfaceid": "0e0f5cbd-0d8d-40f8-949e-b6ae380534b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f8:79,bridge_name='br-int',has_traffic_filtering=True,id=0e0f5cbd-0d8d-40f8-949e-b6ae380534b2,network=Network(e24a73c3-29b8-48bb-8fc0-caed6df02191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e0f5cbd-0d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG os_vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f8:79,bridge_name='br-int',has_traffic_filtering=True,id=0e0f5cbd-0d8d-40f8-949e-b6ae380534b2,network=Network(e24a73c3-29b8-48bb-8fc0-caed6df02191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e0f5cbd-0d') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e0f5cbd-0d, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:57 user nova-compute[75083]: INFO os_vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e2:17,bridge_name='br-int',has_traffic_filtering=True,id=283e3943-59e6-4eb2-8485-64e0cc08b4ed,network=Network(2fd8f8ef-cddb-47b9-a563-ec9270a13b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283e3943-59')
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:47:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:47:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d92f1220-3106-4729-91df-22000fd2a29a", "address": "fa:16:3e:1a:77:de", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92f1220-31", "ovs_interfaceid": "d92f1220-3106-4729-91df-22000fd2a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "d92f1220-3106-4729-91df-22000fd2a29a", "address": "fa:16:3e:1a:77:de", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92f1220-31", "ovs_interfaceid": "d92f1220-3106-4729-91df-22000fd2a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:77:de,bridge_name='br-int',has_traffic_filtering=True,id=d92f1220-3106-4729-91df-22000fd2a29a,network=Network(979d0619-d0b6-485f-b7ea-251b510e7647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92f1220-31') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG os_vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:77:de,bridge_name='br-int',has_traffic_filtering=True,id=d92f1220-3106-4729-91df-22000fd2a29a,network=Network(979d0619-d0b6-485f-b7ea-251b510e7647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92f1220-31') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd92f1220-31, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1192b82a-8080-46d7-96d8-f36f526c80ba) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e737d3f4-6869-4526-9bbb-e72f29a63a7f) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: INFO os_vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f8:79,bridge_name='br-int',has_traffic_filtering=True,id=0e0f5cbd-0d8d-40f8-949e-b6ae380534b2,network=Network(e24a73c3-29b8-48bb-8fc0-caed6df02191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e0f5cbd-0d')
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-415790641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-415790641',id=11,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHdyTIVOVL+MQJfnjBH1Vl3SAR1haM7nM1gue8PFMcFW1pCmyaxDfUi3tQC42XHofrCV1q1W4vYQuk63qQJ9sytkILYJDmi8inYU1x7XEk5K7rt2saZ5h4OTh/Xywt2w==',key_name='tempest-keypair-464626979',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:47:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66d83eb8afd744209d2f156412f867b8',ramdisk_id='',reservation_id='r-j9og1pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-761712321',owner_user_name='tempest-TaggedBootDevicesTest_v242-761712321-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:47:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72c70230bafc432daad785bc45c76f82',uuid=e8fe9965-822d-4058-a031-e71b5fb03db4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4c3696b-581b-4f04-831a-44532362bf1b", "address": "fa:16:3e:cc:7e:83", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c3696b-58", "ovs_interfaceid": "f4c3696b-581b-4f04-831a-44532362bf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converting VIF {"id": "f4c3696b-581b-4f04-831a-44532362bf1b", "address": "fa:16:3e:cc:7e:83", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c3696b-58", "ovs_interfaceid": "f4c3696b-581b-4f04-831a-44532362bf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:7e:83,bridge_name='br-int',has_traffic_filtering=True,id=f4c3696b-581b-4f04-831a-44532362bf1b,network=Network(e24a73c3-29b8-48bb-8fc0-caed6df02191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4c3696b-58') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG os_vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:7e:83,bridge_name='br-int',has_traffic_filtering=True,id=f4c3696b-581b-4f04-831a-44532362bf1b,network=Network(e24a73c3-29b8-48bb-8fc0-caed6df02191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4c3696b-58') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Acquiring lock "0414bda1-7b04-40ba-a693-44be9296e432" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "0414bda1-7b04-40ba-a693-44be9296e432" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Acquiring lock "0414bda1-7b04-40ba-a693-44be9296e432-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "0414bda1-7b04-40ba-a693-44be9296e432-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "0414bda1-7b04-40ba-a693-44be9296e432-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:57 user nova-compute[75083]: INFO nova.compute.manager [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Terminating instance
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4c3696b-58, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: INFO os_vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:77:de,bridge_name='br-int',has_traffic_filtering=True,id=d92f1220-3106-4729-91df-22000fd2a29a,network=Network(979d0619-d0b6-485f-b7ea-251b510e7647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92f1220-31')
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-161073125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-161073125',id=10,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL/4aJqjZOAdQzjpz4VE/fzol64zJ4GtYmyJbGPw4U+UAbro89Kyh0CHxgxz1rO5wiFRD30RmspQit4dKxpRDNsoc+9qgMChk7GpE82a0ma1K0YaTy5o0nqX78JDWbhnw==',key_name='tempest-keypair-1298104917',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:47:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b24f07ef08334fea827629fdf234ee0d',ramdisk_id='',reservation_id='r-ccnvm5em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1645506517',owner_user_name='tempest-TaggedBootDevicesTest-1645506517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:47:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac161fa6da3443a9d8201e0714b4fab',uuid=0f45ac21-017c-4247-b2ae-756ae1c12911,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "address": "fa:16:3e:f8:e7:46", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90d0fc0-64", "ovs_interfaceid": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converting VIF {"id": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "address": "fa:16:3e:f8:e7:46", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90d0fc0-64", "ovs_interfaceid": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e7:46,bridge_name='br-int',has_traffic_filtering=True,id=c90d0fc0-6432-4f98-8295-af931e20e0b5,network=Network(979d0619-d0b6-485f-b7ea-251b510e7647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc90d0fc0-64') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG os_vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e7:46,bridge_name='br-int',has_traffic_filtering=True,id=c90d0fc0-6432-4f98-8295-af931e20e0b5,network=Network(979d0619-d0b6-485f-b7ea-251b510e7647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc90d0fc0-64') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc90d0fc0-64, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=423d48ef-e31f-462f-b121-40b2caa99084) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4308af5b-292f-48ec-a959-ec4d40b91d0c) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:57 user nova-compute[75083]: INFO os_vif [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:7e:83,bridge_name='br-int',has_traffic_filtering=True,id=f4c3696b-581b-4f04-831a-44532362bf1b,network=Network(e24a73c3-29b8-48bb-8fc0-caed6df02191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4c3696b-58')
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBNWepYo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:57 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[503eb71e-f5c9-4c62-8a85-7189e0099ef2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:57 user nova-compute[75083]: INFO os_vif [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e7:46,bridge_name='br-int',has_traffic_filtering=True,id=c90d0fc0-6432-4f98-8295-af931e20e0b5,network=Network(979d0619-d0b6-485f-b7ea-251b510e7647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc90d0fc0-64')
Nov 29 05:48:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:48:57 user nova-compute[75083]: No targets found.
Nov 29 05:48:57 user nova-compute[75083]: iSNS:
Nov 29 05:48:57 user nova-compute[75083]: No targets found.
Nov 29 05:48:57 user nova-compute[75083]: STATIC:
Nov 29 05:48:57 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e
Nov 29 05:48:57 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:57 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:57 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113
Nov 29 05:48:57 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:57 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:57 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0
Nov 29 05:48:57 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:57 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:57 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3
Nov 29 05:48:57 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:57 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:57 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e
Nov 29 05:48:57 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:57 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:57 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c
Nov 29 05:48:57 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:57 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:57 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0
Nov 29 05:48:57 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:57 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:57 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a
Nov 29 05:48:57 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:57 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:57 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83
Nov 29 05:48:57 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:57 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:57 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726
Nov 29 05:48:57 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:57 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:57 user nova-compute[75083]: FIRMWARE:
Nov 29 05:48:57 user nova-compute[75083]: No targets found.
Nov 29 05:48:57 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:48:57 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:48:57 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lRBUOeED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:57 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdm (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2bbb6b-a444-4265-9f44-696f1ba05d27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bb7d04-61a9-4f09-bb37-9ca5e9e30aa0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:57 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:48:57 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:48:57 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:57 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:57 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:57 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:57 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:57 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:57 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:57 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:57 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:48:57 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:48:57 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:57 user nova-compute[75083]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 (non-flash)
Nov 29 05:48:57 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:57 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:57 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:57 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:57 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:57 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0d8336b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0'): ({'sdc'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Removing single pathed devices sdc {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1f4383-f631-4526-8e98-5771f2fd8ed3]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f3fa5b-20b0-4c1a-8096-8889c27d5b88]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Flushing IO for device /dev/sdc {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfb9fa5-aa8b-4980-8757-c5240b198a54]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-4041b1c5-24c6-465b-991b-457a51f7342e req-ef46b573-6dd6-4ca9-86d9-c4ce8f74f352 service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Received event network-vif-unplugged-6c418847-5bf6-4315-9acd-c743ce87f36c {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4041b1c5-24c6-465b-991b-457a51f7342e req-ef46b573-6dd6-4ca9-86d9-c4ce8f74f352 service nova] Acquiring lock "0414bda1-7b04-40ba-a693-44be9296e432-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4041b1c5-24c6-465b-991b-457a51f7342e req-ef46b573-6dd6-4ca9-86d9-c4ce8f74f352 service nova] Lock "0414bda1-7b04-40ba-a693-44be9296e432-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4041b1c5-24c6-465b-991b-457a51f7342e req-ef46b573-6dd6-4ca9-86d9-c4ce8f74f352 service nova] Lock "0414bda1-7b04-40ba-a693-44be9296e432-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-4041b1c5-24c6-465b-991b-457a51f7342e req-ef46b573-6dd6-4ca9-86d9-c4ce8f74f352 service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] No waiting events found dispatching network-vif-unplugged-6c418847-5bf6-4315-9acd-c743ce87f36c {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:48:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-4041b1c5-24c6-465b-991b-457a51f7342e req-ef46b573-6dd6-4ca9-86d9-c4ce8f74f352 service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Received event network-vif-unplugged-6c418847-5bf6-4315-9acd-c743ce87f36c for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[338694f3-bf98-4fb3-89b4-fa5ded17e6c3]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b11123-3177-4b12-beae-2d8bdc97f60a]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.130s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80c1bde-dd2c-4f23-87c1-d2c11f67ebe7]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0, portal: 172.16.0.220,3260]
Nov 29 05:48:58 user nova-compute[75083]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0, portal: 172.16.0.220,3260] successful.
Nov 29 05:48:58 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1bd378b-277c-40a6-9292-e87b013b8ba0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb945d5-acaa-48d8-ab61-976e14872404]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.527s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] <== disconnect_volume: return (529ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.498s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyfRpkZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:58 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[51505946-65bb-4379-80bf-ca8cc949b249]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:48:58 user nova-compute[75083]: No targets found.
Nov 29 05:48:58 user nova-compute[75083]: iSNS:
Nov 29 05:48:58 user nova-compute[75083]: No targets found.
Nov 29 05:48:58 user nova-compute[75083]: STATIC:
Nov 29 05:48:58 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e
Nov 29 05:48:58 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:58 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:58 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113
Nov 29 05:48:58 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:58 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:58 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3
Nov 29 05:48:58 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:58 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:58 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e
Nov 29 05:48:58 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:58 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:58 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c
Nov 29 05:48:58 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:58 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:58 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0
Nov 29 05:48:58 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:58 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:58 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a
Nov 29 05:48:58 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:58 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:58 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83
Nov 29 05:48:58 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:58 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:58 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726
Nov 29 05:48:58 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:58 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:58 user nova-compute[75083]: FIRMWARE:
Nov 29 05:48:58 user nova-compute[75083]: No targets found.
Nov 29 05:48:58 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:48:58 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:48:58 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1949ede0-4f39-4b8e-be0f-01366fc8d574]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9cef2e-2e92-49fd-8ca0-2e75e2ee871f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:58 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:58 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b84b3d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb32a7d-ccf2-41c3-9df2-fd63ef0e53ce]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5744ee-c2a9-42a9-ac04-d40d0f9e5ca8]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Instance destroyed successfully.
Nov 29 05:48:58 user nova-compute[75083]: DEBUG nova.objects.instance [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lazy-loading 'resources' on Instance uuid 0414bda1-7b04-40ba-a693-44be9296e432 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d0ece3-2eb3-47a3-b762-98c43ced5308]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1715263696',display_name='tempest-AttachSCSIVolumeTestJSON-server-1715263696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1715263696',id=6,image_ref='c330ac7c-34d0-450e-a72b-ff68dc5a30b7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvms4cikzQuDQW8pqrgdwdFezFpt6FWF0jGUwEBCo+8I6w+8L1lMkuuL2T4MkDHChLBHf7ipdiig9VroC/XdDIcOk4Z1uM9ny61ibIke1kx9EdGlSkyH2i0eXp2ZtTb1g==',key_name='tempest-keypair-258695651',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='471762377c1f451ab78d898e89ed83e0',ramdisk_id='',reservation_id='r-oz1f0zfh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c330ac7c-34d0-450e-a72b-ff68dc5a30b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1001448366',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1001448366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:46:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='107e2c95f7614188ba8edffa84a1314d',uuid=0414bda1-7b04-40ba-a693-44be9296e432,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c418847-5bf6-4315-9acd-c743ce87f36c", "address": "fa:16:3e:1e:c8:98", "network": {"id": "e5e61cc2-ec29-4baa-af6c-216f426467a4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-481090086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "471762377c1f451ab78d898e89ed83e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c418847-5b", "ovs_interfaceid": "6c418847-5bf6-4315-9acd-c743ce87f36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Converting VIF {"id": "6c418847-5bf6-4315-9acd-c743ce87f36c", "address": "fa:16:3e:1e:c8:98", "network": {"id": "e5e61cc2-ec29-4baa-af6c-216f426467a4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-481090086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "471762377c1f451ab78d898e89ed83e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c418847-5b", "ovs_interfaceid": "6c418847-5bf6-4315-9acd-c743ce87f36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:c8:98,bridge_name='br-int',has_traffic_filtering=True,id=6c418847-5bf6-4315-9acd-c743ce87f36c,network=Network(e5e61cc2-ec29-4baa-af6c-216f426467a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c418847-5b') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_vif [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:c8:98,bridge_name='br-int',has_traffic_filtering=True,id=6c418847-5bf6-4315-9acd-c743ce87f36c,network=Network(e5e61cc2-ec29-4baa-af6c-216f426467a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c418847-5b') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[223bee77-eb73-4a56-a934-9ce8062df0d2]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c418847-5b, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90b13ad8-b32a-47c0-9c08-1751bc78140a) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab38edda-b859-4b3d-b1d9-dde37fda1ae1]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:48:58 user nova-compute[75083]: INFO os_vif [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:c8:98,bridge_name='br-int',has_traffic_filtering=True,id=6c418847-5bf6-4315-9acd-c743ce87f36c,network=Network(e5e61cc2-ec29-4baa-af6c-216f426467a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c418847-5b')
Nov 29 05:48:58 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Deleting instance files /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432_del
Nov 29 05:48:58 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Deletion of /opt/stack/data/nova/instances/0414bda1-7b04-40ba-a693-44be9296e432_del complete
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03829df-0adb-4b31-b8fb-102fdf6fbd39]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c, portal: 172.16.0.220,3260]
Nov 29 05:48:58 user nova-compute[75083]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c, portal: 172.16.0.220,3260] successful.
Nov 29 05:48:58 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: INFO nova.compute.manager [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa95ada-7a3b-46fd-9ca0-b74053557a0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d90015-f3fd-448d-8f08-13f5e13a0265]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] <== disconnect_volume: return (895ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.403s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rOPflVUZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:58 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fe8617-64b4-4fe0-b139-8bf04e344d5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:48:58 user nova-compute[75083]: No targets found.
Nov 29 05:48:58 user nova-compute[75083]: iSNS:
Nov 29 05:48:58 user nova-compute[75083]: No targets found.
Nov 29 05:48:58 user nova-compute[75083]: STATIC:
Nov 29 05:48:58 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e
Nov 29 05:48:58 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:58 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:58 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113
Nov 29 05:48:58 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:58 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:58 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3
Nov 29 05:48:58 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:58 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:58 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e
Nov 29 05:48:58 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:58 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:58 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0
Nov 29 05:48:58 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:58 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:58 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a
Nov 29 05:48:58 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:58 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:58 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83
Nov 29 05:48:58 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:58 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:58 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726
Nov 29 05:48:58 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:58 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:58 user nova-compute[75083]: FIRMWARE:
Nov 29 05:48:58 user nova-compute[75083]: No targets found.
Nov 29 05:48:58 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:48:58 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:48:58 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3296ce24-0d4c-4460-b660-ba5a02aa611a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[731f6acd-8ccf-4df1-b995-ce53e9848c80]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:58 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:58 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:58 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b84b23b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83'): ({'sde'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Removing single pathed devices sde {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe0d2f1-d224-418e-a09a-93958e21b651]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2687a04d-3d54-4f6f-9bf2-7925c6abb3fb]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Flushing IO for device /dev/sde {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[08af7960-41aa-4daa-8caa-0beb522a231d]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfae38f-6a25-4fc4-937f-2c1b7d8c9e04]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] SCSI volumes sde have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc36ffb-9f42-412e-821d-dce7c8cd8d5a]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabf41f1-8a55-4dae-b3ee-c152365fa430]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83, portal: 172.16.0.220,3260]
Nov 29 05:48:59 user nova-compute[75083]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83, portal: 172.16.0.220,3260] successful.
Nov 29 05:48:59 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3950d96-ff2a-493d-8802-3ad5c9a7fd83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f0d154-4fcc-41f1-8a8b-4e28bb1cf19d]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] <== disconnect_volume: return (789ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.384s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmrQSZjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:59 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ce7521-cc20-42a2-9d05-b2422677d959]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:48:59 user nova-compute[75083]: No targets found.
Nov 29 05:48:59 user nova-compute[75083]: iSNS:
Nov 29 05:48:59 user nova-compute[75083]: No targets found.
Nov 29 05:48:59 user nova-compute[75083]: STATIC:
Nov 29 05:48:59 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e
Nov 29 05:48:59 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:59 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:59 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113
Nov 29 05:48:59 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:59 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:59 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3
Nov 29 05:48:59 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:59 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:59 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e
Nov 29 05:48:59 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:59 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:59 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0
Nov 29 05:48:59 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:59 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:59 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a
Nov 29 05:48:59 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:59 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:59 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726
Nov 29 05:48:59 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:59 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:59 user nova-compute[75083]: FIRMWARE:
Nov 29 05:48:59 user nova-compute[75083]: No targets found.
Nov 29 05:48:59 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:48:59 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:48:59 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92bf097-19c9-4697-afd9-cea961da36e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bcc68a-1091-4a0a-8250-95d949397c72]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:59 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:59 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0d8335b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a'): ({'sdd'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Removing single pathed devices sdd {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda1df2b-5d4c-4d83-938b-c7b7cecd49a3]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e08d9d-eab9-4495-adea-aee2a96903dc]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Flushing IO for device /dev/sdd {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[686c6841-2a3b-4af3-b2a3-b5a0592646a4]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e9b4d1-859b-458b-bd77-94dc8008a0f8]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] SCSI volumes sdd have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57e2863-04f7-4831-9159-efa63eae09a4]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[abebed0d-e89d-43ff-a671-a1367cbf8fbf]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a, portal: 172.16.0.220,3260]
Nov 29 05:48:59 user nova-compute[75083]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a, portal: 172.16.0.220,3260] successful.
Nov 29 05:48:59 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG nova.compute.manager [req-406ec6ab-6c4d-45f4-9b09-c2934f33939a req-6ceec1ec-3a2f-491e-b1ce-b1b25dc2da16 service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Received event network-vif-deleted-6c418847-5bf6-4315-9acd-c743ce87f36c {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:48:59 user nova-compute[75083]: INFO nova.compute.manager [req-406ec6ab-6c4d-45f4-9b09-c2934f33939a req-6ceec1ec-3a2f-491e-b1ce-b1b25dc2da16 service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Neutron deleted interface 6c418847-5bf6-4315-9acd-c743ce87f36c; detaching it from the instance and deleting it from the info cache
Nov 29 05:48:59 user nova-compute[75083]: DEBUG nova.network.neutron [req-406ec6ab-6c4d-45f4-9b09-c2934f33939a req-6ceec1ec-3a2f-491e-b1ce-b1b25dc2da16 service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:48:59 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:48:59 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:48:59 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=7887MB free_disk=25.44790267944336GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:48:59 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Took 1.21 seconds to deallocate network for instance.
Nov 29 05:48:59 user nova-compute[75083]: DEBUG nova.compute.manager [req-406ec6ab-6c4d-45f4-9b09-c2934f33939a req-6ceec1ec-3a2f-491e-b1ce-b1b25dc2da16 service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Detach interface failed, port_id=6c418847-5bf6-4315-9acd-c743ce87f36c, reason: Instance 0414bda1-7b04-40ba-a693-44be9296e432 could not be found. {{(pid=75083) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4de376-09fa-4938-bc93-e1c88d782b6a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d8ce5f-eac3-4041-aea0-f4b8ce62f559]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.760s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] <== disconnect_volume: return (1144ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.745s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISClvnpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:48:59 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1f1209-d54d-453d-bc9a-4f2c79905016]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:48:59 user nova-compute[75083]: No targets found.
Nov 29 05:48:59 user nova-compute[75083]: iSNS:
Nov 29 05:48:59 user nova-compute[75083]: No targets found.
Nov 29 05:48:59 user nova-compute[75083]: STATIC:
Nov 29 05:48:59 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e
Nov 29 05:48:59 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:59 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:59 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113
Nov 29 05:48:59 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:59 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:59 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3
Nov 29 05:48:59 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:59 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:59 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e
Nov 29 05:48:59 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:59 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:59 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0
Nov 29 05:48:59 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:59 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:59 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726
Nov 29 05:48:59 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:48:59 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:48:59 user nova-compute[75083]: FIRMWARE:
Nov 29 05:48:59 user nova-compute[75083]: No targets found.
Nov 29 05:48:59 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:48:59 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:48:59 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdca828-67cc-4212-8e93-259da9b018b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[87222ad8-e916-4669-b5a8-9a4f6f5fe02b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:59 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 (non-flash)
Nov 29 05:48:59 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:48:59 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0d83369e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3'): ({'sdg'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Removing single pathed devices sdg {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance e6d49806-cecd-473a-b92f-9255868d35c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance ee1bba24-17d0-4fc3-8bff-1337d86cc9be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 161c6455-90ce-4c40-a33e-7f582989135d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 0414bda1-7b04-40ba-a693-44be9296e432 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance ae18699b-d0cf-44b5-8467-a112fd154580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b2f88b2e-0244-4e18-98ae-21861b02db3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 12989829-1b4c-4aaf-ad24-b30488c4e472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 0f45ac21-017c-4247-b2ae-756ae1c12911 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance e8fe9965-822d-4058-a031-e71b5fb03db4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4dca39-a183-4608-a42c-548c0e346742]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc552a4-f82f-47af-afba-aee042d6bdc4]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Flushing IO for device /dev/sdg {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[925e73a4-b416-4fb0-a913-a19e679c6b91]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:48:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efaf949-5dd0-4e69-8d20-4cf1f1292215]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] SCSI volumes sdg have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG nova.compute.manager [req-3912df4f-387d-4934-bd2e-96af80f4ef44 req-02e937d2-8fa6-4d8d-ada7-758a6e7ef234 service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Received event network-vif-plugged-6c418847-5bf6-4315-9acd-c743ce87f36c {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3912df4f-387d-4934-bd2e-96af80f4ef44 req-02e937d2-8fa6-4d8d-ada7-758a6e7ef234 service nova] Acquiring lock "0414bda1-7b04-40ba-a693-44be9296e432-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3912df4f-387d-4934-bd2e-96af80f4ef44 req-02e937d2-8fa6-4d8d-ada7-758a6e7ef234 service nova] Lock "0414bda1-7b04-40ba-a693-44be9296e432-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3912df4f-387d-4934-bd2e-96af80f4ef44 req-02e937d2-8fa6-4d8d-ada7-758a6e7ef234 service nova] Lock "0414bda1-7b04-40ba-a693-44be9296e432-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG nova.compute.manager [req-3912df4f-387d-4934-bd2e-96af80f4ef44 req-02e937d2-8fa6-4d8d-ada7-758a6e7ef234 service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] No waiting events found dispatching network-vif-plugged-6c418847-5bf6-4315-9acd-c743ce87f36c {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:49:00 user nova-compute[75083]: WARNING nova.compute.manager [req-3912df4f-387d-4934-bd2e-96af80f4ef44 req-02e937d2-8fa6-4d8d-ada7-758a6e7ef234 service nova] [instance: 0414bda1-7b04-40ba-a693-44be9296e432] Received unexpected event network-vif-plugged-6c418847-5bf6-4315-9acd-c743ce87f36c for instance with vm_state deleted and task_state None.
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6deab7-f444-4ff4-b0ee-77991d5d49b6]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c699e5d-d546-41ae-9ba9-75f742c6654a]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3, portal: 172.16.0.220,3260]
Nov 29 05:49:00 user nova-compute[75083]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3, portal: 172.16.0.220,3260] successful.
Nov 29 05:49:00 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3114b1ca-f90b-44fa-9c49-fd3c8b7852a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[05202874-b1f5-4534-8d6f-3a60e68b64d2]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] <== disconnect_volume: return (1073ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:49:00 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Deleting instance files /opt/stack/data/nova/instances/e8fe9965-822d-4058-a031-e71b5fb03db4_del
Nov 29 05:49:00 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Deletion of /opt/stack/data/nova/instances/e8fe9965-822d-4058-a031-e71b5fb03db4_del complete
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.333s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ea035c-8481-4e87-a5c4-8e9d6aecd50e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:49:00 user nova-compute[75083]: No targets found.
Nov 29 05:49:00 user nova-compute[75083]: iSNS:
Nov 29 05:49:00 user nova-compute[75083]: No targets found.
Nov 29 05:49:00 user nova-compute[75083]: STATIC:
Nov 29 05:49:00 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e
Nov 29 05:49:00 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:49:00 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:49:00 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113
Nov 29 05:49:00 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:49:00 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:49:00 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e
Nov 29 05:49:00 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:49:00 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:49:00 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0
Nov 29 05:49:00 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:49:00 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:49:00 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726
Nov 29 05:49:00 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:49:00 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:49:00 user nova-compute[75083]: FIRMWARE:
Nov 29 05:49:00 user nova-compute[75083]: No targets found.
Nov 29 05:49:00 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:49:00 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:49:00 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee054c3b-342b-437a-a712-c36b67de30b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.355s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:00 user nova-compute[75083]: INFO nova.compute.manager [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Took 7.62 seconds to destroy the instance on the hypervisor.
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f91e202-3903-4b3f-8017-672e490d6d4f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:49:00 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:49:00 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:49:00 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:49:00 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:49:00 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:49:00 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:49:00 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:49:00 user nova-compute[75083]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 (non-flash)
Nov 29 05:49:00 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:49:00 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b84c3880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726'): ({'sdf'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Removing single pathed devices sdf {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c81fd67-61a7-4a1c-81e3-4084a261698f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[814d45a6-9ffc-4957-81c4-a19c91be964a]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Flushing IO for device /dev/sdf {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff1a70b-fbc6-4d26-b30f-854030519f25]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[360ef55f-e4b2-4ecc-b5e8-f78ade5c2025]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] SCSI volumes sdf have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb422956-bccc-4e1e-9cbb-ad015ce9d685]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cea360-562a-4e74-bddf-601ccf8306bb]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726, portal: 172.16.0.220,3260]
Nov 29 05:49:00 user nova-compute[75083]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726, portal: 172.16.0.220,3260] successful.
Nov 29 05:49:00 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d34edb-4d46-4cf7-8363-e5c6e623d726 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3c3790-9d1d-4bc4-b39b-b61bbecbeed9]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] <== disconnect_volume: return (656ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:49:00 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Deleting instance files /opt/stack/data/nova/instances/0f45ac21-017c-4247-b2ae-756ae1c12911_del
Nov 29 05:49:00 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Deletion of /opt/stack/data/nova/instances/0f45ac21-017c-4247-b2ae-756ae1c12911_del complete
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:00 user nova-compute[75083]: INFO nova.compute.manager [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Took 8.13 seconds to destroy the instance on the hypervisor.
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 05:49:00 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 05:49:00 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Deleted allocations for instance 0414bda1-7b04-40ba-a693-44be9296e432
Nov 29 05:49:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5786e575-8ca7-41a0-b17c-dd3a56fb0c42 tempest-AttachSCSIVolumeTestJSON-1001448366 tempest-AttachSCSIVolumeTestJSON-1001448366-project-member] Lock "0414bda1-7b04-40ba-a693-44be9296e432" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.032s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:01 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b2f88b2e-0244-4e18-98ae-21861b02db3a is timed out.
Nov 29 05:49:01 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Successfully detached device vdb from instance b2f88b2e-0244-4e18-98ae-21861b02db3a from the live domain config.
Nov 29 05:49:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HzyIPCAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:49:01 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:49:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b12a97d-5b56-482a-bb6e-32df5691fc2b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:49:01 user nova-compute[75083]: No targets found.
Nov 29 05:49:01 user nova-compute[75083]: iSNS:
Nov 29 05:49:01 user nova-compute[75083]: No targets found.
Nov 29 05:49:01 user nova-compute[75083]: STATIC:
Nov 29 05:49:01 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e
Nov 29 05:49:01 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:49:01 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:49:01 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113
Nov 29 05:49:01 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:49:01 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:49:01 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e
Nov 29 05:49:01 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:49:01 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:49:01 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0
Nov 29 05:49:01 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:49:01 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:49:01 user nova-compute[75083]: FIRMWARE:
Nov 29 05:49:01 user nova-compute[75083]: No targets found.
Nov 29 05:49:01 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:49:01 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:49:01 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd65eb8-ef56-4fed-864c-202ef8e84a18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f3217f-03d2-496c-8561-c5d2d3cc8dff]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:49:01 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:49:01 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:49:01 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:49:01 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 (non-flash)
Nov 29 05:49:01 user nova-compute[75083]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:49:01 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:49:01 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:49:01 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b84c3e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0'): ({'sdk'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Removing single pathed devices sdk {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d33c70-2816-4246-b8e4-94b393b65a03]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7676ea6e-2513-4cac-a4a5-31a4110aa9c8]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Flushing IO for device /dev/sdk {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2b2880-b3cd-4bfa-bc1a-c60533a0b882]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.037s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[de47d775-b5fd-4f79-98b2-43ca2dd9158f]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] SCSI volumes sdk have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ed9692-68be-4cce-b4aa-18b413eb1a6b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dd28d7-9897-43dc-a3fc-1827a5fff3b6]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0, portal: 172.16.0.220,3260]
Nov 29 05:49:01 user nova-compute[75083]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0, portal: 172.16.0.220,3260] successful.
Nov 29 05:49:01 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3126857d-d314-4ec6-90c7-aa46375c25b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddeca8c2-1154-4cd0-83a6-0e69142ce3d7]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] <== disconnect_volume: return (320ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG nova.compute.manager [req-9e883ae6-4b1f-484b-9e5f-c219cd16f693 req-0970f56c-cd27-4360-8e21-95e2b508cc54 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-deleted-0e0f5cbd-0d8d-40f8-949e-b6ae380534b2 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:49:01 user nova-compute[75083]: INFO nova.compute.manager [req-9e883ae6-4b1f-484b-9e5f-c219cd16f693 req-0970f56c-cd27-4360-8e21-95e2b508cc54 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Neutron deleted interface 0e0f5cbd-0d8d-40f8-949e-b6ae380534b2; detaching it from the instance and deleting it from the info cache
Nov 29 05:49:01 user nova-compute[75083]: DEBUG nova.network.neutron [req-9e883ae6-4b1f-484b-9e5f-c219cd16f693 req-0970f56c-cd27-4360-8e21-95e2b508cc54 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Updating instance_info_cache with network_info: [{"id": "91851640-12fe-4910-bc52-dd499dfcb1cf", "address": "fa:16:3e:09:eb:19", "network": {"id": "a5217202-1f29-4714-b72b-12e14124535a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2006028268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91851640-12", "ovs_interfaceid": "91851640-12fe-4910-bc52-dd499dfcb1cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3b24c5a-0012-4caa-ae37-f752635c9190", "address": "fa:16:3e:33:b9:fa", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b24c5a-00", "ovs_interfaceid": "b3b24c5a-0012-4caa-ae37-f752635c9190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "address": "fa:16:3e:81:a1:d8", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0d6e28-f2", "ovs_interfaceid": "af0d6e28-f22d-43b7-ba2e-147fcc449a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "address": "fa:16:3e:95:7c:7d", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c8c3cf-ad", "ovs_interfaceid": "a8c8c3cf-ad69-4ba6-81cd-aed9289bc816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "address": "fa:16:3e:78:74:b7", "network": {"id": "8c731c2c-3bf6-4025-853d-e23e4f91a530", "bridge": "br-int", "label": "tempest-device-tagging-net1-352508608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9cab68-94", "ovs_interfaceid": "ed9cab68-946e-4ed5-87d7-4f73c2f82ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4c3696b-581b-4f04-831a-44532362bf1b", "address": "fa:16:3e:cc:7e:83", "network": {"id": "e24a73c3-29b8-48bb-8fc0-caed6df02191", "bridge": "br-int", "label": "tempest-device-tagging-net2-1416480295", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66d83eb8afd744209d2f156412f867b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c3696b-58", "ovs_interfaceid": "f4c3696b-581b-4f04-831a-44532362bf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:49:01 user nova-compute[75083]: DEBUG nova.compute.manager [req-9e883ae6-4b1f-484b-9e5f-c219cd16f693 req-0970f56c-cd27-4360-8e21-95e2b508cc54 service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Detach interface failed, port_id=0e0f5cbd-0d8d-40f8-949e-b6ae380534b2, reason: Instance e8fe9965-822d-4058-a031-e71b5fb03db4 could not be found. {{(pid=75083) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG nova.compute.manager [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viLUoyJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ae18699b-d0cf-44b5-8467-a112fd154580', 'attached_at': '', 'detached_at': '', 'volume_id': '74982c7f-1ac4-4d4f-b76c-521e310f1780', 'serial': '74982c7f-1ac4-4d4f-b76c-521e310f1780'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voYpWmRj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm', 'volume_id': 'bcdfc365-b96d-40ac-a012-96484a067113'}, 'status': 'reserved', 'instance': 'ae18699b-d0cf-44b5-8467-a112fd154580', 'attached_at': '', 'detached_at': '', 'volume_id': 'bcdfc365-b96d-40ac-a012-96484a067113', 'serial'} {{(pid=75083) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viLUoyJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:49:02 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:49:02 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:49:02 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6137a6a0-b021-4bca-a31c-24bc919a4ce4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:49:02 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c20c1e-b24d-44a7-8507-4c5c7353f9a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780] added
Nov 29 05:49:02 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG nova.compute.manager [req-d69d1e8a-91c0-4ab6-9a37-7e098dc0679d req-4526c121-b96c-4870-b8f5-9baafb795d3e service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-deleted-283e3943-59e6-4eb2-8485-64e0cc08b4ed {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:49:02 user nova-compute[75083]: INFO nova.compute.manager [req-d69d1e8a-91c0-4ab6-9a37-7e098dc0679d req-4526c121-b96c-4870-b8f5-9baafb795d3e service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Neutron deleted interface 283e3943-59e6-4eb2-8485-64e0cc08b4ed; detaching it from the instance and deleting it from the info cache
Nov 29 05:49:02 user nova-compute[75083]: DEBUG nova.network.neutron [req-d69d1e8a-91c0-4ab6-9a37-7e098dc0679d req-4526c121-b96c-4870-b8f5-9baafb795d3e service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Updating instance_info_cache with network_info: [{"id": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "address": "fa:16:3e:a9:ac:51", "network": {"id": "9c8a8302-51cb-4107-940f-b5f511d6a9d0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908598171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap750d3bad-3d", "ovs_interfaceid": "750d3bad-3dc1-4a84-afd5-39f7d814da39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1323b7f9-c161-4943-8cf4-123982ca7348", "address": "fa:16:3e:cb:bc:b7", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1323b7f9-c1", "ovs_interfaceid": "1323b7f9-c161-4943-8cf4-123982ca7348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "807ff050-85ba-4543-9516-95ffb6235f90", "address": "fa:16:3e:47:bd:de", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807ff050-85", "ovs_interfaceid": "807ff050-85ba-4543-9516-95ffb6235f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd6b4eda-d093-4ed5-b230-acca120a8213", "address": "fa:16:3e:e4:98:4b", "network": {"id": "2fd8f8ef-cddb-47b9-a563-ec9270a13b98", "bridge": "br-int", "label": "tempest-device-tagging-net1-1430437777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6b4eda-d0", "ovs_interfaceid": "dd6b4eda-d093-4ed5-b230-acca120a8213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d92f1220-3106-4729-91df-22000fd2a29a", "address": "fa:16:3e:1a:77:de", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92f1220-31", "ovs_interfaceid": "d92f1220-3106-4729-91df-22000fd2a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "address": "fa:16:3e:f8:e7:46", "network": {"id": "979d0619-d0b6-485f-b7ea-251b510e7647", "bridge": "br-int", "label": "tempest-device-tagging-net2-209268005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b24f07ef08334fea827629fdf234ee0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90d0fc0-64", "ovs_interfaceid": "c90d0fc0-6432-4f98-8295-af931e20e0b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b42e4f-02b7-4f24-b803-0ffbf782488c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1535627a-408a-40ee-b800-b18c11c8605c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v viLUoyJT {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG nova.compute.manager [req-d69d1e8a-91c0-4ab6-9a37-7e098dc0679d req-4526c121-b96c-4870-b8f5-9baafb795d3e service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Detach interface failed, port_id=283e3943-59e6-4eb2-8485-64e0cc08b4ed, reason: Instance 0f45ac21-017c-4247-b2ae-756ae1c12911 could not be found. {{(pid=75083) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v viLUoyJT" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[95284eb9-4959-4bca-baa7-2ad9dce485fc]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'viLUoyJT'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[335f7d7d-9a9b-4b71-b884-b53d9b71d0fb]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d9f4e4-462d-418c-8979-fd785368fb8e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:49:02 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:49:02 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:49:02 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:49:02 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:49:02 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:49:02 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cc2fc7-6f99-4303-8ffe-b915bcd31b41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780, portal: 172.16.0.220,3260]
Nov 29 05:49:02 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780, portal: 172.16.0.220,3260] successful.
Nov 29 05:49:02 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c06b682-4896-424c-b6d3-26b0d38d0823]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5df8b99-5f6f-4b9c-a6ac-383dc19fa44a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:49:02 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:49:02 user nova-compute[75083]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:49:02 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:49:02 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:49:02 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:49:02 user nova-compute[75083]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:49:02 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:49:02 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[995824ab-f251-4dd2-9e0f-3244895831a6]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viLUoyJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG nova.objects.instance [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lazy-loading 'flavor' on Instance uuid b2f88b2e-0244-4e18-98ae-21861b02db3a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:49:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-18c3f2b4-a493-40b9-adf1-d27de5688d63 tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.901s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquiring lock "interface-b2f88b2e-0244-4e18-98ae-21861b02db3a-90ffff8c-4211-4ef0-b043-f632e883962b" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "interface-b2f88b2e-0244-4e18-98ae-21861b02db3a-90ffff8c-4211-4ef0-b043-f632e883962b" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG nova.objects.instance [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lazy-loading 'flavor' on Instance uuid b2f88b2e-0244-4e18-98ae-21861b02db3a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-435233267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-435233267',id=8,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVo1YmBFLd3yYkAIW3JoUP4JziHChmMQVX+ttBFc7qW+T8emUJzEuqgOO60aMaVCz4WsSuNB1wNEq+HNrQ09nJNiqezTzIp51WzgrWGg90AnD0HNS2LM7B+NhJDHUeq3A==',key_name='tempest-keypair-489296993',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8916664e2bf04c018daedae140735f3a',ramdisk_id='',reservation_id='r-mli56wj6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2091340319',owner_user_name='tempest-TaggedAttachmentsTest-2091340319-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:46:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c746113481e4d179fba6e77efcee7a2',uuid=b2f88b2e-0244-4e18-98ae-21861b02db3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90ffff8c-4211-4ef0-b043-f632e883962b", "address": "fa:16:3e:37:88:c5", "network": {"id": "a1790ee1-80c8-4a22-81b3-abbf42053cef", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-830898710", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ffff8c-42", "ovs_interfaceid": "90ffff8c-4211-4ef0-b043-f632e883962b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Converting VIF {"id": "90ffff8c-4211-4ef0-b043-f632e883962b", "address": "fa:16:3e:37:88:c5", "network": {"id": "a1790ee1-80c8-4a22-81b3-abbf42053cef", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-830898710", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ffff8c-42", "ovs_interfaceid": "90ffff8c-4211-4ef0-b043-f632e883962b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:88:c5,bridge_name='br-int',has_traffic_filtering=True,id=90ffff8c-4211-4ef0-b043-f632e883962b,network=Network(a1790ee1-80c8-4a22-81b3-abbf42053cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ffff8c-42') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:37:88:c5"/><model type="virtio"/><mtu size="1442"/><target dev="tap90ffff8c-42"/></interface> {{(pid=75083) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:37:88:c5"/><model type="virtio"/><mtu size="1442"/><target dev="tap90ffff8c-42"/></interface> {{(pid=75083) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Attempting to detach device tap90ffff8c-42 from instance b2f88b2e-0244-4e18-98ae-21861b02db3a from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] detach device xml: <interface type="ethernet">
Nov 29 05:49:03 user nova-compute[75083]:   <mac address="fa:16:3e:37:88:c5"/>
Nov 29 05:49:03 user nova-compute[75083]:   <model type="virtio"/>
Nov 29 05:49:03 user nova-compute[75083]:   <mtu size="1442"/>
Nov 29 05:49:03 user nova-compute[75083]:   <target dev="tap90ffff8c-42"/>
Nov 29 05:49:03 user nova-compute[75083]: </interface>
Nov 29 05:49:03 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:37:88:c5"/><model type="virtio"/><mtu size="1442"/><target dev="tap90ffff8c-42"/></interface> {{(pid=75083) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:37:88:c5"/><model type="virtio"/><mtu size="1442"/><target dev="tap90ffff8c-42"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 29 05:49:03 user nova-compute[75083]:   <name>instance-00000008</name>
Nov 29 05:49:03 user nova-compute[75083]:   <uuid>b2f88b2e-0244-4e18-98ae-21861b02db3a</uuid>
Nov 29 05:49:03 user nova-compute[75083]:   <metadata>
Nov 29 05:49:03 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:49:03 user nova-compute[75083]:   <nova:package version="0.0.0"/>
Nov 29 05:49:03 user nova-compute[75083]:   <nova:name>tempest-device-tagging-server-435233267</nova:name>
Nov 29 05:49:03 user nova-compute[75083]:   <nova:creationTime>2023-11-29 05:48:27</nova:creationTime>
Nov 29 05:49:03 user nova-compute[75083]:   <nova:flavor name="m1.tiny">
Nov 29 05:49:03 user nova-compute[75083]:     <nova:memory>512</nova:memory>
Nov 29 05:49:03 user nova-compute[75083]:     <nova:disk>1</nova:disk>
Nov 29 05:49:03 user nova-compute[75083]:     <nova:swap>0</nova:swap>
Nov 29 05:49:03 user nova-compute[75083]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:49:03 user nova-compute[75083]:     <nova:vcpus>1</nova:vcpus>
Nov 29 05:49:03 user nova-compute[75083]:   </nova:flavor>
Nov 29 05:49:03 user nova-compute[75083]:   <nova:owner>
Nov 29 05:49:03 user nova-compute[75083]:     <nova:user uuid="9c746113481e4d179fba6e77efcee7a2">tempest-TaggedAttachmentsTest-2091340319-project-member</nova:user>
Nov 29 05:49:03 user nova-compute[75083]:     <nova:project uuid="8916664e2bf04c018daedae140735f3a">tempest-TaggedAttachmentsTest-2091340319</nova:project>
Nov 29 05:49:03 user nova-compute[75083]:   </nova:owner>
Nov 29 05:49:03 user nova-compute[75083]:   <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:49:03 user nova-compute[75083]:   <nova:ports>
Nov 29 05:49:03 user nova-compute[75083]:     <nova:port uuid="9ac8517e-5bf8-41ec-839e-40dcffd8a7ac">
Nov 29 05:49:03 user nova-compute[75083]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 05:49:03 user nova-compute[75083]:     </nova:port>
Nov 29 05:49:03 user nova-compute[75083]:     <nova:port uuid="90ffff8c-4211-4ef0-b043-f632e883962b">
Nov 29 05:49:03 user nova-compute[75083]:       <nova:ip type="fixed" address="10.10.10.54" ipVersion="4"/>
Nov 29 05:49:03 user nova-compute[75083]:     </nova:port>
Nov 29 05:49:03 user nova-compute[75083]:   </nova:ports>
Nov 29 05:49:03 user nova-compute[75083]: </nova:instance>
Nov 29 05:49:03 user nova-compute[75083]:   </metadata>
Nov 29 05:49:03 user nova-compute[75083]:   <memory unit='KiB'>524288</memory>
Nov 29 05:49:03 user nova-compute[75083]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 05:49:03 user nova-compute[75083]:   <vcpu placement='static'>1</vcpu>
Nov 29 05:49:03 user nova-compute[75083]:   <resource>
Nov 29 05:49:03 user nova-compute[75083]:     <partition>/machine</partition>
Nov 29 05:49:03 user nova-compute[75083]:   </resource>
Nov 29 05:49:03 user nova-compute[75083]:   <sysinfo type='smbios'>
Nov 29 05:49:03 user nova-compute[75083]:     <system>
Nov 29 05:49:03 user nova-compute[75083]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 05:49:03 user nova-compute[75083]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 05:49:03 user nova-compute[75083]:       <entry name='version'>0.0.0</entry>
Nov 29 05:49:03 user nova-compute[75083]:       <entry name='serial'>b2f88b2e-0244-4e18-98ae-21861b02db3a</entry>
Nov 29 05:49:03 user nova-compute[75083]:       <entry name='uuid'>b2f88b2e-0244-4e18-98ae-21861b02db3a</entry>
Nov 29 05:49:03 user nova-compute[75083]:       <entry name='family'>Virtual Machine</entry>
Nov 29 05:49:03 user nova-compute[75083]:     </system>
Nov 29 05:49:03 user nova-compute[75083]:   </sysinfo>
Nov 29 05:49:03 user nova-compute[75083]:   <os>
Nov 29 05:49:03 user nova-compute[75083]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 05:49:03 user nova-compute[75083]:     <boot dev='hd'/>
Nov 29 05:49:03 user nova-compute[75083]:     <smbios mode='sysinfo'/>
Nov 29 05:49:03 user nova-compute[75083]:   </os>
Nov 29 05:49:03 user nova-compute[75083]:   <features>
Nov 29 05:49:03 user nova-compute[75083]:     <acpi/>
Nov 29 05:49:03 user nova-compute[75083]:     <apic/>
Nov 29 05:49:03 user nova-compute[75083]:     <vmcoreinfo state='on'/>
Nov 29 05:49:03 user nova-compute[75083]:   </features>
Nov 29 05:49:03 user nova-compute[75083]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 05:49:03 user nova-compute[75083]:     <model fallback='forbid'>Nehalem</model>
Nov 29 05:49:03 user nova-compute[75083]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 05:49:03 user nova-compute[75083]:     <feature policy='require' name='vme'/>
Nov 29 05:49:03 user nova-compute[75083]:     <feature policy='require' name='x2apic'/>
Nov 29 05:49:03 user nova-compute[75083]:     <feature policy='require' name='hypervisor'/>
Nov 29 05:49:03 user nova-compute[75083]:   </cpu>
Nov 29 05:49:03 user nova-compute[75083]:   <clock offset='utc'>
Nov 29 05:49:03 user nova-compute[75083]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 05:49:03 user nova-compute[75083]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 05:49:03 user nova-compute[75083]:     <timer name='hpet' present='no'/>
Nov 29 05:49:03 user nova-compute[75083]:   </clock>
Nov 29 05:49:03 user nova-compute[75083]:   <on_poweroff>destroy</on_poweroff>
Nov 29 05:49:03 user nova-compute[75083]:   <on_reboot>restart</on_reboot>
Nov 29 05:49:03 user nova-compute[75083]:   <on_crash>destroy</on_crash>
Nov 29 05:49:03 user nova-compute[75083]:   <devices>
Nov 29 05:49:03 user nova-compute[75083]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 05:49:03 user nova-compute[75083]:     <disk type='file' device='disk'>
Nov 29 05:49:03 user nova-compute[75083]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 05:49:03 user nova-compute[75083]:       <source file='/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk' index='2'/>
Nov 29 05:49:03 user nova-compute[75083]:       <backingStore type='file' index='3'>
Nov 29 05:49:03 user nova-compute[75083]:         <format type='raw'/>
Nov 29 05:49:03 user nova-compute[75083]:         <source file='/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a'/>
Nov 29 05:49:03 user nova-compute[75083]:         <backingStore/>
Nov 29 05:49:03 user nova-compute[75083]:       </backingStore>
Nov 29 05:49:03 user nova-compute[75083]:       <target dev='vda' bus='virtio'/>
Nov 29 05:49:03 user nova-compute[75083]:       <alias name='virtio-disk0'/>
Nov 29 05:49:03 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 05:49:03 user nova-compute[75083]:     </disk>
Nov 29 05:49:03 user nova-compute[75083]:     <disk type='file' device='cdrom'>
Nov 29 05:49:03 user nova-compute[75083]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 05:49:03 user nova-compute[75083]:       <source file='/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk.config' index='1'/>
Nov 29 05:49:03 user nova-compute[75083]:       <backingStore/>
Nov 29 05:49:03 user nova-compute[75083]:       <target dev='hda' bus='ide'/>
Nov 29 05:49:03 user nova-compute[75083]:       <readonly/>
Nov 29 05:49:03 user nova-compute[75083]:       <alias name='ide0-0-0'/>
Nov 29 05:49:03 user nova-compute[75083]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 05:49:03 user nova-compute[75083]:     </disk>
Nov 29 05:49:03 user nova-compute[75083]:     <controller type='usb' index='0' model='none'>
Nov 29 05:49:03 user nova-compute[75083]:       <alias name='usb'/>
Nov 29 05:49:03 user nova-compute[75083]:     </controller>
Nov 29 05:49:03 user nova-compute[75083]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 05:49:03 user nova-compute[75083]:       <alias name='pci.0'/>
Nov 29 05:49:03 user nova-compute[75083]:     </controller>
Nov 29 05:49:03 user nova-compute[75083]:     <controller type='ide' index='0'>
Nov 29 05:49:03 user nova-compute[75083]:       <alias name='ide'/>
Nov 29 05:49:03 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 05:49:03 user nova-compute[75083]:     </controller>
Nov 29 05:49:03 user nova-compute[75083]:     <interface type='ethernet'>
Nov 29 05:49:03 user nova-compute[75083]:       <mac address='fa:16:3e:b3:28:72'/>
Nov 29 05:49:03 user nova-compute[75083]:       <target dev='tap9ac8517e-5b'/>
Nov 29 05:49:03 user nova-compute[75083]:       <model type='virtio'/>
Nov 29 05:49:03 user nova-compute[75083]:       <mtu size='1442'/>
Nov 29 05:49:03 user nova-compute[75083]:       <alias name='net0'/>
Nov 29 05:49:03 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 05:49:03 user nova-compute[75083]:     </interface>
Nov 29 05:49:03 user nova-compute[75083]:     <interface type='ethernet'>
Nov 29 05:49:03 user nova-compute[75083]:       <mac address='fa:16:3e:37:88:c5'/>
Nov 29 05:49:03 user nova-compute[75083]:       <target dev='tap90ffff8c-42'/>
Nov 29 05:49:03 user nova-compute[75083]:       <model type='virtio'/>
Nov 29 05:49:03 user nova-compute[75083]:       <mtu size='1442'/>
Nov 29 05:49:03 user nova-compute[75083]:       <alias name='net1'/>
Nov 29 05:49:03 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 29 05:49:03 user nova-compute[75083]:     </interface>
Nov 29 05:49:03 user nova-compute[75083]:     <serial type='pty'>
Nov 29 05:49:03 user nova-compute[75083]:       <source path='/dev/pts/7'/>
Nov 29 05:49:03 user nova-compute[75083]:       <log file='/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/console.log' append='off'/>
Nov 29 05:49:03 user nova-compute[75083]:       <target type='isa-serial' port='0'>
Nov 29 05:49:03 user nova-compute[75083]:         <model name='isa-serial'/>
Nov 29 05:49:03 user nova-compute[75083]:       </target>
Nov 29 05:49:03 user nova-compute[75083]:       <alias name='serial0'/>
Nov 29 05:49:03 user nova-compute[75083]:     </serial>
Nov 29 05:49:03 user nova-compute[75083]:     <console type='pty' tty='/dev/pts/7'>
Nov 29 05:49:03 user nova-compute[75083]:       <source path='/dev/pts/7'/>
Nov 29 05:49:03 user nova-compute[75083]:       <log file='/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/console.log' append='off'/>
Nov 29 05:49:03 user nova-compute[75083]:       <target type='serial' port='0'/>
Nov 29 05:49:03 user nova-compute[75083]:       <alias name='serial0'/>
Nov 29 05:49:03 user nova-compute[75083]:     </console>
Nov 29 05:49:03 user nova-compute[75083]:     <input type='mouse' bus='ps2'>
Nov 29 05:49:03 user nova-compute[75083]:       <alias name='input0'/>
Nov 29 05:49:03 user nova-compute[75083]:     </input>
Nov 29 05:49:03 user nova-compute[75083]:     <input type='keyboard' bus='ps2'>
Nov 29 05:49:03 user nova-compute[75083]:       <alias name='input1'/>
Nov 29 05:49:03 user nova-compute[75083]:     </input>
Nov 29 05:49:03 user nova-compute[75083]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 29 05:49:03 user nova-compute[75083]:       <listen type='address' address='0.0.0.0'/>
Nov 29 05:49:03 user nova-compute[75083]:     </graphics>
Nov 29 05:49:03 user nova-compute[75083]:     <audio id='1' type='none'/>
Nov 29 05:49:03 user nova-compute[75083]:     <video>
Nov 29 05:49:03 user nova-compute[75083]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 05:49:03 user nova-compute[75083]:       <alias name='video0'/>
Nov 29 05:49:03 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 05:49:03 user nova-compute[75083]:     </video>
Nov 29 05:49:03 user nova-compute[75083]:     <memballoon model='virtio'>
Nov 29 05:49:03 user nova-compute[75083]:       <stats period='10'/>
Nov 29 05:49:03 user nova-compute[75083]:       <alias name='balloon0'/>
Nov 29 05:49:03 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 05:49:03 user nova-compute[75083]:     </memballoon>
Nov 29 05:49:03 user nova-compute[75083]:     <rng model='virtio'>
Nov 29 05:49:03 user nova-compute[75083]:       <backend model='random'>/dev/urandom</backend>
Nov 29 05:49:03 user nova-compute[75083]:       <alias name='rng0'/>
Nov 29 05:49:03 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 05:49:03 user nova-compute[75083]:     </rng>
Nov 29 05:49:03 user nova-compute[75083]:   </devices>
Nov 29 05:49:03 user nova-compute[75083]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 05:49:03 user nova-compute[75083]:     <label>libvirt-b2f88b2e-0244-4e18-98ae-21861b02db3a</label>
Nov 29 05:49:03 user nova-compute[75083]:     <imagelabel>libvirt-b2f88b2e-0244-4e18-98ae-21861b02db3a</imagelabel>
Nov 29 05:49:03 user nova-compute[75083]:   </seclabel>
Nov 29 05:49:03 user nova-compute[75083]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 05:49:03 user nova-compute[75083]:     <label>+64055:+108</label>
Nov 29 05:49:03 user nova-compute[75083]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 05:49:03 user nova-compute[75083]:   </seclabel>
Nov 29 05:49:03 user nova-compute[75083]: </domain>
Nov 29 05:49:03 user nova-compute[75083]:  {{(pid=75083) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 05:49:03 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Successfully detached device tap90ffff8c-42 from instance b2f88b2e-0244-4e18-98ae-21861b02db3a from the persistent domain config.
Nov 29 05:49:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] (1/8): Attempting to detach device tap90ffff8c-42 with device alias net1 from instance b2f88b2e-0244-4e18-98ae-21861b02db3a from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] detach device xml: <interface type="ethernet">
Nov 29 05:49:03 user nova-compute[75083]:   <mac address="fa:16:3e:37:88:c5"/>
Nov 29 05:49:03 user nova-compute[75083]:   <model type="virtio"/>
Nov 29 05:49:03 user nova-compute[75083]:   <mtu size="1442"/>
Nov 29 05:49:03 user nova-compute[75083]:   <target dev="tap90ffff8c-42"/>
Nov 29 05:49:03 user nova-compute[75083]: </interface>
Nov 29 05:49:03 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:49:03 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Took 3.29 seconds to deallocate network for instance.
Nov 29 05:49:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26539666534623433', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539666534623433', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG nova.objects.instance [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Lazy-loading 'flavor' on Instance uuid ae18699b-d0cf-44b5-8467-a112fd154580 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Start waiting for the detach event from libvirt for device tap90ffff8c-42 with device alias net1 for instance b2f88b2e-0244-4e18-98ae-21861b02db3a {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG nova.compute.manager [req-12ea88f3-6cd7-4128-ad0d-ad2a5c05a885 req-1384a284-b64d-40e2-b8b6-f71e0bc0b92d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-deleted-ed9cab68-946e-4ed5-87d7-4f73c2f82ac2 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG nova.compute.manager [req-12ea88f3-6cd7-4128-ad0d-ad2a5c05a885 req-1384a284-b64d-40e2-b8b6-f71e0bc0b92d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-deleted-a8c8c3cf-ad69-4ba6-81cd-aed9289bc816 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG nova.compute.manager [req-12ea88f3-6cd7-4128-ad0d-ad2a5c05a885 req-1384a284-b64d-40e2-b8b6-f71e0bc0b92d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-deleted-91851640-12fe-4910-bc52-dd499dfcb1cf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:49:03 user nova-compute[75083]: DEBUG nova.compute.manager [req-12ea88f3-6cd7-4128-ad0d-ad2a5c05a885 req-1384a284-b64d-40e2-b8b6-f71e0bc0b92d service nova] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Received event network-vif-deleted-f4c3696b-581b-4f04-831a-44532362bf1b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:49:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:49:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-0fb6da87-1197-489a-9091-db69d090532a req-df963728-2c9d-4e7d-918f-d04baa1b7815 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received event network-vif-unplugged-90ffff8c-4211-4ef0-b043-f632e883962b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:49:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0fb6da87-1197-489a-9091-db69d090532a req-df963728-2c9d-4e7d-918f-d04baa1b7815 service nova] Acquiring lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:49:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0fb6da87-1197-489a-9091-db69d090532a req-df963728-2c9d-4e7d-918f-d04baa1b7815 service nova] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0fb6da87-1197-489a-9091-db69d090532a req-df963728-2c9d-4e7d-918f-d04baa1b7815 service nova] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-0fb6da87-1197-489a-9091-db69d090532a req-df963728-2c9d-4e7d-918f-d04baa1b7815 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] No waiting events found dispatching network-vif-unplugged-90ffff8c-4211-4ef0-b043-f632e883962b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:49:04 user nova-compute[75083]: WARNING nova.compute.manager [req-0fb6da87-1197-489a-9091-db69d090532a req-df963728-2c9d-4e7d-918f-d04baa1b7815 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received unexpected event network-vif-unplugged-90ffff8c-4211-4ef0-b043-f632e883962b for instance with vm_state active and task_state None.
Nov 29 05:49:04 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:49:04 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Took 3.84 seconds to deallocate network for instance.
Nov 29 05:49:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-28a232a1-88b4-47e3-80be-4c51a5eb744f req-728370d8-fe73-4003-a2f4-1b06c5a3263c service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-deleted-d92f1220-3106-4729-91df-22000fd2a29a {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:49:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-28a232a1-88b4-47e3-80be-4c51a5eb744f req-728370d8-fe73-4003-a2f4-1b06c5a3263c service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-deleted-750d3bad-3dc1-4a84-afd5-39f7d814da39 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:49:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-28a232a1-88b4-47e3-80be-4c51a5eb744f req-728370d8-fe73-4003-a2f4-1b06c5a3263c service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-deleted-c90d0fc0-6432-4f98-8295-af931e20e0b5 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:49:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] COPY block job progress, current cursor: 149946368 final cursor: 1073741824 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:49:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] COPY block job progress, current cursor: 233832448 final cursor: 1073741824 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:49:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] COPY block job progress, current cursor: 350224384 final cursor: 1073741824 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] COPY block job progress, current cursor: 470810624 final cursor: 1073741824 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-466584ce-9ab3-4560-be10-d30acf61ba5a req-160bde12-ff01-4583-b2f5-0637d08a21a3 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received event network-vif-plugged-90ffff8c-4211-4ef0-b043-f632e883962b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-466584ce-9ab3-4560-be10-d30acf61ba5a req-160bde12-ff01-4583-b2f5-0637d08a21a3 service nova] Acquiring lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-466584ce-9ab3-4560-be10-d30acf61ba5a req-160bde12-ff01-4583-b2f5-0637d08a21a3 service nova] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-466584ce-9ab3-4560-be10-d30acf61ba5a req-160bde12-ff01-4583-b2f5-0637d08a21a3 service nova] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-466584ce-9ab3-4560-be10-d30acf61ba5a req-160bde12-ff01-4583-b2f5-0637d08a21a3 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] No waiting events found dispatching network-vif-plugged-90ffff8c-4211-4ef0-b043-f632e883962b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:49:06 user nova-compute[75083]: WARNING nova.compute.manager [req-466584ce-9ab3-4560-be10-d30acf61ba5a req-160bde12-ff01-4583-b2f5-0637d08a21a3 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received unexpected event network-vif-plugged-90ffff8c-4211-4ef0-b043-f632e883962b for instance with vm_state active and task_state None.
Nov 29 05:49:06 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 12989829-1b4c-4aaf-ad24-b30488c4e472 is timed out.
Nov 29 05:49:06 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Successfully detached device vdb from instance 12989829-1b4c-4aaf-ad24-b30488c4e472 from the live domain config.
Nov 29 05:49:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kTMJeCmc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:49:06 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:49:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-ccf17787-5052-49fa-b87e-3fff32a9554c req-bbb3a557-598b-4f86-a45a-d24be5075713 service nova] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Received event network-vif-deleted-dd6b4eda-d093-4ed5-b230-acca120a8213 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf56d637-2537-4134-baea-b4be7b774b06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:49:06 user nova-compute[75083]: No targets found.
Nov 29 05:49:06 user nova-compute[75083]: iSNS:
Nov 29 05:49:06 user nova-compute[75083]: No targets found.
Nov 29 05:49:06 user nova-compute[75083]: STATIC:
Nov 29 05:49:06 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e
Nov 29 05:49:06 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:49:06 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:49:06 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113
Nov 29 05:49:06 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:49:06 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:49:06 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e
Nov 29 05:49:06 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:49:06 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:49:06 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780
Nov 29 05:49:06 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:49:06 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:49:06 user nova-compute[75083]: FIRMWARE:
Nov 29 05:49:06 user nova-compute[75083]: No targets found.
Nov 29 05:49:06 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:49:06 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:49:06 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d374eb8d-fd8c-4b77-8d0b-14fcdd93a43b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] COPY block job progress, current cursor: 609222656 final cursor: 1073741824 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f1bbcc-c518-4b7f-81eb-d311171878bb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:49:06 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:49:06 user nova-compute[75083]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:49:06 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:49:06 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e (non-flash)
Nov 29 05:49:06 user nova-compute[75083]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:49:06 user nova-compute[75083]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:49:06 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:49:06 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b84c3eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e'): ({'sdl'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Removing single pathed devices sdl {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3546b979-983e-4e58-9723-1c1a4f3d1065]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4790f06-7d93-4eee-a463-8cd21e1a7b12]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Flushing IO for device /dev/sdl {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.012s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5804cd-bd38-4bc2-8a37-08e971ab03d5]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.054s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a5cae4-e75f-4753-a43e-4417d9ce5765]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] SCSI volumes sdl have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f77484-1648-4bcf-9a3f-d3d567dc2036]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[70565894-3579-4ce9-8a36-26260447497e]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e, portal: 172.16.0.220,3260]
Nov 29 05:49:06 user nova-compute[75083]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e, portal: 172.16.0.220,3260] successful.
Nov 29 05:49:06 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9756f050-c5b1-4427-963b-f92f8e9fad8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1287fbca-f12f-47e0-8ca8-93e05ea38188]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] <== disconnect_volume: return (367ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:49:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:49:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] COPY block job progress, current cursor: 736100352 final cursor: 1073741824 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:49:07 user nova-compute[75083]: INFO nova.compute.manager [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] [instance: e8fe9965-822d-4058-a031-e71b5fb03db4] Took 3.74 seconds to detach 3 volumes for instance.
Nov 29 05:49:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:49:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] COPY block job progress, current cursor: 806354944 final cursor: 1073741824 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:49:07 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:49:07 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:08 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Deleted allocations for instance e8fe9965-822d-4058-a031-e71b5fb03db4
Nov 29 05:49:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] COPY block job progress, current cursor: 955252736 final cursor: 1073741824 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dd163a5e-835a-467e-823a-033bf2cd6aed tempest-TaggedBootDevicesTest_v242-761712321 tempest-TaggedBootDevicesTest_v242-761712321-project-member] Lock "e8fe9965-822d-4058-a031-e71b5fb03db4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.594s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:08 user nova-compute[75083]: INFO nova.compute.manager [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] [instance: 0f45ac21-017c-4247-b2ae-756ae1c12911] Took 3.83 seconds to detach 3 volumes for instance.
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG nova.objects.instance [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Lazy-loading 'flavor' on Instance uuid 12989829-1b4c-4aaf-ad24-b30488c4e472 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-aec5d6b5-a4b2-4ca5-8b1c-2451017371a2 tempest-VolumesAssistedSnapshotsTest-472135171 tempest-VolumesAssistedSnapshotsTest-472135171-project-admin] Lock "12989829-1b4c-4aaf-ad24-b30488c4e472" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.560s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:08 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Deleted allocations for instance 0f45ac21-017c-4247-b2ae-756ae1c12911
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-35628d0c-b86d-459a-a660-2cfbbed14310 tempest-TaggedBootDevicesTest-1645506517 tempest-TaggedBootDevicesTest-1645506517-project-member] Lock "0f45ac21-017c-4247-b2ae-756ae1c12911" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.289s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voYpWmRj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm', 'volume_id': 'bcdfc365-b96d-40ac-a012-96484a067113'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:49:08 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:49:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f4432b-634f-4a52-8578-e33703bb5a7e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:49:08 user nova-compute[75083]: No targets found.
Nov 29 05:49:08 user nova-compute[75083]: iSNS:
Nov 29 05:49:08 user nova-compute[75083]: No targets found.
Nov 29 05:49:08 user nova-compute[75083]: STATIC:
Nov 29 05:49:08 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113
Nov 29 05:49:08 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:49:08 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:49:08 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e
Nov 29 05:49:08 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:49:08 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:49:08 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780
Nov 29 05:49:08 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:49:08 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:49:08 user nova-compute[75083]: FIRMWARE:
Nov 29 05:49:08 user nova-compute[75083]: No targets found.
Nov 29 05:49:08 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:49:08 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:49:08 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1a0995-35fa-4491-80b8-045d5dafcb67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebb3feb-b99e-47e8-a656-4d330ac3c20b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:49:08 user nova-compute[75083]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:49:08 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:49:08 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 (non-flash)
Nov 29 05:49:08 user nova-compute[75083]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:49:08 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:49:08 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0d83f2c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113'): ({'sdm'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Removing single pathed devices sdm {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2574689-ffdc-447a-aba2-e80ebc333a91]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[915bf22b-54f5-4e5f-b96e-28b618066168]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Flushing IO for device /dev/sdm {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.012s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5e112b-b21b-4716-be86-973862f7eb04]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.050s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[891ebf7f-49b2-4b09-b638-65ad3edfc2ed]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Checking to see if SCSI volumes sdm have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] SCSI volumes sdm have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[339c9d87-c557-475c-9944-888a6caf01af]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db6f550-f47b-4e75-8d2f-8a05eb8597b5]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113, portal: 172.16.0.220,3260]
Nov 29 05:49:09 user nova-compute[75083]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113, portal: 172.16.0.220,3260] successful.
Nov 29 05:49:09 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdfc365-b96d-40ac-a012-96484a067113 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0ec2c4-947d-4bb7-8190-c6d5c0a32818]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:49:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] <== disconnect_volume: return (309ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:49:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:49:09 user nova-compute[75083]: DEBUG nova.compute.manager [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viLUoyJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ae18699b-d0cf-44b5-8467-a112fd154580', 'attached_at': '', 'detached_at': '', 'volume_id': '74982c7f-1ac4-4d4f-b76c-521e310f1780', 'serial'} {{(pid=75083) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 29 05:49:09 user nova-compute[75083]: DEBUG nova.compute.manager [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] swap_volume: removing Cinder connection for volume bcdfc365-b96d-40ac-a012-96484a067113 {{(pid=75083) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 29 05:49:09 user nova-compute[75083]: DEBUG nova.compute.manager [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] swap_volume: Updating volume bcdfc365-b96d-40ac-a012-96484a067113 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "viLUoyJT", "auth_password": "O2WtfYALodQrnD", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "74982c7f-1ac4-4d4f-b76c-521e310f1780"}, "status": "reserved", "instance": "ae18699b-d0cf-44b5-8467-a112fd154580", "attached_at": "", "detached_at": "", "volume_id": "74982c7f-1ac4-4d4f-b76c-521e310f1780", "serial": "74982c7f-1ac4-4d4f-b76c-521e310f1780"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '74982c7f-1ac4-4d4f-b76c-521e310f1780', 'no_device': None, 'attachment_id': '40bea0c4-0668-4243-bab6-d902772ce8cc'} {{(pid=75083) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 29 05:49:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-178744be-744f-4dcb-a8a8-16d745fdb76d tempest-TestVolumeSwap-489468748 tempest-TestVolumeSwap-489468748-project-admin] Lock "ae18699b-d0cf-44b5-8467-a112fd154580" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.564s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Acquiring lock "ae18699b-d0cf-44b5-8467-a112fd154580" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:49:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "ae18699b-d0cf-44b5-8467-a112fd154580" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:11 user nova-compute[75083]: INFO nova.compute.manager [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Detaching volume 74982c7f-1ac4-4d4f-b76c-521e310f1780
Nov 29 05:49:11 user nova-compute[75083]: INFO nova.virt.block_device [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Attempting to driver detach volume 74982c7f-1ac4-4d4f-b76c-521e310f1780 from mountpoint /dev/vdb
Nov 29 05:49:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Attempting to detach device vdb from instance ae18699b-d0cf-44b5-8467-a112fd154580 from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 05:49:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:49:11 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:49:11 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 05:49:11 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:49:11 user nova-compute[75083]:   <serial>74982c7f-1ac4-4d4f-b76c-521e310f1780</serial>
Nov 29 05:49:11 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 05:49:11 user nova-compute[75083]: </disk>
Nov 29 05:49:11 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:49:11 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Successfully detached device vdb from instance ae18699b-d0cf-44b5-8467-a112fd154580 from the persistent domain config.
Nov 29 05:49:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ae18699b-d0cf-44b5-8467-a112fd154580 from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 05:49:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:49:11 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:49:11 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 05:49:11 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:49:11 user nova-compute[75083]:   <serial>74982c7f-1ac4-4d4f-b76c-521e310f1780</serial>
Nov 29 05:49:11 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 05:49:11 user nova-compute[75083]: </disk>
Nov 29 05:49:11 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:49:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ae18699b-d0cf-44b5-8467-a112fd154580 {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 05:49:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:49:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 05:49:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 05:49:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 05:49:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:49:23 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Waiting for libvirt event about the detach of device tap90ffff8c-42 with device alias net1 from instance b2f88b2e-0244-4e18-98ae-21861b02db3a is timed out.
Nov 29 05:49:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:37:88:c5"/><model type="virtio"/><mtu size="1442"/><target dev="tap90ffff8c-42"/></interface> {{(pid=75083) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 05:49:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:37:88:c5"/><model type="virtio"/><mtu size="1442"/><target dev="tap90ffff8c-42"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 29 05:49:23 user nova-compute[75083]:   <name>instance-00000008</name>
Nov 29 05:49:23 user nova-compute[75083]:   <uuid>b2f88b2e-0244-4e18-98ae-21861b02db3a</uuid>
Nov 29 05:49:23 user nova-compute[75083]:   <metadata>
Nov 29 05:49:23 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:49:23 user nova-compute[75083]:   <nova:package version="0.0.0"/>
Nov 29 05:49:23 user nova-compute[75083]:   <nova:name>tempest-device-tagging-server-435233267</nova:name>
Nov 29 05:49:23 user nova-compute[75083]:   <nova:creationTime>2023-11-29 05:48:27</nova:creationTime>
Nov 29 05:49:23 user nova-compute[75083]:   <nova:flavor name="m1.tiny">
Nov 29 05:49:23 user nova-compute[75083]:     <nova:memory>512</nova:memory>
Nov 29 05:49:23 user nova-compute[75083]:     <nova:disk>1</nova:disk>
Nov 29 05:49:23 user nova-compute[75083]:     <nova:swap>0</nova:swap>
Nov 29 05:49:23 user nova-compute[75083]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:49:23 user nova-compute[75083]:     <nova:vcpus>1</nova:vcpus>
Nov 29 05:49:23 user nova-compute[75083]:   </nova:flavor>
Nov 29 05:49:23 user nova-compute[75083]:   <nova:owner>
Nov 29 05:49:23 user nova-compute[75083]:     <nova:user uuid="9c746113481e4d179fba6e77efcee7a2">tempest-TaggedAttachmentsTest-2091340319-project-member</nova:user>
Nov 29 05:49:23 user nova-compute[75083]:     <nova:project uuid="8916664e2bf04c018daedae140735f3a">tempest-TaggedAttachmentsTest-2091340319</nova:project>
Nov 29 05:49:23 user nova-compute[75083]:   </nova:owner>
Nov 29 05:49:23 user nova-compute[75083]:   <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:49:23 user nova-compute[75083]:   <nova:ports>
Nov 29 05:49:23 user nova-compute[75083]:     <nova:port uuid="9ac8517e-5bf8-41ec-839e-40dcffd8a7ac">
Nov 29 05:49:23 user nova-compute[75083]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 05:49:23 user nova-compute[75083]:     </nova:port>
Nov 29 05:49:23 user nova-compute[75083]:     <nova:port uuid="90ffff8c-4211-4ef0-b043-f632e883962b">
Nov 29 05:49:23 user nova-compute[75083]:       <nova:ip type="fixed" address="10.10.10.54" ipVersion="4"/>
Nov 29 05:49:23 user nova-compute[75083]:     </nova:port>
Nov 29 05:49:23 user nova-compute[75083]:   </nova:ports>
Nov 29 05:49:23 user nova-compute[75083]: </nova:instance>
Nov 29 05:49:23 user nova-compute[75083]:   </metadata>
Nov 29 05:49:23 user nova-compute[75083]:   <memory unit='KiB'>524288</memory>
Nov 29 05:49:23 user nova-compute[75083]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 05:49:23 user nova-compute[75083]:   <vcpu placement='static'>1</vcpu>
Nov 29 05:49:23 user nova-compute[75083]:   <resource>
Nov 29 05:49:23 user nova-compute[75083]:     <partition>/machine</partition>
Nov 29 05:49:23 user nova-compute[75083]:   </resource>
Nov 29 05:49:23 user nova-compute[75083]:   <sysinfo type='smbios'>
Nov 29 05:49:23 user nova-compute[75083]:     <system>
Nov 29 05:49:23 user nova-compute[75083]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 05:49:23 user nova-compute[75083]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 05:49:23 user nova-compute[75083]:       <entry name='version'>0.0.0</entry>
Nov 29 05:49:23 user nova-compute[75083]:       <entry name='serial'>b2f88b2e-0244-4e18-98ae-21861b02db3a</entry>
Nov 29 05:49:23 user nova-compute[75083]:       <entry name='uuid'>b2f88b2e-0244-4e18-98ae-21861b02db3a</entry>
Nov 29 05:49:23 user nova-compute[75083]:       <entry name='family'>Virtual Machine</entry>
Nov 29 05:49:23 user nova-compute[75083]:     </system>
Nov 29 05:49:23 user nova-compute[75083]:   </sysinfo>
Nov 29 05:49:23 user nova-compute[75083]:   <os>
Nov 29 05:49:23 user nova-compute[75083]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 05:49:23 user nova-compute[75083]:     <boot dev='hd'/>
Nov 29 05:49:23 user nova-compute[75083]:     <smbios mode='sysinfo'/>
Nov 29 05:49:23 user nova-compute[75083]:   </os>
Nov 29 05:49:23 user nova-compute[75083]:   <features>
Nov 29 05:49:23 user nova-compute[75083]:     <acpi/>
Nov 29 05:49:23 user nova-compute[75083]:     <apic/>
Nov 29 05:49:23 user nova-compute[75083]:     <vmcoreinfo state='on'/>
Nov 29 05:49:23 user nova-compute[75083]:   </features>
Nov 29 05:49:23 user nova-compute[75083]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 05:49:23 user nova-compute[75083]:     <model fallback='forbid'>Nehalem</model>
Nov 29 05:49:23 user nova-compute[75083]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 05:49:23 user nova-compute[75083]:     <feature policy='require' name='vme'/>
Nov 29 05:49:23 user nova-compute[75083]:     <feature policy='require' name='x2apic'/>
Nov 29 05:49:23 user nova-compute[75083]:     <feature policy='require' name='hypervisor'/>
Nov 29 05:49:23 user nova-compute[75083]:   </cpu>
Nov 29 05:49:23 user nova-compute[75083]:   <clock offset='utc'>
Nov 29 05:49:23 user nova-compute[75083]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 05:49:23 user nova-compute[75083]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 05:49:23 user nova-compute[75083]:     <timer name='hpet' present='no'/>
Nov 29 05:49:23 user nova-compute[75083]:   </clock>
Nov 29 05:49:23 user nova-compute[75083]:   <on_poweroff>destroy</on_poweroff>
Nov 29 05:49:23 user nova-compute[75083]:   <on_reboot>restart</on_reboot>
Nov 29 05:49:23 user nova-compute[75083]:   <on_crash>destroy</on_crash>
Nov 29 05:49:23 user nova-compute[75083]:   <devices>
Nov 29 05:49:23 user nova-compute[75083]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 05:49:23 user nova-compute[75083]:     <disk type='file' device='disk'>
Nov 29 05:49:23 user nova-compute[75083]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 05:49:23 user nova-compute[75083]:       <source file='/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk' index='2'/>
Nov 29 05:49:23 user nova-compute[75083]:       <backingStore type='file' index='3'>
Nov 29 05:49:23 user nova-compute[75083]:         <format type='raw'/>
Nov 29 05:49:23 user nova-compute[75083]:         <source file='/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a'/>
Nov 29 05:49:23 user nova-compute[75083]:         <backingStore/>
Nov 29 05:49:23 user nova-compute[75083]:       </backingStore>
Nov 29 05:49:23 user nova-compute[75083]:       <target dev='vda' bus='virtio'/>
Nov 29 05:49:23 user nova-compute[75083]:       <alias name='virtio-disk0'/>
Nov 29 05:49:23 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 05:49:23 user nova-compute[75083]:     </disk>
Nov 29 05:49:23 user nova-compute[75083]:     <disk type='file' device='cdrom'>
Nov 29 05:49:23 user nova-compute[75083]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 05:49:23 user nova-compute[75083]:       <source file='/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk.config' index='1'/>
Nov 29 05:49:23 user nova-compute[75083]:       <backingStore/>
Nov 29 05:49:23 user nova-compute[75083]:       <target dev='hda' bus='ide'/>
Nov 29 05:49:23 user nova-compute[75083]:       <readonly/>
Nov 29 05:49:23 user nova-compute[75083]:       <alias name='ide0-0-0'/>
Nov 29 05:49:23 user nova-compute[75083]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 05:49:23 user nova-compute[75083]:     </disk>
Nov 29 05:49:23 user nova-compute[75083]:     <controller type='usb' index='0' model='none'>
Nov 29 05:49:23 user nova-compute[75083]:       <alias name='usb'/>
Nov 29 05:49:23 user nova-compute[75083]:     </controller>
Nov 29 05:49:23 user nova-compute[75083]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 05:49:23 user nova-compute[75083]:       <alias name='pci.0'/>
Nov 29 05:49:23 user nova-compute[75083]:     </controller>
Nov 29 05:49:23 user nova-compute[75083]:     <controller type='ide' index='0'>
Nov 29 05:49:23 user nova-compute[75083]:       <alias name='ide'/>
Nov 29 05:49:23 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 05:49:23 user nova-compute[75083]:     </controller>
Nov 29 05:49:23 user nova-compute[75083]:     <interface type='ethernet'>
Nov 29 05:49:23 user nova-compute[75083]:       <mac address='fa:16:3e:b3:28:72'/>
Nov 29 05:49:23 user nova-compute[75083]:       <target dev='tap9ac8517e-5b'/>
Nov 29 05:49:23 user nova-compute[75083]:       <model type='virtio'/>
Nov 29 05:49:23 user nova-compute[75083]:       <mtu size='1442'/>
Nov 29 05:49:23 user nova-compute[75083]:       <alias name='net0'/>
Nov 29 05:49:23 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 05:49:23 user nova-compute[75083]:     </interface>
Nov 29 05:49:23 user nova-compute[75083]:     <serial type='pty'>
Nov 29 05:49:23 user nova-compute[75083]:       <source path='/dev/pts/7'/>
Nov 29 05:49:23 user nova-compute[75083]:       <log file='/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/console.log' append='off'/>
Nov 29 05:49:23 user nova-compute[75083]:       <target type='isa-serial' port='0'>
Nov 29 05:49:23 user nova-compute[75083]:         <model name='isa-serial'/>
Nov 29 05:49:23 user nova-compute[75083]:       </target>
Nov 29 05:49:23 user nova-compute[75083]:       <alias name='serial0'/>
Nov 29 05:49:23 user nova-compute[75083]:     </serial>
Nov 29 05:49:23 user nova-compute[75083]:     <console type='pty' tty='/dev/pts/7'>
Nov 29 05:49:23 user nova-compute[75083]:       <source path='/dev/pts/7'/>
Nov 29 05:49:23 user nova-compute[75083]:       <log file='/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/console.log' append='off'/>
Nov 29 05:49:23 user nova-compute[75083]:       <target type='serial' port='0'/>
Nov 29 05:49:23 user nova-compute[75083]:       <alias name='serial0'/>
Nov 29 05:49:23 user nova-compute[75083]:     </console>
Nov 29 05:49:23 user nova-compute[75083]:     <input type='mouse' bus='ps2'>
Nov 29 05:49:23 user nova-compute[75083]:       <alias name='input0'/>
Nov 29 05:49:23 user nova-compute[75083]:     </input>
Nov 29 05:49:23 user nova-compute[75083]:     <input type='keyboard' bus='ps2'>
Nov 29 05:49:23 user nova-compute[75083]:       <alias name='input1'/>
Nov 29 05:49:23 user nova-compute[75083]:     </input>
Nov 29 05:49:23 user nova-compute[75083]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 29 05:49:23 user nova-compute[75083]:       <listen type='address' address='0.0.0.0'/>
Nov 29 05:49:23 user nova-compute[75083]:     </graphics>
Nov 29 05:49:23 user nova-compute[75083]:     <audio id='1' type='none'/>
Nov 29 05:49:23 user nova-compute[75083]:     <video>
Nov 29 05:49:23 user nova-compute[75083]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 05:49:23 user nova-compute[75083]:       <alias name='video0'/>
Nov 29 05:49:23 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 05:49:23 user nova-compute[75083]:     </video>
Nov 29 05:49:23 user nova-compute[75083]:     <memballoon model='virtio'>
Nov 29 05:49:23 user nova-compute[75083]:       <stats period='10'/>
Nov 29 05:49:23 user nova-compute[75083]:       <alias name='balloon0'/>
Nov 29 05:49:23 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 05:49:23 user nova-compute[75083]:     </memballoon>
Nov 29 05:49:23 user nova-compute[75083]:     <rng model='virtio'>
Nov 29 05:49:23 user nova-compute[75083]:       <backend model='random'>/dev/urandom</backend>
Nov 29 05:49:23 user nova-compute[75083]:       <alias name='rng0'/>
Nov 29 05:49:23 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 05:49:23 user nova-compute[75083]:     </rng>
Nov 29 05:49:23 user nova-compute[75083]:   </devices>
Nov 29 05:49:23 user nova-compute[75083]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 05:49:23 user nova-compute[75083]:     <label>libvirt-b2f88b2e-0244-4e18-98ae-21861b02db3a</label>
Nov 29 05:49:23 user nova-compute[75083]:     <imagelabel>libvirt-b2f88b2e-0244-4e18-98ae-21861b02db3a</imagelabel>
Nov 29 05:49:23 user nova-compute[75083]:   </seclabel>
Nov 29 05:49:23 user nova-compute[75083]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 05:49:23 user nova-compute[75083]:     <label>+64055:+108</label>
Nov 29 05:49:23 user nova-compute[75083]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 05:49:23 user nova-compute[75083]:   </seclabel>
Nov 29 05:49:23 user nova-compute[75083]: </domain>
Nov 29 05:49:23 user nova-compute[75083]:  {{(pid=75083) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 05:49:23 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Successfully detached device tap90ffff8c-42 from instance b2f88b2e-0244-4e18-98ae-21861b02db3a from the live domain config.
Nov 29 05:49:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-435233267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-435233267',id=8,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVo1YmBFLd3yYkAIW3JoUP4JziHChmMQVX+ttBFc7qW+T8emUJzEuqgOO60aMaVCz4WsSuNB1wNEq+HNrQ09nJNiqezTzIp51WzgrWGg90AnD0HNS2LM7B+NhJDHUeq3A==',key_name='tempest-keypair-489296993',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8916664e2bf04c018daedae140735f3a',ramdisk_id='',reservation_id='r-mli56wj6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2091340319',owner_user_name='tempest-TaggedAttachmentsTest-2091340319-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:46:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c746113481e4d179fba6e77efcee7a2',uuid=b2f88b2e-0244-4e18-98ae-21861b02db3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90ffff8c-4211-4ef0-b043-f632e883962b", "address": "fa:16:3e:37:88:c5", "network": {"id": "a1790ee1-80c8-4a22-81b3-abbf42053cef", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-830898710", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ffff8c-42", "ovs_interfaceid": "90ffff8c-4211-4ef0-b043-f632e883962b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:49:23 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Converting VIF {"id": "90ffff8c-4211-4ef0-b043-f632e883962b", "address": "fa:16:3e:37:88:c5", "network": {"id": "a1790ee1-80c8-4a22-81b3-abbf42053cef", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-830898710", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ffff8c-42", "ovs_interfaceid": "90ffff8c-4211-4ef0-b043-f632e883962b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:49:23 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:88:c5,bridge_name='br-int',has_traffic_filtering=True,id=90ffff8c-4211-4ef0-b043-f632e883962b,network=Network(a1790ee1-80c8-4a22-81b3-abbf42053cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ffff8c-42') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:49:23 user nova-compute[75083]: DEBUG os_vif [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:88:c5,bridge_name='br-int',has_traffic_filtering=True,id=90ffff8c-4211-4ef0-b043-f632e883962b,network=Network(a1790ee1-80c8-4a22-81b3-abbf42053cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ffff8c-42') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:49:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90ffff8c-42, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:49:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:49:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19328f40-47aa-4565-b7cb-cea1cb32f7cf) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:49:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:49:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:23 user nova-compute[75083]: INFO os_vif [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:88:c5,bridge_name='br-int',has_traffic_filtering=True,id=90ffff8c-4211-4ef0-b043-f632e883962b,network=Network(a1790ee1-80c8-4a22-81b3-abbf42053cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ffff8c-42')
Nov 29 05:49:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:49:23 user nova-compute[75083]:   <nova:package version="0.0.0"/>
Nov 29 05:49:23 user nova-compute[75083]:   <nova:name>tempest-device-tagging-server-435233267</nova:name>
Nov 29 05:49:23 user nova-compute[75083]:   <nova:creationTime>2023-11-29 05:49:23</nova:creationTime>
Nov 29 05:49:23 user nova-compute[75083]:   <nova:flavor name="m1.tiny">
Nov 29 05:49:23 user nova-compute[75083]:     <nova:memory>512</nova:memory>
Nov 29 05:49:23 user nova-compute[75083]:     <nova:disk>1</nova:disk>
Nov 29 05:49:23 user nova-compute[75083]:     <nova:swap>0</nova:swap>
Nov 29 05:49:23 user nova-compute[75083]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:49:23 user nova-compute[75083]:     <nova:vcpus>1</nova:vcpus>
Nov 29 05:49:23 user nova-compute[75083]:   </nova:flavor>
Nov 29 05:49:23 user nova-compute[75083]:   <nova:owner>
Nov 29 05:49:23 user nova-compute[75083]:     <nova:user uuid="9c746113481e4d179fba6e77efcee7a2">tempest-TaggedAttachmentsTest-2091340319-project-member</nova:user>
Nov 29 05:49:23 user nova-compute[75083]:     <nova:project uuid="8916664e2bf04c018daedae140735f3a">tempest-TaggedAttachmentsTest-2091340319</nova:project>
Nov 29 05:49:23 user nova-compute[75083]:   </nova:owner>
Nov 29 05:49:23 user nova-compute[75083]:   <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:49:23 user nova-compute[75083]:   <nova:ports>
Nov 29 05:49:23 user nova-compute[75083]:     <nova:port uuid="9ac8517e-5bf8-41ec-839e-40dcffd8a7ac">
Nov 29 05:49:23 user nova-compute[75083]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 05:49:23 user nova-compute[75083]:     </nova:port>
Nov 29 05:49:23 user nova-compute[75083]:   </nova:ports>
Nov 29 05:49:23 user nova-compute[75083]: </nova:instance>
Nov 29 05:49:23 user nova-compute[75083]:  {{(pid=75083) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 05:49:24 user nova-compute[75083]: DEBUG nova.compute.manager [req-70f0230e-6252-401c-b5d6-4255c17954c3 req-58cae698-0528-4d50-ac76-0a036b51d6e3 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received event network-vif-deleted-90ffff8c-4211-4ef0-b043-f632e883962b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:49:24 user nova-compute[75083]: INFO nova.compute.manager [req-70f0230e-6252-401c-b5d6-4255c17954c3 req-58cae698-0528-4d50-ac76-0a036b51d6e3 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Neutron deleted interface 90ffff8c-4211-4ef0-b043-f632e883962b; detaching it from the instance and deleting it from the info cache
Nov 29 05:49:24 user nova-compute[75083]: DEBUG nova.network.neutron [req-70f0230e-6252-401c-b5d6-4255c17954c3 req-58cae698-0528-4d50-ac76-0a036b51d6e3 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Updating instance_info_cache with network_info: [{"id": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "address": "fa:16:3e:b3:28:72", "network": {"id": "acfa7005-35a1-408e-a897-5920887137b3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-302522629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac8517e-5b", "ovs_interfaceid": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:49:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquiring lock "refresh_cache-b2f88b2e-0244-4e18-98ae-21861b02db3a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:49:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquired lock "refresh_cache-b2f88b2e-0244-4e18-98ae-21861b02db3a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:49:24 user nova-compute[75083]: DEBUG nova.network.neutron [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:49:24 user nova-compute[75083]: DEBUG nova.objects.instance [req-70f0230e-6252-401c-b5d6-4255c17954c3 req-58cae698-0528-4d50-ac76-0a036b51d6e3 service nova] Lazy-loading 'system_metadata' on Instance uuid b2f88b2e-0244-4e18-98ae-21861b02db3a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:49:24 user nova-compute[75083]: DEBUG nova.objects.instance [req-70f0230e-6252-401c-b5d6-4255c17954c3 req-58cae698-0528-4d50-ac76-0a036b51d6e3 service nova] Lazy-loading 'flavor' on Instance uuid b2f88b2e-0244-4e18-98ae-21861b02db3a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:49:24 user nova-compute[75083]: DEBUG nova.objects.base [req-70f0230e-6252-401c-b5d6-4255c17954c3 req-58cae698-0528-4d50-ac76-0a036b51d6e3 service nova] Object Instance<b2f88b2e-0244-4e18-98ae-21861b02db3a> lazy-loaded attributes: system_metadata,flavor {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:49:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [req-70f0230e-6252-401c-b5d6-4255c17954c3 req-58cae698-0528-4d50-ac76-0a036b51d6e3 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-435233267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-435233267',id=8,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVo1YmBFLd3yYkAIW3JoUP4JziHChmMQVX+ttBFc7qW+T8emUJzEuqgOO60aMaVCz4WsSuNB1wNEq+HNrQ09nJNiqezTzIp51WzgrWGg90AnD0HNS2LM7B+NhJDHUeq3A==',key_name='tempest-keypair-489296993',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8916664e2bf04c018daedae140735f3a',ramdisk_id='',reservation_id='r-mli56wj6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2091340319',owner_user_name='tempest-TaggedAttachmentsTest-2091340319-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:46:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c746113481e4d179fba6e77efcee7a2',uuid=b2f88b2e-0244-4e18-98ae-21861b02db3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90ffff8c-4211-4ef0-b043-f632e883962b", "address": "fa:16:3e:37:88:c5", "network": {"id": "a1790ee1-80c8-4a22-81b3-abbf42053cef", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-830898710", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ffff8c-42", "ovs_interfaceid": "90ffff8c-4211-4ef0-b043-f632e883962b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:49:24 user nova-compute[75083]: DEBUG nova.network.os_vif_util [req-70f0230e-6252-401c-b5d6-4255c17954c3 req-58cae698-0528-4d50-ac76-0a036b51d6e3 service nova] Converting VIF {"id": "90ffff8c-4211-4ef0-b043-f632e883962b", "address": "fa:16:3e:37:88:c5", "network": {"id": "a1790ee1-80c8-4a22-81b3-abbf42053cef", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-830898710", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ffff8c-42", "ovs_interfaceid": "90ffff8c-4211-4ef0-b043-f632e883962b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:49:24 user nova-compute[75083]: DEBUG nova.network.os_vif_util [req-70f0230e-6252-401c-b5d6-4255c17954c3 req-58cae698-0528-4d50-ac76-0a036b51d6e3 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:88:c5,bridge_name='br-int',has_traffic_filtering=True,id=90ffff8c-4211-4ef0-b043-f632e883962b,network=Network(a1790ee1-80c8-4a22-81b3-abbf42053cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ffff8c-42') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:49:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [req-70f0230e-6252-401c-b5d6-4255c17954c3 req-58cae698-0528-4d50-ac76-0a036b51d6e3 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:37:88:c5"/><model type="virtio"/><mtu size="1442"/><target dev="tap90ffff8c-42"/></interface> {{(pid=75083) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 05:49:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [req-70f0230e-6252-401c-b5d6-4255c17954c3 req-58cae698-0528-4d50-ac76-0a036b51d6e3 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:37:88:c5"/><model type="virtio"/><mtu size="1442"/><target dev="tap90ffff8c-42"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 29 05:49:24 user nova-compute[75083]:   <name>instance-00000008</name>
Nov 29 05:49:24 user nova-compute[75083]:   <uuid>b2f88b2e-0244-4e18-98ae-21861b02db3a</uuid>
Nov 29 05:49:24 user nova-compute[75083]:   <metadata>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:49:24 user nova-compute[75083]:   <nova:package version="0.0.0"/>
Nov 29 05:49:24 user nova-compute[75083]:   <nova:name>tempest-device-tagging-server-435233267</nova:name>
Nov 29 05:49:24 user nova-compute[75083]:   <nova:creationTime>2023-11-29 05:49:23</nova:creationTime>
Nov 29 05:49:24 user nova-compute[75083]:   <nova:flavor name="m1.tiny">
Nov 29 05:49:24 user nova-compute[75083]:     <nova:memory>512</nova:memory>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:disk>1</nova:disk>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:swap>0</nova:swap>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:vcpus>1</nova:vcpus>
Nov 29 05:49:24 user nova-compute[75083]:   </nova:flavor>
Nov 29 05:49:24 user nova-compute[75083]:   <nova:owner>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:user uuid="9c746113481e4d179fba6e77efcee7a2">tempest-TaggedAttachmentsTest-2091340319-project-member</nova:user>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:project uuid="8916664e2bf04c018daedae140735f3a">tempest-TaggedAttachmentsTest-2091340319</nova:project>
Nov 29 05:49:24 user nova-compute[75083]:   </nova:owner>
Nov 29 05:49:24 user nova-compute[75083]:   <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:49:24 user nova-compute[75083]:   <nova:ports>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:port uuid="9ac8517e-5bf8-41ec-839e-40dcffd8a7ac">
Nov 29 05:49:24 user nova-compute[75083]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 05:49:24 user nova-compute[75083]:     </nova:port>
Nov 29 05:49:24 user nova-compute[75083]:   </nova:ports>
Nov 29 05:49:24 user nova-compute[75083]: </nova:instance>
Nov 29 05:49:24 user nova-compute[75083]:   </metadata>
Nov 29 05:49:24 user nova-compute[75083]:   <memory unit='KiB'>524288</memory>
Nov 29 05:49:24 user nova-compute[75083]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 05:49:24 user nova-compute[75083]:   <vcpu placement='static'>1</vcpu>
Nov 29 05:49:24 user nova-compute[75083]:   <resource>
Nov 29 05:49:24 user nova-compute[75083]:     <partition>/machine</partition>
Nov 29 05:49:24 user nova-compute[75083]:   </resource>
Nov 29 05:49:24 user nova-compute[75083]:   <sysinfo type='smbios'>
Nov 29 05:49:24 user nova-compute[75083]:     <system>
Nov 29 05:49:24 user nova-compute[75083]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 05:49:24 user nova-compute[75083]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 05:49:24 user nova-compute[75083]:       <entry name='version'>0.0.0</entry>
Nov 29 05:49:24 user nova-compute[75083]:       <entry name='serial'>b2f88b2e-0244-4e18-98ae-21861b02db3a</entry>
Nov 29 05:49:24 user nova-compute[75083]:       <entry name='uuid'>b2f88b2e-0244-4e18-98ae-21861b02db3a</entry>
Nov 29 05:49:24 user nova-compute[75083]:       <entry name='family'>Virtual Machine</entry>
Nov 29 05:49:24 user nova-compute[75083]:     </system>
Nov 29 05:49:24 user nova-compute[75083]:   </sysinfo>
Nov 29 05:49:24 user nova-compute[75083]:   <os>
Nov 29 05:49:24 user nova-compute[75083]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 05:49:24 user nova-compute[75083]:     <boot dev='hd'/>
Nov 29 05:49:24 user nova-compute[75083]:     <smbios mode='sysinfo'/>
Nov 29 05:49:24 user nova-compute[75083]:   </os>
Nov 29 05:49:24 user nova-compute[75083]:   <features>
Nov 29 05:49:24 user nova-compute[75083]:     <acpi/>
Nov 29 05:49:24 user nova-compute[75083]:     <apic/>
Nov 29 05:49:24 user nova-compute[75083]:     <vmcoreinfo state='on'/>
Nov 29 05:49:24 user nova-compute[75083]:   </features>
Nov 29 05:49:24 user nova-compute[75083]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 05:49:24 user nova-compute[75083]:     <model fallback='forbid'>Nehalem</model>
Nov 29 05:49:24 user nova-compute[75083]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 05:49:24 user nova-compute[75083]:     <feature policy='require' name='vme'/>
Nov 29 05:49:24 user nova-compute[75083]:     <feature policy='require' name='x2apic'/>
Nov 29 05:49:24 user nova-compute[75083]:     <feature policy='require' name='hypervisor'/>
Nov 29 05:49:24 user nova-compute[75083]:   </cpu>
Nov 29 05:49:24 user nova-compute[75083]:   <clock offset='utc'>
Nov 29 05:49:24 user nova-compute[75083]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 05:49:24 user nova-compute[75083]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 05:49:24 user nova-compute[75083]:     <timer name='hpet' present='no'/>
Nov 29 05:49:24 user nova-compute[75083]:   </clock>
Nov 29 05:49:24 user nova-compute[75083]:   <on_poweroff>destroy</on_poweroff>
Nov 29 05:49:24 user nova-compute[75083]:   <on_reboot>restart</on_reboot>
Nov 29 05:49:24 user nova-compute[75083]:   <on_crash>destroy</on_crash>
Nov 29 05:49:24 user nova-compute[75083]:   <devices>
Nov 29 05:49:24 user nova-compute[75083]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 05:49:24 user nova-compute[75083]:     <disk type='file' device='disk'>
Nov 29 05:49:24 user nova-compute[75083]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 05:49:24 user nova-compute[75083]:       <source file='/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk' index='2'/>
Nov 29 05:49:24 user nova-compute[75083]:       <backingStore type='file' index='3'>
Nov 29 05:49:24 user nova-compute[75083]:         <format type='raw'/>
Nov 29 05:49:24 user nova-compute[75083]:         <source file='/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a'/>
Nov 29 05:49:24 user nova-compute[75083]:         <backingStore/>
Nov 29 05:49:24 user nova-compute[75083]:       </backingStore>
Nov 29 05:49:24 user nova-compute[75083]:       <target dev='vda' bus='virtio'/>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='virtio-disk0'/>
Nov 29 05:49:24 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </disk>
Nov 29 05:49:24 user nova-compute[75083]:     <disk type='file' device='cdrom'>
Nov 29 05:49:24 user nova-compute[75083]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 05:49:24 user nova-compute[75083]:       <source file='/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk.config' index='1'/>
Nov 29 05:49:24 user nova-compute[75083]:       <backingStore/>
Nov 29 05:49:24 user nova-compute[75083]:       <target dev='hda' bus='ide'/>
Nov 29 05:49:24 user nova-compute[75083]:       <readonly/>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='ide0-0-0'/>
Nov 29 05:49:24 user nova-compute[75083]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </disk>
Nov 29 05:49:24 user nova-compute[75083]:     <controller type='usb' index='0' model='none'>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='usb'/>
Nov 29 05:49:24 user nova-compute[75083]:     </controller>
Nov 29 05:49:24 user nova-compute[75083]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='pci.0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </controller>
Nov 29 05:49:24 user nova-compute[75083]:     <controller type='ide' index='0'>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='ide'/>
Nov 29 05:49:24 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 05:49:24 user nova-compute[75083]:     </controller>
Nov 29 05:49:24 user nova-compute[75083]:     <interface type='ethernet'>
Nov 29 05:49:24 user nova-compute[75083]:       <mac address='fa:16:3e:b3:28:72'/>
Nov 29 05:49:24 user nova-compute[75083]:       <target dev='tap9ac8517e-5b'/>
Nov 29 05:49:24 user nova-compute[75083]:       <model type='virtio'/>
Nov 29 05:49:24 user nova-compute[75083]:       <mtu size='1442'/>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='net0'/>
Nov 29 05:49:24 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </interface>
Nov 29 05:49:24 user nova-compute[75083]:     <serial type='pty'>
Nov 29 05:49:24 user nova-compute[75083]:       <source path='/dev/pts/7'/>
Nov 29 05:49:24 user nova-compute[75083]:       <log file='/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/console.log' append='off'/>
Nov 29 05:49:24 user nova-compute[75083]:       <target type='isa-serial' port='0'>
Nov 29 05:49:24 user nova-compute[75083]:         <model name='isa-serial'/>
Nov 29 05:49:24 user nova-compute[75083]:       </target>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='serial0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </serial>
Nov 29 05:49:24 user nova-compute[75083]:     <console type='pty' tty='/dev/pts/7'>
Nov 29 05:49:24 user nova-compute[75083]:       <source path='/dev/pts/7'/>
Nov 29 05:49:24 user nova-compute[75083]:       <log file='/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/console.log' append='off'/>
Nov 29 05:49:24 user nova-compute[75083]:       <target type='serial' port='0'/>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='serial0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </console>
Nov 29 05:49:24 user nova-compute[75083]:     <input type='mouse' bus='ps2'>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='input0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </input>
Nov 29 05:49:24 user nova-compute[75083]:     <input type='keyboard' bus='ps2'>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='input1'/>
Nov 29 05:49:24 user nova-compute[75083]:     </input>
Nov 29 05:49:24 user nova-compute[75083]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 29 05:49:24 user nova-compute[75083]:       <listen type='address' address='0.0.0.0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </graphics>
Nov 29 05:49:24 user nova-compute[75083]:     <audio id='1' type='none'/>
Nov 29 05:49:24 user nova-compute[75083]:     <video>
Nov 29 05:49:24 user nova-compute[75083]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='video0'/>
Nov 29 05:49:24 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </video>
Nov 29 05:49:24 user nova-compute[75083]:     <memballoon model='virtio'>
Nov 29 05:49:24 user nova-compute[75083]:       <stats period='10'/>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='balloon0'/>
Nov 29 05:49:24 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </memballoon>
Nov 29 05:49:24 user nova-compute[75083]:     <rng model='virtio'>
Nov 29 05:49:24 user nova-compute[75083]:       <backend model='random'>/dev/urandom</backend>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='rng0'/>
Nov 29 05:49:24 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </rng>
Nov 29 05:49:24 user nova-compute[75083]:   </devices>
Nov 29 05:49:24 user nova-compute[75083]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 05:49:24 user nova-compute[75083]:     <label>libvirt-b2f88b2e-0244-4e18-98ae-21861b02db3a</label>
Nov 29 05:49:24 user nova-compute[75083]:     <imagelabel>libvirt-b2f88b2e-0244-4e18-98ae-21861b02db3a</imagelabel>
Nov 29 05:49:24 user nova-compute[75083]:   </seclabel>
Nov 29 05:49:24 user nova-compute[75083]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 05:49:24 user nova-compute[75083]:     <label>+64055:+108</label>
Nov 29 05:49:24 user nova-compute[75083]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 05:49:24 user nova-compute[75083]:   </seclabel>
Nov 29 05:49:24 user nova-compute[75083]: </domain>
Nov 29 05:49:24 user nova-compute[75083]:  {{(pid=75083) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 05:49:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [req-70f0230e-6252-401c-b5d6-4255c17954c3 req-58cae698-0528-4d50-ac76-0a036b51d6e3 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:37:88:c5"/><model type="virtio"/><mtu size="1442"/><target dev="tap90ffff8c-42"/></interface> {{(pid=75083) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 05:49:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [req-70f0230e-6252-401c-b5d6-4255c17954c3 req-58cae698-0528-4d50-ac76-0a036b51d6e3 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:37:88:c5"/><model type="virtio"/><mtu size="1442"/><target dev="tap90ffff8c-42"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 29 05:49:24 user nova-compute[75083]:   <name>instance-00000008</name>
Nov 29 05:49:24 user nova-compute[75083]:   <uuid>b2f88b2e-0244-4e18-98ae-21861b02db3a</uuid>
Nov 29 05:49:24 user nova-compute[75083]:   <metadata>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:49:24 user nova-compute[75083]:   <nova:package version="0.0.0"/>
Nov 29 05:49:24 user nova-compute[75083]:   <nova:name>tempest-device-tagging-server-435233267</nova:name>
Nov 29 05:49:24 user nova-compute[75083]:   <nova:creationTime>2023-11-29 05:49:23</nova:creationTime>
Nov 29 05:49:24 user nova-compute[75083]:   <nova:flavor name="m1.tiny">
Nov 29 05:49:24 user nova-compute[75083]:     <nova:memory>512</nova:memory>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:disk>1</nova:disk>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:swap>0</nova:swap>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:vcpus>1</nova:vcpus>
Nov 29 05:49:24 user nova-compute[75083]:   </nova:flavor>
Nov 29 05:49:24 user nova-compute[75083]:   <nova:owner>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:user uuid="9c746113481e4d179fba6e77efcee7a2">tempest-TaggedAttachmentsTest-2091340319-project-member</nova:user>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:project uuid="8916664e2bf04c018daedae140735f3a">tempest-TaggedAttachmentsTest-2091340319</nova:project>
Nov 29 05:49:24 user nova-compute[75083]:   </nova:owner>
Nov 29 05:49:24 user nova-compute[75083]:   <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:49:24 user nova-compute[75083]:   <nova:ports>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:port uuid="9ac8517e-5bf8-41ec-839e-40dcffd8a7ac">
Nov 29 05:49:24 user nova-compute[75083]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 05:49:24 user nova-compute[75083]:     </nova:port>
Nov 29 05:49:24 user nova-compute[75083]:   </nova:ports>
Nov 29 05:49:24 user nova-compute[75083]: </nova:instance>
Nov 29 05:49:24 user nova-compute[75083]:   </metadata>
Nov 29 05:49:24 user nova-compute[75083]:   <memory unit='KiB'>524288</memory>
Nov 29 05:49:24 user nova-compute[75083]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 05:49:24 user nova-compute[75083]:   <vcpu placement='static'>1</vcpu>
Nov 29 05:49:24 user nova-compute[75083]:   <resource>
Nov 29 05:49:24 user nova-compute[75083]:     <partition>/machine</partition>
Nov 29 05:49:24 user nova-compute[75083]:   </resource>
Nov 29 05:49:24 user nova-compute[75083]:   <sysinfo type='smbios'>
Nov 29 05:49:24 user nova-compute[75083]:     <system>
Nov 29 05:49:24 user nova-compute[75083]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 05:49:24 user nova-compute[75083]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 05:49:24 user nova-compute[75083]:       <entry name='version'>0.0.0</entry>
Nov 29 05:49:24 user nova-compute[75083]:       <entry name='serial'>b2f88b2e-0244-4e18-98ae-21861b02db3a</entry>
Nov 29 05:49:24 user nova-compute[75083]:       <entry name='uuid'>b2f88b2e-0244-4e18-98ae-21861b02db3a</entry>
Nov 29 05:49:24 user nova-compute[75083]:       <entry name='family'>Virtual Machine</entry>
Nov 29 05:49:24 user nova-compute[75083]:     </system>
Nov 29 05:49:24 user nova-compute[75083]:   </sysinfo>
Nov 29 05:49:24 user nova-compute[75083]:   <os>
Nov 29 05:49:24 user nova-compute[75083]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 05:49:24 user nova-compute[75083]:     <boot dev='hd'/>
Nov 29 05:49:24 user nova-compute[75083]:     <smbios mode='sysinfo'/>
Nov 29 05:49:24 user nova-compute[75083]:   </os>
Nov 29 05:49:24 user nova-compute[75083]:   <features>
Nov 29 05:49:24 user nova-compute[75083]:     <acpi/>
Nov 29 05:49:24 user nova-compute[75083]:     <apic/>
Nov 29 05:49:24 user nova-compute[75083]:     <vmcoreinfo state='on'/>
Nov 29 05:49:24 user nova-compute[75083]:   </features>
Nov 29 05:49:24 user nova-compute[75083]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 05:49:24 user nova-compute[75083]:     <model fallback='forbid'>Nehalem</model>
Nov 29 05:49:24 user nova-compute[75083]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 05:49:24 user nova-compute[75083]:     <feature policy='require' name='vme'/>
Nov 29 05:49:24 user nova-compute[75083]:     <feature policy='require' name='x2apic'/>
Nov 29 05:49:24 user nova-compute[75083]:     <feature policy='require' name='hypervisor'/>
Nov 29 05:49:24 user nova-compute[75083]:   </cpu>
Nov 29 05:49:24 user nova-compute[75083]:   <clock offset='utc'>
Nov 29 05:49:24 user nova-compute[75083]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 05:49:24 user nova-compute[75083]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 05:49:24 user nova-compute[75083]:     <timer name='hpet' present='no'/>
Nov 29 05:49:24 user nova-compute[75083]:   </clock>
Nov 29 05:49:24 user nova-compute[75083]:   <on_poweroff>destroy</on_poweroff>
Nov 29 05:49:24 user nova-compute[75083]:   <on_reboot>restart</on_reboot>
Nov 29 05:49:24 user nova-compute[75083]:   <on_crash>destroy</on_crash>
Nov 29 05:49:24 user nova-compute[75083]:   <devices>
Nov 29 05:49:24 user nova-compute[75083]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 05:49:24 user nova-compute[75083]:     <disk type='file' device='disk'>
Nov 29 05:49:24 user nova-compute[75083]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 05:49:24 user nova-compute[75083]:       <source file='/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk' index='2'/>
Nov 29 05:49:24 user nova-compute[75083]:       <backingStore type='file' index='3'>
Nov 29 05:49:24 user nova-compute[75083]:         <format type='raw'/>
Nov 29 05:49:24 user nova-compute[75083]:         <source file='/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a'/>
Nov 29 05:49:24 user nova-compute[75083]:         <backingStore/>
Nov 29 05:49:24 user nova-compute[75083]:       </backingStore>
Nov 29 05:49:24 user nova-compute[75083]:       <target dev='vda' bus='virtio'/>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='virtio-disk0'/>
Nov 29 05:49:24 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </disk>
Nov 29 05:49:24 user nova-compute[75083]:     <disk type='file' device='cdrom'>
Nov 29 05:49:24 user nova-compute[75083]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 05:49:24 user nova-compute[75083]:       <source file='/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/disk.config' index='1'/>
Nov 29 05:49:24 user nova-compute[75083]:       <backingStore/>
Nov 29 05:49:24 user nova-compute[75083]:       <target dev='hda' bus='ide'/>
Nov 29 05:49:24 user nova-compute[75083]:       <readonly/>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='ide0-0-0'/>
Nov 29 05:49:24 user nova-compute[75083]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </disk>
Nov 29 05:49:24 user nova-compute[75083]:     <controller type='usb' index='0' model='none'>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='usb'/>
Nov 29 05:49:24 user nova-compute[75083]:     </controller>
Nov 29 05:49:24 user nova-compute[75083]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='pci.0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </controller>
Nov 29 05:49:24 user nova-compute[75083]:     <controller type='ide' index='0'>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='ide'/>
Nov 29 05:49:24 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 05:49:24 user nova-compute[75083]:     </controller>
Nov 29 05:49:24 user nova-compute[75083]:     <interface type='ethernet'>
Nov 29 05:49:24 user nova-compute[75083]:       <mac address='fa:16:3e:b3:28:72'/>
Nov 29 05:49:24 user nova-compute[75083]:       <target dev='tap9ac8517e-5b'/>
Nov 29 05:49:24 user nova-compute[75083]:       <model type='virtio'/>
Nov 29 05:49:24 user nova-compute[75083]:       <mtu size='1442'/>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='net0'/>
Nov 29 05:49:24 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </interface>
Nov 29 05:49:24 user nova-compute[75083]:     <serial type='pty'>
Nov 29 05:49:24 user nova-compute[75083]:       <source path='/dev/pts/7'/>
Nov 29 05:49:24 user nova-compute[75083]:       <log file='/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/console.log' append='off'/>
Nov 29 05:49:24 user nova-compute[75083]:       <target type='isa-serial' port='0'>
Nov 29 05:49:24 user nova-compute[75083]:         <model name='isa-serial'/>
Nov 29 05:49:24 user nova-compute[75083]:       </target>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='serial0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </serial>
Nov 29 05:49:24 user nova-compute[75083]:     <console type='pty' tty='/dev/pts/7'>
Nov 29 05:49:24 user nova-compute[75083]:       <source path='/dev/pts/7'/>
Nov 29 05:49:24 user nova-compute[75083]:       <log file='/opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a/console.log' append='off'/>
Nov 29 05:49:24 user nova-compute[75083]:       <target type='serial' port='0'/>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='serial0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </console>
Nov 29 05:49:24 user nova-compute[75083]:     <input type='mouse' bus='ps2'>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='input0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </input>
Nov 29 05:49:24 user nova-compute[75083]:     <input type='keyboard' bus='ps2'>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='input1'/>
Nov 29 05:49:24 user nova-compute[75083]:     </input>
Nov 29 05:49:24 user nova-compute[75083]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 29 05:49:24 user nova-compute[75083]:       <listen type='address' address='0.0.0.0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </graphics>
Nov 29 05:49:24 user nova-compute[75083]:     <audio id='1' type='none'/>
Nov 29 05:49:24 user nova-compute[75083]:     <video>
Nov 29 05:49:24 user nova-compute[75083]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='video0'/>
Nov 29 05:49:24 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </video>
Nov 29 05:49:24 user nova-compute[75083]:     <memballoon model='virtio'>
Nov 29 05:49:24 user nova-compute[75083]:       <stats period='10'/>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='balloon0'/>
Nov 29 05:49:24 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </memballoon>
Nov 29 05:49:24 user nova-compute[75083]:     <rng model='virtio'>
Nov 29 05:49:24 user nova-compute[75083]:       <backend model='random'>/dev/urandom</backend>
Nov 29 05:49:24 user nova-compute[75083]:       <alias name='rng0'/>
Nov 29 05:49:24 user nova-compute[75083]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 05:49:24 user nova-compute[75083]:     </rng>
Nov 29 05:49:24 user nova-compute[75083]:   </devices>
Nov 29 05:49:24 user nova-compute[75083]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 05:49:24 user nova-compute[75083]:     <label>libvirt-b2f88b2e-0244-4e18-98ae-21861b02db3a</label>
Nov 29 05:49:24 user nova-compute[75083]:     <imagelabel>libvirt-b2f88b2e-0244-4e18-98ae-21861b02db3a</imagelabel>
Nov 29 05:49:24 user nova-compute[75083]:   </seclabel>
Nov 29 05:49:24 user nova-compute[75083]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 05:49:24 user nova-compute[75083]:     <label>+64055:+108</label>
Nov 29 05:49:24 user nova-compute[75083]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 05:49:24 user nova-compute[75083]:   </seclabel>
Nov 29 05:49:24 user nova-compute[75083]: </domain>
Nov 29 05:49:24 user nova-compute[75083]:  {{(pid=75083) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 05:49:24 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [req-70f0230e-6252-401c-b5d6-4255c17954c3 req-58cae698-0528-4d50-ac76-0a036b51d6e3 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Detaching interface fa:16:3e:37:88:c5 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap90ffff8c-42' not found.
Nov 29 05:49:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [req-70f0230e-6252-401c-b5d6-4255c17954c3 req-58cae698-0528-4d50-ac76-0a036b51d6e3 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-435233267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-435233267',id=8,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVo1YmBFLd3yYkAIW3JoUP4JziHChmMQVX+ttBFc7qW+T8emUJzEuqgOO60aMaVCz4WsSuNB1wNEq+HNrQ09nJNiqezTzIp51WzgrWGg90AnD0HNS2LM7B+NhJDHUeq3A==',key_name='tempest-keypair-489296993',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8916664e2bf04c018daedae140735f3a',ramdisk_id='',reservation_id='r-mli56wj6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2091340319',owner_user_name='tempest-TaggedAttachmentsTest-2091340319-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:46:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c746113481e4d179fba6e77efcee7a2',uuid=b2f88b2e-0244-4e18-98ae-21861b02db3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90ffff8c-4211-4ef0-b043-f632e883962b", "address": "fa:16:3e:37:88:c5", "network": {"id": "a1790ee1-80c8-4a22-81b3-abbf42053cef", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-830898710", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ffff8c-42", "ovs_interfaceid": "90ffff8c-4211-4ef0-b043-f632e883962b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:49:24 user nova-compute[75083]: DEBUG nova.network.os_vif_util [req-70f0230e-6252-401c-b5d6-4255c17954c3 req-58cae698-0528-4d50-ac76-0a036b51d6e3 service nova] Converting VIF {"id": "90ffff8c-4211-4ef0-b043-f632e883962b", "address": "fa:16:3e:37:88:c5", "network": {"id": "a1790ee1-80c8-4a22-81b3-abbf42053cef", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-830898710", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ffff8c-42", "ovs_interfaceid": "90ffff8c-4211-4ef0-b043-f632e883962b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:49:24 user nova-compute[75083]: DEBUG nova.network.os_vif_util [req-70f0230e-6252-401c-b5d6-4255c17954c3 req-58cae698-0528-4d50-ac76-0a036b51d6e3 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:88:c5,bridge_name='br-int',has_traffic_filtering=True,id=90ffff8c-4211-4ef0-b043-f632e883962b,network=Network(a1790ee1-80c8-4a22-81b3-abbf42053cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ffff8c-42') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:49:24 user nova-compute[75083]: DEBUG os_vif [req-70f0230e-6252-401c-b5d6-4255c17954c3 req-58cae698-0528-4d50-ac76-0a036b51d6e3 service nova] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:88:c5,bridge_name='br-int',has_traffic_filtering=True,id=90ffff8c-4211-4ef0-b043-f632e883962b,network=Network(a1790ee1-80c8-4a22-81b3-abbf42053cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ffff8c-42') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:49:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90ffff8c-42, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:49:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:49:24 user nova-compute[75083]: INFO os_vif [req-70f0230e-6252-401c-b5d6-4255c17954c3 req-58cae698-0528-4d50-ac76-0a036b51d6e3 service nova] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:88:c5,bridge_name='br-int',has_traffic_filtering=True,id=90ffff8c-4211-4ef0-b043-f632e883962b,network=Network(a1790ee1-80c8-4a22-81b3-abbf42053cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ffff8c-42')
Nov 29 05:49:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [req-70f0230e-6252-401c-b5d6-4255c17954c3 req-58cae698-0528-4d50-ac76-0a036b51d6e3 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:49:24 user nova-compute[75083]:   <nova:package version="0.0.0"/>
Nov 29 05:49:24 user nova-compute[75083]:   <nova:name>tempest-device-tagging-server-435233267</nova:name>
Nov 29 05:49:24 user nova-compute[75083]:   <nova:creationTime>2023-11-29 05:49:24</nova:creationTime>
Nov 29 05:49:24 user nova-compute[75083]:   <nova:flavor name="m1.tiny">
Nov 29 05:49:24 user nova-compute[75083]:     <nova:memory>512</nova:memory>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:disk>1</nova:disk>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:swap>0</nova:swap>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:vcpus>1</nova:vcpus>
Nov 29 05:49:24 user nova-compute[75083]:   </nova:flavor>
Nov 29 05:49:24 user nova-compute[75083]:   <nova:owner>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:user uuid="9c746113481e4d179fba6e77efcee7a2">tempest-TaggedAttachmentsTest-2091340319-project-member</nova:user>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:project uuid="8916664e2bf04c018daedae140735f3a">tempest-TaggedAttachmentsTest-2091340319</nova:project>
Nov 29 05:49:24 user nova-compute[75083]:   </nova:owner>
Nov 29 05:49:24 user nova-compute[75083]:   <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:49:24 user nova-compute[75083]:   <nova:ports>
Nov 29 05:49:24 user nova-compute[75083]:     <nova:port uuid="9ac8517e-5bf8-41ec-839e-40dcffd8a7ac">
Nov 29 05:49:24 user nova-compute[75083]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 05:49:24 user nova-compute[75083]:     </nova:port>
Nov 29 05:49:24 user nova-compute[75083]:   </nova:ports>
Nov 29 05:49:24 user nova-compute[75083]: </nova:instance>
Nov 29 05:49:24 user nova-compute[75083]:  {{(pid=75083) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 05:49:25 user nova-compute[75083]: INFO nova.network.neutron [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Port 90ffff8c-4211-4ef0-b043-f632e883962b from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 29 05:49:25 user nova-compute[75083]: DEBUG nova.network.neutron [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Updating instance_info_cache with network_info: [{"id": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "address": "fa:16:3e:b3:28:72", "network": {"id": "acfa7005-35a1-408e-a897-5920887137b3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-302522629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac8517e-5b", "ovs_interfaceid": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:49:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Releasing lock "refresh_cache-b2f88b2e-0244-4e18-98ae-21861b02db3a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:49:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-98f3b57e-754e-4f82-96e7-539b459775cd tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "interface-b2f88b2e-0244-4e18-98ae-21861b02db3a-90ffff8c-4211-4ef0-b043-f632e883962b" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.636s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:31 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ae18699b-d0cf-44b5-8467-a112fd154580 is timed out.
Nov 29 05:49:31 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Successfully detached device vdb from instance ae18699b-d0cf-44b5-8467-a112fd154580 from the live domain config.
Nov 29 05:49:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viLUoyJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '74982c7f-1ac4-4d4f-b76c-521e310f1780'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:49:31 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:49:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b0daaf-b112-44b5-8321-4d8aa3cab417]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:49:31 user nova-compute[75083]: No targets found.
Nov 29 05:49:31 user nova-compute[75083]: iSNS:
Nov 29 05:49:31 user nova-compute[75083]: No targets found.
Nov 29 05:49:31 user nova-compute[75083]: STATIC:
Nov 29 05:49:31 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e
Nov 29 05:49:31 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:49:31 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:49:31 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780
Nov 29 05:49:31 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:49:31 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:49:31 user nova-compute[75083]: FIRMWARE:
Nov 29 05:49:31 user nova-compute[75083]: No targets found.
Nov 29 05:49:31 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:49:31 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:49:31 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff2f9f1-6385-4d11-a6fa-ef652461279b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ddecab-158b-4bce-9579-60d910f499af]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:49:31 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:49:31 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 (non-flash)
Nov 29 05:49:31 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:49:31 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b84835b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c104f2-b1fd-4810-9316-a1a451b6a104]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4b0c47-80c8-4830-b60e-67232564760f]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c24c587-717e-4b3e-a821-347f7a09d11b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eef47c5-8b81-4f7c-99ab-9d3bf629f933]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ca2f3a-9bf8-40c8-8b7c-99f37269e12c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0b9fb0-bb9d-4270-8582-574200cd1684]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780, portal: 172.16.0.220,3260]
Nov 29 05:49:32 user nova-compute[75083]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780, portal: 172.16.0.220,3260] successful.
Nov 29 05:49:32 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74982c7f-1ac4-4d4f-b76c-521e310f1780 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[61279841-45bc-4e83-9913-94baed3c96c7]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:49:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] <== disconnect_volume: return (296ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:49:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:49:32 user nova-compute[75083]: DEBUG nova.objects.instance [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lazy-loading 'flavor' on Instance uuid ae18699b-d0cf-44b5-8467-a112fd154580 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:49:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-bf4d105b-d44c-4a7c-a302-bfc40169847f tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "ae18699b-d0cf-44b5-8467-a112fd154580" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.671s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Acquiring lock "12989829-1b4c-4aaf-ad24-b30488c4e472" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:49:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Lock "12989829-1b4c-4aaf-ad24-b30488c4e472" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Acquiring lock "12989829-1b4c-4aaf-ad24-b30488c4e472-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:49:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Lock "12989829-1b4c-4aaf-ad24-b30488c4e472-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Lock "12989829-1b4c-4aaf-ad24-b30488c4e472-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:40 user nova-compute[75083]: INFO nova.compute.manager [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Terminating instance
Nov 29 05:49:40 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:49:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG nova.compute.manager [req-687776c9-e3e7-47cd-b301-6f19a8adf01f req-76fc5834-2b07-4d13-b187-152b2b5bd5da service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Received event network-vif-unplugged-ccdce1d3-0ef3-437b-aaab-383bc235b27f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-687776c9-e3e7-47cd-b301-6f19a8adf01f req-76fc5834-2b07-4d13-b187-152b2b5bd5da service nova] Acquiring lock "12989829-1b4c-4aaf-ad24-b30488c4e472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-687776c9-e3e7-47cd-b301-6f19a8adf01f req-76fc5834-2b07-4d13-b187-152b2b5bd5da service nova] Lock "12989829-1b4c-4aaf-ad24-b30488c4e472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-687776c9-e3e7-47cd-b301-6f19a8adf01f req-76fc5834-2b07-4d13-b187-152b2b5bd5da service nova] Lock "12989829-1b4c-4aaf-ad24-b30488c4e472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG nova.compute.manager [req-687776c9-e3e7-47cd-b301-6f19a8adf01f req-76fc5834-2b07-4d13-b187-152b2b5bd5da service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] No waiting events found dispatching network-vif-unplugged-ccdce1d3-0ef3-437b-aaab-383bc235b27f {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG nova.compute.manager [req-687776c9-e3e7-47cd-b301-6f19a8adf01f req-76fc5834-2b07-4d13-b187-152b2b5bd5da service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Received event network-vif-unplugged-ccdce1d3-0ef3-437b-aaab-383bc235b27f for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:49:41 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Instance destroyed successfully.
Nov 29 05:49:41 user nova-compute[75083]: DEBUG nova.objects.instance [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Lazy-loading 'resources' on Instance uuid 12989829-1b4c-4aaf-ad24-b30488c4e472 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-981525727',display_name='tempest-VolumesAssistedSnapshotsTest-server-981525727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-981525727',id=9,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUF3io1TF9VV8r8jVCmuijZpXkF6gU8DDpNCqepn2zLZd23+Ke1vrmDTusSKcyGICYvwnXlf6mWnVBaNEbz3gvN1a7lr7DUheCMYD1wc949VJw4kUjigQa/psy1MBShbw==',key_name='tempest-keypair-583905881',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='228d74739f504c8aa3a034742390113c',ramdisk_id='',reservation_id='r-fwlp05s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1291886007',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1291886007-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:46:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6de4aa0d366546268ed7254afaaf7b08',uuid=12989829-1b4c-4aaf-ad24-b30488c4e472,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "address": "fa:16:3e:47:af:1e", "network": {"id": "7b7dbeb9-8470-4f69-9c8d-537c75e4c009", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-386572162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228d74739f504c8aa3a034742390113c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccdce1d3-0e", "ovs_interfaceid": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Converting VIF {"id": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "address": "fa:16:3e:47:af:1e", "network": {"id": "7b7dbeb9-8470-4f69-9c8d-537c75e4c009", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-386572162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228d74739f504c8aa3a034742390113c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccdce1d3-0e", "ovs_interfaceid": "ccdce1d3-0ef3-437b-aaab-383bc235b27f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:af:1e,bridge_name='br-int',has_traffic_filtering=True,id=ccdce1d3-0ef3-437b-aaab-383bc235b27f,network=Network(7b7dbeb9-8470-4f69-9c8d-537c75e4c009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccdce1d3-0e') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG os_vif [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:af:1e,bridge_name='br-int',has_traffic_filtering=True,id=ccdce1d3-0ef3-437b-aaab-383bc235b27f,network=Network(7b7dbeb9-8470-4f69-9c8d-537c75e4c009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccdce1d3-0e') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccdce1d3-0e, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe39952c-ed59-4a4b-bb49-ac7fdfcd0081) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:41 user nova-compute[75083]: INFO os_vif [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:af:1e,bridge_name='br-int',has_traffic_filtering=True,id=ccdce1d3-0ef3-437b-aaab-383bc235b27f,network=Network(7b7dbeb9-8470-4f69-9c8d-537c75e4c009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccdce1d3-0e')
Nov 29 05:49:41 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Deleting instance files /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472_del
Nov 29 05:49:41 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Deletion of /opt/stack/data/nova/instances/12989829-1b4c-4aaf-ad24-b30488c4e472_del complete
Nov 29 05:49:41 user nova-compute[75083]: INFO nova.compute.manager [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 05:49:41 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 05:49:41 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 05:49:42 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:49:42 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Took 0.90 seconds to deallocate network for instance.
Nov 29 05:49:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-df4ebdfe-f8e6-4294-a84a-ec8b6b1b632d req-576a6156-e8c8-426c-b17f-bb13085007a9 service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Received event network-vif-deleted-ccdce1d3-0ef3-437b-aaab-383bc235b27f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:49:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:49:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:42 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:49:42 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:49:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:42 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Deleted allocations for instance 12989829-1b4c-4aaf-ad24-b30488c4e472
Nov 29 05:49:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8187839e-1fc0-438c-898d-c41eda9214c2 tempest-VolumesAssistedSnapshotsTest-1291886007 tempest-VolumesAssistedSnapshotsTest-1291886007-project-member] Lock "12989829-1b4c-4aaf-ad24-b30488c4e472" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.200s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-03fe2dab-6f42-425d-b64c-a5e18c9797df req-9fe89ca9-a764-4961-af6e-9d9d7257a0ed service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Received event network-vif-plugged-ccdce1d3-0ef3-437b-aaab-383bc235b27f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:49:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-03fe2dab-6f42-425d-b64c-a5e18c9797df req-9fe89ca9-a764-4961-af6e-9d9d7257a0ed service nova] Acquiring lock "12989829-1b4c-4aaf-ad24-b30488c4e472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:49:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-03fe2dab-6f42-425d-b64c-a5e18c9797df req-9fe89ca9-a764-4961-af6e-9d9d7257a0ed service nova] Lock "12989829-1b4c-4aaf-ad24-b30488c4e472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-03fe2dab-6f42-425d-b64c-a5e18c9797df req-9fe89ca9-a764-4961-af6e-9d9d7257a0ed service nova] Lock "12989829-1b4c-4aaf-ad24-b30488c4e472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-03fe2dab-6f42-425d-b64c-a5e18c9797df req-9fe89ca9-a764-4961-af6e-9d9d7257a0ed service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] No waiting events found dispatching network-vif-plugged-ccdce1d3-0ef3-437b-aaab-383bc235b27f {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:49:43 user nova-compute[75083]: WARNING nova.compute.manager [req-03fe2dab-6f42-425d-b64c-a5e18c9797df req-9fe89ca9-a764-4961-af6e-9d9d7257a0ed service nova] [instance: 12989829-1b4c-4aaf-ad24-b30488c4e472] Received unexpected event network-vif-plugged-ccdce1d3-0ef3-437b-aaab-383bc235b27f for instance with vm_state deleted and task_state None.
Nov 29 05:49:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:49:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:50 user nova-compute[75083]: DEBUG nova.objects.instance [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lazy-loading 'flavor' on Instance uuid ee1bba24-17d0-4fc3-8bff-1337d86cc9be {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:49:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:49:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:50 user nova-compute[75083]: INFO nova.compute.manager [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Attaching volume 7cabbe02-0d11-483c-b05e-9d94c28862a5 to /dev/vdb
Nov 29 05:49:51 user nova-compute[75083]: DEBUG os_brick.utils [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dee2baa-0325-4573-99dd-4183ce87ea68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8285dc6-cb79-4e7c-899d-f0b7ef69ef9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3ff6e9-27ea-49e4-bec2-f051c88c9015]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[40068e89-292c-4454-b108-44b419f83a9c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:49:51 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:49:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efbc6c0-29e7-4a42-86c4-cefd7818ea9f]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG os_brick.utils [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Updating existing volume attachment record: f6f524b8-2864-48c5-8661-8d0d4b99ad42 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 05:49:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquiring lock "b2f88b2e-0244-4e18-98ae-21861b02db3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:49:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquiring lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:49:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:54 user nova-compute[75083]: INFO nova.compute.manager [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Terminating instance
Nov 29 05:49:54 user nova-compute[75083]: DEBUG nova.compute.manager [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:49:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:54 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:49:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:54 user nova-compute[75083]: DEBUG nova.compute.manager [req-772d6a98-72f3-4bcd-b7b7-a0fb6d727771 req-55ae98cb-9747-43a0-855e-087775a61373 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received event network-vif-unplugged-9ac8517e-5bf8-41ec-839e-40dcffd8a7ac {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:49:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-772d6a98-72f3-4bcd-b7b7-a0fb6d727771 req-55ae98cb-9747-43a0-855e-087775a61373 service nova] Acquiring lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:49:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-772d6a98-72f3-4bcd-b7b7-a0fb6d727771 req-55ae98cb-9747-43a0-855e-087775a61373 service nova] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-772d6a98-72f3-4bcd-b7b7-a0fb6d727771 req-55ae98cb-9747-43a0-855e-087775a61373 service nova] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:54 user nova-compute[75083]: DEBUG nova.compute.manager [req-772d6a98-72f3-4bcd-b7b7-a0fb6d727771 req-55ae98cb-9747-43a0-855e-087775a61373 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] No waiting events found dispatching network-vif-unplugged-9ac8517e-5bf8-41ec-839e-40dcffd8a7ac {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:49:54 user nova-compute[75083]: DEBUG nova.compute.manager [req-772d6a98-72f3-4bcd-b7b7-a0fb6d727771 req-55ae98cb-9747-43a0-855e-087775a61373 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received event network-vif-unplugged-9ac8517e-5bf8-41ec-839e-40dcffd8a7ac for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:49:55 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Instance destroyed successfully.
Nov 29 05:49:55 user nova-compute[75083]: DEBUG nova.objects.instance [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lazy-loading 'resources' on Instance uuid b2f88b2e-0244-4e18-98ae-21861b02db3a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:49:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T05:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-435233267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-435233267',id=8,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVo1YmBFLd3yYkAIW3JoUP4JziHChmMQVX+ttBFc7qW+T8emUJzEuqgOO60aMaVCz4WsSuNB1wNEq+HNrQ09nJNiqezTzIp51WzgrWGg90AnD0HNS2LM7B+NhJDHUeq3A==',key_name='tempest-keypair-489296993',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8916664e2bf04c018daedae140735f3a',ramdisk_id='',reservation_id='r-mli56wj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2091340319',owner_user_name='tempest-TaggedAttachmentsTest-2091340319-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:46:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c746113481e4d179fba6e77efcee7a2',uuid=b2f88b2e-0244-4e18-98ae-21861b02db3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "address": "fa:16:3e:b3:28:72", "network": {"id": "acfa7005-35a1-408e-a897-5920887137b3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-302522629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac8517e-5b", "ovs_interfaceid": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:49:55 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Converting VIF {"id": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "address": "fa:16:3e:b3:28:72", "network": {"id": "acfa7005-35a1-408e-a897-5920887137b3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-302522629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8916664e2bf04c018daedae140735f3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac8517e-5b", "ovs_interfaceid": "9ac8517e-5bf8-41ec-839e-40dcffd8a7ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:49:55 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:28:72,bridge_name='br-int',has_traffic_filtering=True,id=9ac8517e-5bf8-41ec-839e-40dcffd8a7ac,network=Network(acfa7005-35a1-408e-a897-5920887137b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac8517e-5b') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:49:55 user nova-compute[75083]: DEBUG os_vif [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:28:72,bridge_name='br-int',has_traffic_filtering=True,id=9ac8517e-5bf8-41ec-839e-40dcffd8a7ac,network=Network(acfa7005-35a1-408e-a897-5920887137b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac8517e-5b') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:49:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ac8517e-5b, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:49:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:49:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56643b98-1764-4f3e-8f4b-09c3f5cebeef) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:49:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:49:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:55 user nova-compute[75083]: INFO os_vif [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:28:72,bridge_name='br-int',has_traffic_filtering=True,id=9ac8517e-5bf8-41ec-839e-40dcffd8a7ac,network=Network(acfa7005-35a1-408e-a897-5920887137b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac8517e-5b')
Nov 29 05:49:55 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Deleting instance files /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a_del
Nov 29 05:49:55 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Deletion of /opt/stack/data/nova/instances/b2f88b2e-0244-4e18-98ae-21861b02db3a_del complete
Nov 29 05:49:55 user nova-compute[75083]: INFO nova.compute.manager [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 29 05:49:55 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 05:49:55 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 05:49:55 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 05:49:56 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:49:56 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Took 0.96 seconds to deallocate network for instance.
Nov 29 05:49:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:49:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:56 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:49:56 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:49:56 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:49:56 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:49:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:56 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Deleted allocations for instance b2f88b2e-0244-4e18-98ae-21861b02db3a
Nov 29 05:49:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:49:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-14a7f511-d321-478f-97d4-496cd8d17f5c tempest-TaggedAttachmentsTest-2091340319 tempest-TaggedAttachmentsTest-2091340319-project-member] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.428s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:56 user nova-compute[75083]: DEBUG nova.compute.manager [req-5a9408cc-6ea7-4242-93fc-2e60ba1638a8 req-48f12d66-f5b7-4058-bc28-39fb8d251725 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received event network-vif-plugged-9ac8517e-5bf8-41ec-839e-40dcffd8a7ac {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:49:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5a9408cc-6ea7-4242-93fc-2e60ba1638a8 req-48f12d66-f5b7-4058-bc28-39fb8d251725 service nova] Acquiring lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:49:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5a9408cc-6ea7-4242-93fc-2e60ba1638a8 req-48f12d66-f5b7-4058-bc28-39fb8d251725 service nova] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5a9408cc-6ea7-4242-93fc-2e60ba1638a8 req-48f12d66-f5b7-4058-bc28-39fb8d251725 service nova] Lock "b2f88b2e-0244-4e18-98ae-21861b02db3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:56 user nova-compute[75083]: DEBUG nova.compute.manager [req-5a9408cc-6ea7-4242-93fc-2e60ba1638a8 req-48f12d66-f5b7-4058-bc28-39fb8d251725 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] No waiting events found dispatching network-vif-plugged-9ac8517e-5bf8-41ec-839e-40dcffd8a7ac {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:49:56 user nova-compute[75083]: WARNING nova.compute.manager [req-5a9408cc-6ea7-4242-93fc-2e60ba1638a8 req-48f12d66-f5b7-4058-bc28-39fb8d251725 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received unexpected event network-vif-plugged-9ac8517e-5bf8-41ec-839e-40dcffd8a7ac for instance with vm_state deleted and task_state None.
Nov 29 05:49:56 user nova-compute[75083]: DEBUG nova.compute.manager [req-5a9408cc-6ea7-4242-93fc-2e60ba1638a8 req-48f12d66-f5b7-4058-bc28-39fb8d251725 service nova] [instance: b2f88b2e-0244-4e18-98ae-21861b02db3a] Received event network-vif-deleted-9ac8517e-5bf8-41ec-839e-40dcffd8a7ac {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:49:57 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:49:57 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 05:49:57 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 29 05:49:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:49:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:49:57 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 05:49:58 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Updating instance_info_cache with network_info: [{"id": "188d4866-21b0-4a1e-a17a-c0c82e849726", "address": "fa:16:3e:a8:14:4a", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d4866-21", "ovs_interfaceid": "188d4866-21b0-4a1e-a17a-c0c82e849726", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:49:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:49:58 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 05:49:58 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:49:58 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:49:58 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 05:49:58 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:49:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:49:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:49:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:49:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 05:49:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MsfWBgNZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:49:59 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:49:59 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:49:59 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2a0f49-c553-41e3-844b-48accbfc1a5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:49:59 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[04761655-8ec4-4f75-bca4-c38792f1d258]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5] added
Nov 29 05:49:59 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50a8be2-a475-40f9-8c76-b56215de3c1d]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.053s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c5ffb1-ab53-4af8-b014-26aa87e1ff0b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MsfWBgNZ {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MsfWBgNZ" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72d051b-3f06-40c0-aca7-f2fb478d4498]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MsfWBgNZ'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fbc0fe-86c3-4c73-b36f-924e4a922170]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a213b6-d1b6-4c1f-9bfa-e9c5388785ac]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:49:59 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:49:59 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67dff2a-e80d-4616-9fbc-3c3784fe25b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5, portal: 172.16.0.220,3260]
Nov 29 05:49:59 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5, portal: 172.16.0.220,3260] successful.
Nov 29 05:49:59 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea826f6-ba88-4b3d-9819-2f2b99003327]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e459aefc-c45e-4e6a-8ae2-d766798347bf]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:49:59 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:49:59 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:49:59 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:49:59 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[48058225-3566-408f-9dff-2152420c1cc6]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:49:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MsfWBgNZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:50:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:50:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.465s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] <== connect_volume: return (1467ms) {'type': 'block', 'scsi_wwn': '26636626635633735', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636626635633735', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:50:01 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:50:01 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:50:01 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8549MB free_disk=25.551441192626953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG nova.objects.instance [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lazy-loading 'flavor' on Instance uuid ee1bba24-17d0-4fc3-8bff-1337d86cc9be {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 05:50:01 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:50:01 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 05:50:01 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:50:01 user nova-compute[75083]:   <serial>7cabbe02-0d11-483c-b05e-9d94c28862a5</serial>
Nov 29 05:50:01 user nova-compute[75083]: </disk>
Nov 29 05:50:01 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance e6d49806-cecd-473a-b92f-9255868d35c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance ee1bba24-17d0-4fc3-8bff-1337d86cc9be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 161c6455-90ce-4c40-a33e-7f582989135d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance ae18699b-d0cf-44b5-8467-a112fd154580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b6d38a2c-a512-41f2-a7df-6a54058f8f8b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG nova.compute.manager [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.608s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.133s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:50:01 user nova-compute[75083]: INFO nova.compute.claims [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Claim successful on node user
Nov 29 05:50:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Acquiring lock "ae18699b-d0cf-44b5-8467-a112fd154580" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "ae18699b-d0cf-44b5-8467-a112fd154580" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Acquiring lock "ae18699b-d0cf-44b5-8467-a112fd154580-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "ae18699b-d0cf-44b5-8467-a112fd154580-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "ae18699b-d0cf-44b5-8467-a112fd154580-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] No VIF found with MAC fa:16:3e:76:b7:47, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:50:01 user nova-compute[75083]: INFO nova.compute.manager [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Terminating instance
Nov 29 05:50:01 user nova-compute[75083]: DEBUG nova.compute.manager [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-68ab3682-54b4-47af-b823-48e13271597f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.053s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG nova.compute.manager [req-b123cb78-d377-49da-8818-cc1bcb61a2ce req-943bbb5a-72a7-4e96-b7c5-bdeda6352865 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Received event network-vif-unplugged-576fd898-62e6-4bf7-a914-6b94081176b1 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b123cb78-d377-49da-8818-cc1bcb61a2ce req-943bbb5a-72a7-4e96-b7c5-bdeda6352865 service nova] Acquiring lock "ae18699b-d0cf-44b5-8467-a112fd154580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b123cb78-d377-49da-8818-cc1bcb61a2ce req-943bbb5a-72a7-4e96-b7c5-bdeda6352865 service nova] Lock "ae18699b-d0cf-44b5-8467-a112fd154580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b123cb78-d377-49da-8818-cc1bcb61a2ce req-943bbb5a-72a7-4e96-b7c5-bdeda6352865 service nova] Lock "ae18699b-d0cf-44b5-8467-a112fd154580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG nova.compute.manager [req-b123cb78-d377-49da-8818-cc1bcb61a2ce req-943bbb5a-72a7-4e96-b7c5-bdeda6352865 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] No waiting events found dispatching network-vif-unplugged-576fd898-62e6-4bf7-a914-6b94081176b1 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG nova.compute.manager [req-b123cb78-d377-49da-8818-cc1bcb61a2ce req-943bbb5a-72a7-4e96-b7c5-bdeda6352865 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Received event network-vif-unplugged-576fd898-62e6-4bf7-a914-6b94081176b1 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG nova.compute.manager [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG nova.compute.manager [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG nova.network.neutron [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:50:02 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:50:02 user nova-compute[75083]: DEBUG nova.compute.manager [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG nova.compute.manager [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:50:02 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Creating image(s)
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "/opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "/opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG nova.policy [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbd7f863ad7c4229957c4b08601b5003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d0f3dd09bf436498e67d7bfdd904bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "47437526-c4e4-4a15-ba9b-51bbae17c77b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:02 user nova-compute[75083]: INFO nova.compute.manager [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Unshelving
Nov 29 05:50:02 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Instance destroyed successfully.
Nov 29 05:50:02 user nova-compute[75083]: DEBUG nova.objects.instance [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lazy-loading 'resources' on Instance uuid ae18699b-d0cf-44b5-8467-a112fd154580 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-243593488',display_name='tempest-TestVolumeSwap-server-243593488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-243593488',id=7,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNk6U9fL+cCmVxUB+GYgbg3rqejQxUVvAg8+Adeq8b2M7Q6RgkPR2YnNwVLVM7MHhCaCXMaEP3DVETchA37HzlY6FfPgTRTzDZn1LwLlMZvDEpHKPLzWTLPN1YzMt/ZCVQ==',key_name='tempest-keypair-1787660746',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e7f2ae08bd241fcaa60e97d864545f3',ramdisk_id='',reservation_id='r-0baugmjz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1735569809',owner_user_name='tempest-TestVolumeSwap-1735569809-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:46:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b9424c8a1054c8f8128ef0f0a2b6dcf',uuid=ae18699b-d0cf-44b5-8467-a112fd154580,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "576fd898-62e6-4bf7-a914-6b94081176b1", "address": "fa:16:3e:4f:5a:84", "network": {"id": "e98dee6b-18b4-41c2-af52-23b9bead051d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-91142156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7f2ae08bd241fcaa60e97d864545f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576fd898-62", "ovs_interfaceid": "576fd898-62e6-4bf7-a914-6b94081176b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Converting VIF {"id": "576fd898-62e6-4bf7-a914-6b94081176b1", "address": "fa:16:3e:4f:5a:84", "network": {"id": "e98dee6b-18b4-41c2-af52-23b9bead051d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-91142156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7f2ae08bd241fcaa60e97d864545f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576fd898-62", "ovs_interfaceid": "576fd898-62e6-4bf7-a914-6b94081176b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:5a:84,bridge_name='br-int',has_traffic_filtering=True,id=576fd898-62e6-4bf7-a914-6b94081176b1,network=Network(e98dee6b-18b4-41c2-af52-23b9bead051d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap576fd898-62') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG os_vif [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:5a:84,bridge_name='br-int',has_traffic_filtering=True,id=576fd898-62e6-4bf7-a914-6b94081176b1,network=Network(e98dee6b-18b4-41c2-af52-23b9bead051d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap576fd898-62') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap576fd898-62, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.220s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:02 user nova-compute[75083]: INFO nova.virt.block_device [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Booting with volume af19f30c-72b8-4314-8bd3-1ca696377611 at /dev/vdc
Nov 29 05:50:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5612df26-331e-46c3-bf48-1a771b86ba6c) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:02 user nova-compute[75083]: INFO os_vif [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:5a:84,bridge_name='br-int',has_traffic_filtering=True,id=576fd898-62e6-4bf7-a914-6b94081176b1,network=Network(e98dee6b-18b4-41c2-af52-23b9bead051d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap576fd898-62')
Nov 29 05:50:02 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Deleting instance files /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580_del
Nov 29 05:50:02 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Deletion of /opt/stack/data/nova/instances/ae18699b-d0cf-44b5-8467-a112fd154580_del complete
Nov 29 05:50:02 user nova-compute[75083]: INFO nova.compute.manager [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG os_brick.utils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f771f6d-6c9a-4aa5-b71e-77716b4a178f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.200s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5ef766-2057-42be-81ef-b4994a124af5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk 1073741824" returned: 0 in 0.058s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7478fd-9dfa-4e78-9067-21d5cebe342e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cf81c8-5b92-4ae5-be04-3123f4ca03e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:50:03 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:50:03 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[766fba73-2f56-4d82-831d-1d008a3d6c12]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG os_brick.utils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] <== get_connector_properties: return (234ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Updating existing volume attachment record: 412950e6-78bc-42e6-b6cd-a6dcda7c3ac0 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.269s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Cannot resize image /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Ensure instance console log exists: /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:03 user nova-compute[75083]: INFO nova.compute.manager [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Rescuing
Nov 29 05:50:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquired lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:50:03 user nova-compute[75083]: DEBUG nova.network.neutron [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:50:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-75a8f0b7-de06-449b-956e-984a4cf714d2 req-949e58d7-1a1e-48de-aeb6-4abeb2efcaf0 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Received event network-vif-plugged-576fd898-62e6-4bf7-a914-6b94081176b1 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:50:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-75a8f0b7-de06-449b-956e-984a4cf714d2 req-949e58d7-1a1e-48de-aeb6-4abeb2efcaf0 service nova] Acquiring lock "ae18699b-d0cf-44b5-8467-a112fd154580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-75a8f0b7-de06-449b-956e-984a4cf714d2 req-949e58d7-1a1e-48de-aeb6-4abeb2efcaf0 service nova] Lock "ae18699b-d0cf-44b5-8467-a112fd154580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-75a8f0b7-de06-449b-956e-984a4cf714d2 req-949e58d7-1a1e-48de-aeb6-4abeb2efcaf0 service nova] Lock "ae18699b-d0cf-44b5-8467-a112fd154580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-75a8f0b7-de06-449b-956e-984a4cf714d2 req-949e58d7-1a1e-48de-aeb6-4abeb2efcaf0 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] No waiting events found dispatching network-vif-plugged-576fd898-62e6-4bf7-a914-6b94081176b1 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:50:04 user nova-compute[75083]: WARNING nova.compute.manager [req-75a8f0b7-de06-449b-956e-984a4cf714d2 req-949e58d7-1a1e-48de-aeb6-4abeb2efcaf0 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Received unexpected event network-vif-plugged-576fd898-62e6-4bf7-a914-6b94081176b1 for instance with vm_state active and task_state deleting.
Nov 29 05:50:04 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:50:04 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Took 1.54 seconds to deallocate network for instance.
Nov 29 05:50:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-63f5e8e5-66f8-46d9-9a00-3928a1f36c05 req-5558913b-d545-48fe-9a3b-43d876132573 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Received event network-vif-deleted-576fd898-62e6-4bf7-a914-6b94081176b1 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:50:04 user nova-compute[75083]: INFO nova.compute.manager [req-63f5e8e5-66f8-46d9-9a00-3928a1f36c05 req-5558913b-d545-48fe-9a3b-43d876132573 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Neutron deleted interface 576fd898-62e6-4bf7-a914-6b94081176b1; detaching it from the instance and deleting it from the info cache
Nov 29 05:50:04 user nova-compute[75083]: DEBUG nova.network.neutron [req-63f5e8e5-66f8-46d9-9a00-3928a1f36c05 req-5558913b-d545-48fe-9a3b-43d876132573 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:50:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-63f5e8e5-66f8-46d9-9a00-3928a1f36c05 req-5558913b-d545-48fe-9a3b-43d876132573 service nova] [instance: ae18699b-d0cf-44b5-8467-a112fd154580] Detach interface failed, port_id=576fd898-62e6-4bf7-a914-6b94081176b1, reason: Instance ae18699b-d0cf-44b5-8467-a112fd154580 could not be found. {{(pid=75083) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 05:50:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:04 user nova-compute[75083]: DEBUG nova.network.neutron [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Successfully created port: cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:50:04 user nova-compute[75083]: DEBUG nova.network.neutron [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Updating instance_info_cache with network_info: [{"id": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "address": "fa:16:3e:76:b7:47", "network": {"id": "0e6492fc-5e8d-4df7-8fac-2da472312c4d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d625d0d60faf4a4f9073df250039f58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ddf4bb-5d", "ovs_interfaceid": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:50:04 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:50:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Releasing lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:50:04 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:50:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:04 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Deleted allocations for instance ae18699b-d0cf-44b5-8467-a112fd154580
Nov 29 05:50:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-23786d78-b0d2-484e-8549-1da0b867f007 tempest-TestVolumeSwap-1735569809 tempest-TestVolumeSwap-1735569809-project-member] Lock "ae18699b-d0cf-44b5-8467-a112fd154580" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.268s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:05 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Instance destroyed successfully.
Nov 29 05:50:05 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Attempting a stable device rescue
Nov 29 05:50:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75083) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 05:50:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Instance directory exists: not creating {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 05:50:05 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Creating image(s)
Nov 29 05:50:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "/opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "/opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:05 user nova-compute[75083]: DEBUG nova.objects.instance [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lazy-loading 'trusted_certs' on Instance uuid ee1bba24-17d0-4fc3-8bff-1337d86cc9be {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "aca7a4315e9d17d826db8830aa4cd56182f3bdbc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "aca7a4315e9d17d826db8830aa4cd56182f3bdbc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aca7a4315e9d17d826db8830aa4cd56182f3bdbc.part --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG nova.network.neutron [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Successfully updated port: cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG nova.compute.manager [req-cb1f1903-efe0-44dc-81a1-ad7e81904d75 req-9c3c73ef-d9b4-4cc2-89f5-b5646ce37b43 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Received event network-changed-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG nova.compute.manager [req-cb1f1903-efe0-44dc-81a1-ad7e81904d75 req-9c3c73ef-d9b4-4cc2-89f5-b5646ce37b43 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Refreshing instance network info cache due to event network-changed-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-cb1f1903-efe0-44dc-81a1-ad7e81904d75 req-9c3c73ef-d9b4-4cc2-89f5-b5646ce37b43 service nova] Acquiring lock "refresh_cache-b6d38a2c-a512-41f2-a7df-6a54058f8f8b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-cb1f1903-efe0-44dc-81a1-ad7e81904d75 req-9c3c73ef-d9b4-4cc2-89f5-b5646ce37b43 service nova] Acquired lock "refresh_cache-b6d38a2c-a512-41f2-a7df-6a54058f8f8b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG nova.network.neutron [req-cb1f1903-efe0-44dc-81a1-ad7e81904d75 req-9c3c73ef-d9b4-4cc2-89f5-b5646ce37b43 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Refreshing network info cache for port cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG nova.compute.manager [req-e9ea7ed8-96af-40b5-9f12-8fbdb5474bdc req-90e608d9-3f6f-4a90-a359-915fd8cf6175 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received event network-vif-unplugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e9ea7ed8-96af-40b5-9f12-8fbdb5474bdc req-90e608d9-3f6f-4a90-a359-915fd8cf6175 service nova] Acquiring lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e9ea7ed8-96af-40b5-9f12-8fbdb5474bdc req-90e608d9-3f6f-4a90-a359-915fd8cf6175 service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e9ea7ed8-96af-40b5-9f12-8fbdb5474bdc req-90e608d9-3f6f-4a90-a359-915fd8cf6175 service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG nova.compute.manager [req-e9ea7ed8-96af-40b5-9f12-8fbdb5474bdc req-90e608d9-3f6f-4a90-a359-915fd8cf6175 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] No waiting events found dispatching network-vif-unplugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:50:07 user nova-compute[75083]: WARNING nova.compute.manager [req-e9ea7ed8-96af-40b5-9f12-8fbdb5474bdc req-90e608d9-3f6f-4a90-a359-915fd8cf6175 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received unexpected event network-vif-unplugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 for instance with vm_state active and task_state rescuing.
Nov 29 05:50:07 user nova-compute[75083]: DEBUG nova.compute.manager [req-e9ea7ed8-96af-40b5-9f12-8fbdb5474bdc req-90e608d9-3f6f-4a90-a359-915fd8cf6175 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received event network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e9ea7ed8-96af-40b5-9f12-8fbdb5474bdc req-90e608d9-3f6f-4a90-a359-915fd8cf6175 service nova] Acquiring lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e9ea7ed8-96af-40b5-9f12-8fbdb5474bdc req-90e608d9-3f6f-4a90-a359-915fd8cf6175 service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e9ea7ed8-96af-40b5-9f12-8fbdb5474bdc req-90e608d9-3f6f-4a90-a359-915fd8cf6175 service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG nova.compute.manager [req-e9ea7ed8-96af-40b5-9f12-8fbdb5474bdc req-90e608d9-3f6f-4a90-a359-915fd8cf6175 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] No waiting events found dispatching network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:50:07 user nova-compute[75083]: WARNING nova.compute.manager [req-e9ea7ed8-96af-40b5-9f12-8fbdb5474bdc req-90e608d9-3f6f-4a90-a359-915fd8cf6175 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received unexpected event network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 for instance with vm_state active and task_state rescuing.
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "refresh_cache-b6d38a2c-a512-41f2-a7df-6a54058f8f8b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aca7a4315e9d17d826db8830aa4cd56182f3bdbc.part --force-share --output=json" returned: 0 in 0.227s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG nova.virt.images [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] a2c9702b-e652-4766-a736-4b0720aba95d was qcow2, converting to raw {{(pid=75083) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG nova.privsep.utils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75083) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aca7a4315e9d17d826db8830aa4cd56182f3bdbc.part /opt/stack/data/nova/instances/_base/aca7a4315e9d17d826db8830aa4cd56182f3bdbc.converted {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG nova.network.neutron [req-cb1f1903-efe0-44dc-81a1-ad7e81904d75 req-9c3c73ef-d9b4-4cc2-89f5-b5646ce37b43 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aca7a4315e9d17d826db8830aa4cd56182f3bdbc.part /opt/stack/data/nova/instances/_base/aca7a4315e9d17d826db8830aa4cd56182f3bdbc.converted" returned: 0 in 0.325s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aca7a4315e9d17d826db8830aa4cd56182f3bdbc.converted --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG nova.network.neutron [req-cb1f1903-efe0-44dc-81a1-ad7e81904d75 req-9c3c73ef-d9b4-4cc2-89f5-b5646ce37b43 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-cb1f1903-efe0-44dc-81a1-ad7e81904d75 req-9c3c73ef-d9b4-4cc2-89f5-b5646ce37b43 service nova] Releasing lock "refresh_cache-b6d38a2c-a512-41f2-a7df-6a54058f8f8b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquired lock "refresh_cache-b6d38a2c-a512-41f2-a7df-6a54058f8f8b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG nova.network.neutron [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aca7a4315e9d17d826db8830aa4cd56182f3bdbc.converted --force-share --output=json" returned: 0 in 0.218s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "aca7a4315e9d17d826db8830aa4cd56182f3bdbc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.038s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "aca7a4315e9d17d826db8830aa4cd56182f3bdbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "aca7a4315e9d17d826db8830aa4cd56182f3bdbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aca7a4315e9d17d826db8830aa4cd56182f3bdbc --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG nova.network.neutron [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aca7a4315e9d17d826db8830aa4cd56182f3bdbc --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aca7a4315e9d17d826db8830aa4cd56182f3bdbc,backing_fmt=raw /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk.rescue {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aca7a4315e9d17d826db8830aa4cd56182f3bdbc,backing_fmt=raw /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk.rescue" returned: 0 in 0.047s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "aca7a4315e9d17d826db8830aa4cd56182f3bdbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.objects.instance [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lazy-loading 'migration_context' on Instance uuid ee1bba24-17d0-4fc3-8bff-1337d86cc9be {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.objects.base [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Object Instance<ee1bba24-17d0-4fc3-8bff-1337d86cc9be> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Start _get_guest_xml network_info=[{"id": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "address": "fa:16:3e:76:b7:47", "network": {"id": "0e6492fc-5e8d-4df7-8fac-2da472312c4d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "vif_mac": "fa:16:3e:76:b7:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d625d0d60faf4a4f9073df250039f58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ddf4bb-5d", "ovs_interfaceid": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a2c9702b-e652-4766-a736-4b0720aba95d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'f6f524b8-2864-48c5-8661-8d0d4b99ad42', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MsfWBgNZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ee1bba24-17d0-4fc3-8bff-1337d86cc9be', 'attached_at': '', 'detached_at': '', 'volume_id': '7cabbe02-0d11-483c-b05e-9d94c28862a5', 'serial': '7cabbe02-0d11-483c-b05e-9d94c28862a5'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.objects.instance [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lazy-loading 'resources' on Instance uuid ee1bba24-17d0-4fc3-8bff-1337d86cc9be {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.objects.base [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Object Instance<ee1bba24-17d0-4fc3-8bff-1337d86cc9be> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.objects.instance [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lazy-loading 'numa_topology' on Instance uuid ee1bba24-17d0-4fc3-8bff-1337d86cc9be {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.objects.base [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Object Instance<ee1bba24-17d0-4fc3-8bff-1337d86cc9be> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.network.neutron [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Updating instance_info_cache with network_info: [{"id": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "address": "fa:16:3e:f6:1e:5c", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf04f87a-6d", "ovs_interfaceid": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:50:08 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:50:08 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Releasing lock "refresh_cache-b6d38a2c-a512-41f2-a7df-6a54058f8f8b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.compute.manager [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Instance network_info: |[{"id": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "address": "fa:16:3e:f6:1e:5c", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf04f87a-6d", "ovs_interfaceid": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Start _get_guest_xml network_info=[{"id": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "address": "fa:16:3e:f6:1e:5c", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf04f87a-6d", "ovs_interfaceid": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.objects.instance [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lazy-loading 'vcpu_model' on Instance uuid ee1bba24-17d0-4fc3-8bff-1337d86cc9be {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:08 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:50:08 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:50:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-767389487',display_name='tempest-tempest.common.compute-instance-767389487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-767389487',id=12,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfvHF6/oSNRPLODGah+lUX+h6/YktVuSfbjhiVUADedZo8ZZa8yTY3sj5iWRDCdXv2wxDvaROa6nC6uX8hHjhEFAijNYi3sdzIr+uRnWW/58teiEfkLjGJRSM5qLnzVvA==',key_name='tempest-keypair-720253988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95d0f3dd09bf436498e67d7bfdd904bf',ramdisk_id='',reservation_id='r-z46r3ddw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2114836332',owner_user_name='tempest-ServerActionsTestOtherA-2114836332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:50:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbd7f863ad7c4229957c4b08601b5003',uuid=b6d38a2c-a512-41f2-a7df-6a54058f8f8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "address": "fa:16:3e:f6:1e:5c", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf04f87a-6d", "ovs_interfaceid": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converting VIF {"id": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "address": "fa:16:3e:f6:1e:5c", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf04f87a-6d", "ovs_interfaceid": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf04f87a-6d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.objects.instance [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lazy-loading 'pci_devices' on Instance uuid b6d38a2c-a512-41f2-a7df-6a54058f8f8b {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.objects.base [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Object Instance<ee1bba24-17d0-4fc3-8bff-1337d86cc9be> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MsfWBgNZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:50:08 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:50:08 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:50:08 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:50:08 user nova-compute[75083]:   <uuid>b6d38a2c-a512-41f2-a7df-6a54058f8f8b</uuid>
Nov 29 05:50:08 user nova-compute[75083]:   <name>instance-0000000c</name>
Nov 29 05:50:08 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:50:08 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:50:08 user nova-compute[75083]:   <metadata>
Nov 29 05:50:08 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:50:08 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:50:08 user nova-compute[75083]:       <nova:name>tempest-tempest.common.compute-instance-767389487</nova:name>
Nov 29 05:50:08 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:50:08</nova:creationTime>
Nov 29 05:50:08 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:50:08 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:50:08 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:50:08 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:50:08 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:50:08 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:50:08 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:50:08 user nova-compute[75083]:       <nova:owner>
Nov 29 05:50:08 user nova-compute[75083]:         <nova:user uuid="cbd7f863ad7c4229957c4b08601b5003">tempest-ServerActionsTestOtherA-2114836332-project-member</nova:user>
Nov 29 05:50:08 user nova-compute[75083]:         <nova:project uuid="95d0f3dd09bf436498e67d7bfdd904bf">tempest-ServerActionsTestOtherA-2114836332</nova:project>
Nov 29 05:50:08 user nova-compute[75083]:       </nova:owner>
Nov 29 05:50:08 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:50:08 user nova-compute[75083]:       <nova:ports>
Nov 29 05:50:08 user nova-compute[75083]:         <nova:port uuid="cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3">
Nov 29 05:50:08 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 05:50:08 user nova-compute[75083]:         </nova:port>
Nov 29 05:50:08 user nova-compute[75083]:       </nova:ports>
Nov 29 05:50:08 user nova-compute[75083]:     </nova:instance>
Nov 29 05:50:08 user nova-compute[75083]:   </metadata>
Nov 29 05:50:08 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:50:08 user nova-compute[75083]:     <system>
Nov 29 05:50:08 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:50:08 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:50:08 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:50:08 user nova-compute[75083]:       <entry name="serial">b6d38a2c-a512-41f2-a7df-6a54058f8f8b</entry>
Nov 29 05:50:08 user nova-compute[75083]:       <entry name="uuid">b6d38a2c-a512-41f2-a7df-6a54058f8f8b</entry>
Nov 29 05:50:08 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:50:08 user nova-compute[75083]:     </system>
Nov 29 05:50:08 user nova-compute[75083]:   </sysinfo>
Nov 29 05:50:08 user nova-compute[75083]:   <os>
Nov 29 05:50:08 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:50:08 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:50:08 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:50:08 user nova-compute[75083]:   </os>
Nov 29 05:50:08 user nova-compute[75083]:   <features>
Nov 29 05:50:08 user nova-compute[75083]:     <acpi/>
Nov 29 05:50:08 user nova-compute[75083]:     <apic/>
Nov 29 05:50:08 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:50:08 user nova-compute[75083]:   </features>
Nov 29 05:50:08 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:50:08 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:50:08 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:50:08 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:50:08 user nova-compute[75083]:   </clock>
Nov 29 05:50:08 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:50:08 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:50:08 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:50:08 user nova-compute[75083]:   </cpu>
Nov 29 05:50:08 user nova-compute[75083]:   <devices>
Nov 29 05:50:08 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:50:08 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:50:08 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk"/>
Nov 29 05:50:08 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:50:08 user nova-compute[75083]:     </disk>
Nov 29 05:50:08 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:50:08 user nova-compute[75083]:       <mac address="fa:16:3e:f6:1e:5c"/>
Nov 29 05:50:08 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:50:08 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:50:08 user nova-compute[75083]:       <target dev="tapcf04f87a-6d"/>
Nov 29 05:50:08 user nova-compute[75083]:     </interface>
Nov 29 05:50:08 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:50:08 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/console.log" append="off"/>
Nov 29 05:50:08 user nova-compute[75083]:     </serial>
Nov 29 05:50:08 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:50:08 user nova-compute[75083]:     <video>
Nov 29 05:50:08 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:50:08 user nova-compute[75083]:     </video>
Nov 29 05:50:08 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:50:08 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:50:08 user nova-compute[75083]:     </rng>
Nov 29 05:50:08 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:50:08 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:50:08 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:50:08 user nova-compute[75083]:     </memballoon>
Nov 29 05:50:08 user nova-compute[75083]:   </devices>
Nov 29 05:50:08 user nova-compute[75083]: </domain>
Nov 29 05:50:08 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:50:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-767389487',display_name='tempest-tempest.common.compute-instance-767389487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-767389487',id=12,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfvHF6/oSNRPLODGah+lUX+h6/YktVuSfbjhiVUADedZo8ZZa8yTY3sj5iWRDCdXv2wxDvaROa6nC6uX8hHjhEFAijNYi3sdzIr+uRnWW/58teiEfkLjGJRSM5qLnzVvA==',key_name='tempest-keypair-720253988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95d0f3dd09bf436498e67d7bfdd904bf',ramdisk_id='',reservation_id='r-z46r3ddw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2114836332',owner_user_name='tempest-ServerActionsTestOtherA-2114836332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:50:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbd7f863ad7c4229957c4b08601b5003',uuid=b6d38a2c-a512-41f2-a7df-6a54058f8f8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "address": "fa:16:3e:f6:1e:5c", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf04f87a-6d", "ovs_interfaceid": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converting VIF {"id": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "address": "fa:16:3e:f6:1e:5c", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf04f87a-6d", "ovs_interfaceid": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf04f87a-6d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_vif [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf04f87a-6d') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'faee9eb5-f060-56db-bfdd-8af10be93d01', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abb03ac-feff-461c-bb5d-6fad3e3f61e6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = MsfWBgNZ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 05:50:08 user nova-compute[75083]: node.name = iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5
Nov 29 05:50:08 user nova-compute[75083]: node.tpgt = -1
Nov 29 05:50:08 user nova-compute[75083]: node.startup = automatic
Nov 29 05:50:08 user nova-compute[75083]: node.leading_login = No
Nov 29 05:50:08 user nova-compute[75083]: iface.iscsi_ifacename = default
Nov 29 05:50:08 user nova-compute[75083]: iface.net_ifacename = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.ipaddress = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.prefix_len = 0
Nov 29 05:50:08 user nova-compute[75083]: iface.hwaddress = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.transport_name = tcp
Nov 29 05:50:08 user nova-compute[75083]: iface.initiatorname = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.state = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.vlan_id = 0
Nov 29 05:50:08 user nova-compute[75083]: iface.vlan_priority = 0
Nov 29 05:50:08 user nova-compute[75083]: iface.vlan_state = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.iface_num = 0
Nov 29 05:50:08 user nova-compute[75083]: iface.mtu = 0
Nov 29 05:50:08 user nova-compute[75083]: iface.port = 0
Nov 29 05:50:08 user nova-compute[75083]: iface.bootproto = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.subnet_mask = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.gateway = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.dhcp_alt_client_id = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.dhcp_dns = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.dhcp_learn_iqn = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.dhcp_vendor_id_state = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.dhcp_vendor_id = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.dhcp_slp_da = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.fragmentation = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.gratuitous_arp = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.incoming_forwarding = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.tos_state = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.tos = 0
Nov 29 05:50:08 user nova-compute[75083]: iface.ttl = 0
Nov 29 05:50:08 user nova-compute[75083]: iface.delayed_ack = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.tcp_nagle = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.tcp_wsf_state = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.tcp_wsf = 0
Nov 29 05:50:08 user nova-compute[75083]: iface.tcp_timer_scale = 0
Nov 29 05:50:08 user nova-compute[75083]: iface.tcp_timestamp = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.redirect = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.def_task_mgmt_timeout = 0
Nov 29 05:50:08 user nova-compute[75083]: iface.header_digest = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.data_digest = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.immediate_data = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.initial_r2t = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.data_seq_inorder = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.data_pdu_inorder = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.erl = 0
Nov 29 05:50:08 user nova-compute[75083]: iface.max_receive_data_len = 0
Nov 29 05:50:08 user nova-compute[75083]: iface.first_burst_len = 0
Nov 29 05:50:08 user nova-compute[75083]: iface.max_outstanding_r2t = 0
Nov 29 05:50:08 user nova-compute[75083]: iface.max_burst_len = 0
Nov 29 05:50:08 user nova-compute[75083]: iface.chap_auth = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.bidi_chap = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.strict_login_compliance = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.discovery_auth = <empty>
Nov 29 05:50:08 user nova-compute[75083]: iface.discovery_logout = <empty>
Nov 29 05:50:08 user nova-compute[75083]: node.discovery_address = <empty>
Nov 29 05:50:08 user nova-compute[75083]: node.discovery_port = 0
Nov 29 05:50:08 user nova-compute[75083]: node.discovery_type = static
Nov 29 05:50:08 user nova-compute[75083]: node.session.initial_cmdsn = 0
Nov 29 05:50:08 user nova-compute[75083]: node.session.initial_login_retry_max = 8
Nov 29 05:50:08 user nova-compute[75083]: node.session.xmit_thread_priority = -20
Nov 29 05:50:08 user nova-compute[75083]: node.session.cmds_max = 128
Nov 29 05:50:08 user nova-compute[75083]: node.session.queue_depth = 32
Nov 29 05:50:08 user nova-compute[75083]: node.session.nr_sessions = 1
Nov 29 05:50:08 user nova-compute[75083]: node.session.auth.authmethod = CHAP
Nov 29 05:50:08 user nova-compute[75083]: node.session.auth.username = MsfWBgNZ
Nov 29 05:50:08 user nova-compute[75083]: node.session.auth.password = ***
Nov 29 05:50:08 user nova-compute[75083]: node.session.auth.username_in = <empty>
Nov 29 05:50:08 user nova-compute[75083]: node.session.auth.password_in = <empty>
Nov 29 05:50:08 user nova-compute[75083]: node.session.auth.chap_algs = MD5
Nov 29 05:50:08 user nova-compute[75083]: node.session.timeo.replacement_timeout = 120
Nov 29 05:50:08 user nova-compute[75083]: node.session.err_timeo.abort_timeout = 15
Nov 29 05:50:08 user nova-compute[75083]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 05:50:08 user nova-compute[75083]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 05:50:08 user nova-compute[75083]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 05:50:08 user nova-compute[75083]: node.session.iscsi.FastAbort = Yes
Nov 29 05:50:08 user nova-compute[75083]: node.session.iscsi.InitialR2T = No
Nov 29 05:50:08 user nova-compute[75083]: node.session.iscsi.ImmediateData = Yes
Nov 29 05:50:08 user nova-compute[75083]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 05:50:08 user nova-compute[75083]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 05:50:08 user nova-compute[75083]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 05:50:08 user nova-compute[75083]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 05:50:08 user nova-compute[75083]: node.session.iscsi.MaxConnections = 1
Nov 29 05:50:08 user nova-compute[75083]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 05:50:08 user nova-compute[75083]: node.session.iscsi.ERL = 0
Nov 29 05:50:08 user nova-compute[75083]: node.session.scan = manual
Nov 29 05:50:08 user nova-compute[75083]: node.session.reopen_max = 0
Nov 29 05:50:08 user nova-compute[75083]: node.conn[0].address = 172.16.0.220
Nov 29 05:50:08 user nova-compute[75083]: node.conn[0].port = 3260
Nov 29 05:50:08 user nova-compute[75083]: node.conn[0].startup = manual
Nov 29 05:50:08 user nova-compute[75083]: node.conn[0].tcp.window_size = 524288
Nov 29 05:50:08 user nova-compute[75083]: node.conn[0].tcp.type_of_service = 0
Nov 29 05:50:08 user nova-compute[75083]: node.conn[0].timeo.logout_timeout = 15
Nov 29 05:50:08 user nova-compute[75083]: node.conn[0].timeo.login_timeout = 15
Nov 29 05:50:08 user nova-compute[75083]: node.conn[0].timeo.auth_timeout = 45
Nov 29 05:50:08 user nova-compute[75083]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 05:50:08 user nova-compute[75083]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 05:50:08 user nova-compute[75083]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 05:50:08 user nova-compute[75083]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 05:50:08 user nova-compute[75083]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 05:50:08 user nova-compute[75083]: node.conn[0].iscsi.DataDigest = None
Nov 29 05:50:08 user nova-compute[75083]: node.conn[0].iscsi.IFMarker = No
Nov 29 05:50:08 user nova-compute[75083]: node.conn[0].iscsi.OFMarker = No
Nov 29 05:50:08 user nova-compute[75083]: # END RECORD
Nov 29 05:50:08 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf04f87a-6d, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf04f87a-6d, col_values=(('qos', UUID('020de7c2-3440-4313-b552-95c530deddaf')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf04f87a-6d, col_values=(('external_ids', {'iface-id': 'cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:1e:5c', 'vm-uuid': 'b6d38a2c-a512-41f2-a7df-6a54058f8f8b'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[04647bfb-7673-4577-99ef-c7d04a555b03]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f725354-030c-4991-ae3f-41fb18e32be7]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MsfWBgNZ {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:08 user nova-compute[75083]: INFO os_vif [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf04f87a-6d')
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MsfWBgNZ" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b996c26b-0124-4773-87c3-439ce840ff02]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MsfWBgNZ'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[512708b3-8daf-4223-971f-f2af448c0d9e]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[175005e1-32e8-48bc-b11c-97184139d0dd]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:50:08 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:50:08 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:50:08 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:50:08 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.178s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] HCTL ('33', '0', '0', 0) found on session 16 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] No VIF found with MAC fa:16:3e:f6:1e:5c, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a86f1f5-29b6-40b7-9e22-ef804da620dc]: (4, ('0 0 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Searching for a device in session 16 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MsfWBgNZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.211s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] <== connect_volume: return (213ms) {'type': 'block', 'scsi_wwn': '26636626635633735', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636626635633735', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-826292306',display_name='tempest-ServerStableDeviceRescueTest-server-826292306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-826292306',id=3,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4Ued3iPzzbMe5P8yCCDECsXfcv5JHNAjhap4DZX0mLVVlTdbfXR6zFoeLnVJJxMXZB04R5Xe0j2RaI5pk8Yj72peIfQZXhFvMw9aBrNBt/3KF1NAc6raVZ7kAtojg42A==',key_name='tempest-keypair-1498054763',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d625d0d60faf4a4f9073df250039f58b',ramdisk_id='',reservation_id='r-20ynrj0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1148285851',owner_user_name='tempest-ServerStableDeviceRescueTest-1148285851-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:48:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28d78f6409074549a9353312300b041b',uuid=ee1bba24-17d0-4fc3-8bff-1337d86cc9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "address": "fa:16:3e:76:b7:47", "network": {"id": "0e6492fc-5e8d-4df7-8fac-2da472312c4d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "vif_mac": "fa:16:3e:76:b7:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d625d0d60faf4a4f9073df250039f58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ddf4bb-5d", "ovs_interfaceid": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Converting VIF {"id": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "address": "fa:16:3e:76:b7:47", "network": {"id": "0e6492fc-5e8d-4df7-8fac-2da472312c4d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "vif_mac": "fa:16:3e:76:b7:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d625d0d60faf4a4f9073df250039f58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ddf4bb-5d", "ovs_interfaceid": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:b7:47,bridge_name='br-int',has_traffic_filtering=True,id=b4ddf4bb-5def-4760-8d1b-f020942dedf8,network=Network(0e6492fc-5e8d-4df7-8fac-2da472312c4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ddf4bb-5d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.objects.instance [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lazy-loading 'pci_devices' on Instance uuid ee1bba24-17d0-4fc3-8bff-1337d86cc9be {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.objects.base [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Object Instance<ee1bba24-17d0-4fc3-8bff-1337d86cc9be> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:50:08 user nova-compute[75083]:   <uuid>ee1bba24-17d0-4fc3-8bff-1337d86cc9be</uuid>
Nov 29 05:50:08 user nova-compute[75083]:   <name>instance-00000003</name>
Nov 29 05:50:08 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:50:08 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:50:08 user nova-compute[75083]:   <metadata>
Nov 29 05:50:08 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:50:08 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:50:08 user nova-compute[75083]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-826292306</nova:name>
Nov 29 05:50:08 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:50:08</nova:creationTime>
Nov 29 05:50:08 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:50:08 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:50:08 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:50:08 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:50:08 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:50:08 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:50:08 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:50:08 user nova-compute[75083]:       <nova:owner>
Nov 29 05:50:08 user nova-compute[75083]:         <nova:user uuid="28d78f6409074549a9353312300b041b">tempest-ServerStableDeviceRescueTest-1148285851-project-member</nova:user>
Nov 29 05:50:08 user nova-compute[75083]:         <nova:project uuid="d625d0d60faf4a4f9073df250039f58b">tempest-ServerStableDeviceRescueTest-1148285851</nova:project>
Nov 29 05:50:08 user nova-compute[75083]:       </nova:owner>
Nov 29 05:50:08 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:50:08 user nova-compute[75083]:       <nova:ports>
Nov 29 05:50:08 user nova-compute[75083]:         <nova:port uuid="b4ddf4bb-5def-4760-8d1b-f020942dedf8">
Nov 29 05:50:08 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 05:50:08 user nova-compute[75083]:         </nova:port>
Nov 29 05:50:08 user nova-compute[75083]:       </nova:ports>
Nov 29 05:50:08 user nova-compute[75083]:     </nova:instance>
Nov 29 05:50:08 user nova-compute[75083]:   </metadata>
Nov 29 05:50:08 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:50:08 user nova-compute[75083]:     <system>
Nov 29 05:50:08 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:50:08 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:50:08 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:50:08 user nova-compute[75083]:       <entry name="serial">ee1bba24-17d0-4fc3-8bff-1337d86cc9be</entry>
Nov 29 05:50:08 user nova-compute[75083]:       <entry name="uuid">ee1bba24-17d0-4fc3-8bff-1337d86cc9be</entry>
Nov 29 05:50:08 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:50:08 user nova-compute[75083]:     </system>
Nov 29 05:50:08 user nova-compute[75083]:   </sysinfo>
Nov 29 05:50:08 user nova-compute[75083]:   <os>
Nov 29 05:50:08 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:50:08 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:50:08 user nova-compute[75083]:   </os>
Nov 29 05:50:08 user nova-compute[75083]:   <features>
Nov 29 05:50:08 user nova-compute[75083]:     <acpi/>
Nov 29 05:50:08 user nova-compute[75083]:     <apic/>
Nov 29 05:50:08 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:50:08 user nova-compute[75083]:   </features>
Nov 29 05:50:08 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:50:08 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:50:08 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:50:08 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:50:08 user nova-compute[75083]:   </clock>
Nov 29 05:50:08 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:50:08 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:50:08 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:50:08 user nova-compute[75083]:   </cpu>
Nov 29 05:50:08 user nova-compute[75083]:   <devices>
Nov 29 05:50:08 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:50:08 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:50:08 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk"/>
Nov 29 05:50:08 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:50:08 user nova-compute[75083]:     </disk>
Nov 29 05:50:08 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 05:50:08 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:50:08 user nova-compute[75083]:       <source dev="/dev/sdb"/>
Nov 29 05:50:08 user nova-compute[75083]:       <target dev="vdb" bus="virtio"/>
Nov 29 05:50:08 user nova-compute[75083]:       <serial>7cabbe02-0d11-483c-b05e-9d94c28862a5</serial>
Nov 29 05:50:08 user nova-compute[75083]:     </disk>
Nov 29 05:50:08 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:50:08 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:50:08 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk.rescue"/>
Nov 29 05:50:08 user nova-compute[75083]:       <target dev="vdc" bus="virtio"/>
Nov 29 05:50:08 user nova-compute[75083]:       <boot order="1"/>
Nov 29 05:50:08 user nova-compute[75083]:     </disk>
Nov 29 05:50:08 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:50:08 user nova-compute[75083]:       <mac address="fa:16:3e:76:b7:47"/>
Nov 29 05:50:08 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:50:08 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:50:08 user nova-compute[75083]:       <target dev="tapb4ddf4bb-5d"/>
Nov 29 05:50:08 user nova-compute[75083]:     </interface>
Nov 29 05:50:08 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:50:08 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/console.log" append="off"/>
Nov 29 05:50:08 user nova-compute[75083]:     </serial>
Nov 29 05:50:08 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:50:08 user nova-compute[75083]:     <video>
Nov 29 05:50:08 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:50:08 user nova-compute[75083]:     </video>
Nov 29 05:50:08 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:50:08 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:50:08 user nova-compute[75083]:     </rng>
Nov 29 05:50:08 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:50:08 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:50:08 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:50:08 user nova-compute[75083]:     </memballoon>
Nov 29 05:50:08 user nova-compute[75083]:   </devices>
Nov 29 05:50:08 user nova-compute[75083]: </domain>
Nov 29 05:50:08 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:50:08 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Instance destroyed successfully.
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:50:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] No VIF found with MAC fa:16:3e:76:b7:47, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:50:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:11 user nova-compute[75083]: DEBUG nova.compute.manager [req-4d0731c7-7310-47b3-a2b5-3f6d2f93a291 req-704b0239-5d8a-44ce-a62e-df81065656db service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Received event network-vif-plugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:50:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4d0731c7-7310-47b3-a2b5-3f6d2f93a291 req-704b0239-5d8a-44ce-a62e-df81065656db service nova] Acquiring lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4d0731c7-7310-47b3-a2b5-3f6d2f93a291 req-704b0239-5d8a-44ce-a62e-df81065656db service nova] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4d0731c7-7310-47b3-a2b5-3f6d2f93a291 req-704b0239-5d8a-44ce-a62e-df81065656db service nova] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:11 user nova-compute[75083]: DEBUG nova.compute.manager [req-4d0731c7-7310-47b3-a2b5-3f6d2f93a291 req-704b0239-5d8a-44ce-a62e-df81065656db service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] No waiting events found dispatching network-vif-plugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:50:11 user nova-compute[75083]: WARNING nova.compute.manager [req-4d0731c7-7310-47b3-a2b5-3f6d2f93a291 req-704b0239-5d8a-44ce-a62e-df81065656db service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Received unexpected event network-vif-plugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 for instance with vm_state building and task_state spawning.
Nov 29 05:50:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:11 user nova-compute[75083]: DEBUG nova.objects.instance [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'pci_requests' on Instance uuid 47437526-c4e4-4a15-ba9b-51bbae17c77b {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:11 user nova-compute[75083]: DEBUG nova.objects.instance [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'numa_topology' on Instance uuid 47437526-c4e4-4a15-ba9b-51bbae17c77b {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:50:11 user nova-compute[75083]: INFO nova.compute.claims [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Claim successful on node user
Nov 29 05:50:12 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:50:12 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:50:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:12 user nova-compute[75083]: INFO nova.network.neutron [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Updating port 8c103582-6856-45ff-ac2b-7a30d3138c75 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquired lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG nova.network.neutron [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG nova.compute.manager [req-24e85ad5-77e0-4368-aac3-5ba0615640f9 req-50608dbb-e3f5-42c5-b8cf-717d40bb1bc8 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received event network-changed-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG nova.compute.manager [req-24e85ad5-77e0-4368-aac3-5ba0615640f9 req-50608dbb-e3f5-42c5-b8cf-717d40bb1bc8 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Refreshing instance network info cache due to event network-changed-8c103582-6856-45ff-ac2b-7a30d3138c75. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-24e85ad5-77e0-4368-aac3-5ba0615640f9 req-50608dbb-e3f5-42c5-b8cf-717d40bb1bc8 service nova] Acquiring lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG nova.objects.instance [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'flavor' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquired lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG nova.network.neutron [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG nova.objects.instance [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'info_cache' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG nova.objects.base [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Object Instance<e6d49806-cecd-473a-b92f-9255868d35c7> lazy-loaded attributes: flavor,info_cache {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG nova.compute.manager [req-1a4e9216-6bb2-4283-813d-5e0d6a48b4bc req-3231d4bf-c37e-4166-aa4f-ca5852894fe7 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Received event network-vif-plugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-1a4e9216-6bb2-4283-813d-5e0d6a48b4bc req-3231d4bf-c37e-4166-aa4f-ca5852894fe7 service nova] Acquiring lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-1a4e9216-6bb2-4283-813d-5e0d6a48b4bc req-3231d4bf-c37e-4166-aa4f-ca5852894fe7 service nova] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-1a4e9216-6bb2-4283-813d-5e0d6a48b4bc req-3231d4bf-c37e-4166-aa4f-ca5852894fe7 service nova] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG nova.compute.manager [req-1a4e9216-6bb2-4283-813d-5e0d6a48b4bc req-3231d4bf-c37e-4166-aa4f-ca5852894fe7 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] No waiting events found dispatching network-vif-plugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:50:13 user nova-compute[75083]: WARNING nova.compute.manager [req-1a4e9216-6bb2-4283-813d-5e0d6a48b4bc req-3231d4bf-c37e-4166-aa4f-ca5852894fe7 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Received unexpected event network-vif-plugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 for instance with vm_state building and task_state spawning.
Nov 29 05:50:13 user nova-compute[75083]: DEBUG nova.compute.manager [req-1a4e9216-6bb2-4283-813d-5e0d6a48b4bc req-3231d4bf-c37e-4166-aa4f-ca5852894fe7 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received event network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-1a4e9216-6bb2-4283-813d-5e0d6a48b4bc req-3231d4bf-c37e-4166-aa4f-ca5852894fe7 service nova] Acquiring lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-1a4e9216-6bb2-4283-813d-5e0d6a48b4bc req-3231d4bf-c37e-4166-aa4f-ca5852894fe7 service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-1a4e9216-6bb2-4283-813d-5e0d6a48b4bc req-3231d4bf-c37e-4166-aa4f-ca5852894fe7 service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG nova.compute.manager [req-1a4e9216-6bb2-4283-813d-5e0d6a48b4bc req-3231d4bf-c37e-4166-aa4f-ca5852894fe7 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] No waiting events found dispatching network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:50:13 user nova-compute[75083]: WARNING nova.compute.manager [req-1a4e9216-6bb2-4283-813d-5e0d6a48b4bc req-3231d4bf-c37e-4166-aa4f-ca5852894fe7 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received unexpected event network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 for instance with vm_state active and task_state rescuing.
Nov 29 05:50:13 user nova-compute[75083]: DEBUG nova.compute.manager [req-1a4e9216-6bb2-4283-813d-5e0d6a48b4bc req-3231d4bf-c37e-4166-aa4f-ca5852894fe7 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received event network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-1a4e9216-6bb2-4283-813d-5e0d6a48b4bc req-3231d4bf-c37e-4166-aa4f-ca5852894fe7 service nova] Acquiring lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-1a4e9216-6bb2-4283-813d-5e0d6a48b4bc req-3231d4bf-c37e-4166-aa4f-ca5852894fe7 service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-1a4e9216-6bb2-4283-813d-5e0d6a48b4bc req-3231d4bf-c37e-4166-aa4f-ca5852894fe7 service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:13 user nova-compute[75083]: DEBUG nova.compute.manager [req-1a4e9216-6bb2-4283-813d-5e0d6a48b4bc req-3231d4bf-c37e-4166-aa4f-ca5852894fe7 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] No waiting events found dispatching network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:50:13 user nova-compute[75083]: WARNING nova.compute.manager [req-1a4e9216-6bb2-4283-813d-5e0d6a48b4bc req-3231d4bf-c37e-4166-aa4f-ca5852894fe7 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received unexpected event network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 for instance with vm_state active and task_state rescuing.
Nov 29 05:50:14 user nova-compute[75083]: DEBUG nova.network.neutron [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Updating instance_info_cache with network_info: [{"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:50:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Releasing lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:50:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:50:14 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Creating image(s)
Nov 29 05:50:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "/opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "/opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "/opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:14 user nova-compute[75083]: DEBUG nova.objects.instance [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'trusted_certs' on Instance uuid 47437526-c4e4-4a15-ba9b-51bbae17c77b {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-24e85ad5-77e0-4368-aac3-5ba0615640f9 req-50608dbb-e3f5-42c5-b8cf-717d40bb1bc8 service nova] Acquired lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:50:14 user nova-compute[75083]: DEBUG nova.network.neutron [req-24e85ad5-77e0-4368-aac3-5ba0615640f9 req-50608dbb-e3f5-42c5-b8cf-717d40bb1bc8 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Refreshing network info cache for port 8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:50:14 user nova-compute[75083]: DEBUG nova.objects.base [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Object Instance<47437526-c4e4-4a15-ba9b-51bbae17c77b> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:50:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:14 user nova-compute[75083]: DEBUG nova.network.neutron [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Updating instance_info_cache with network_info: [{"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:50:14 user nova-compute[75083]: DEBUG nova.compute.manager [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:50:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7.part --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG nova.compute.manager [None req-6c34a2c1-4d4a-4e2f-ae68-1c5b7e55b654 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Releasing lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:50:15 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Instance spawned successfully.
Nov 29 05:50:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:50:15 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Instance destroyed successfully.
Nov 29 05:50:15 user nova-compute[75083]: DEBUG nova.objects.instance [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'resources' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG nova.objects.base [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Object Instance<e6d49806-cecd-473a-b92f-9255868d35c7> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1653680976',display_name='tempest-AttachVolumeTestJSON-server-1653680976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1653680976',id=1,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOJP1hrn9YscfxvgIeV/wzeq3iJtsHPsw4UYwsBDpY8QrDAnobm8WRbnfZio9s2zPze+QLzStURV3KhLmNcFlFIYVxh1xHzL9FnGoRwL1BjeWphRTOqz9jLnn2TEGffsg==',key_name='tempest-keypair-1515818350',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c4c1cb7a503b446f945f12b3b998035b',ramdisk_id='',reservation_id='r-50iyzeul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1539985865',owner_user_name='tempest-AttachVolumeTestJSON-1539985865-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f2d92aba5c4069b94b8a5cd8b72a46',uuid=e6d49806-cecd-473a-b92f-9255868d35c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converting VIF {"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG os_vif [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ec74c9e-a1, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=882a86d0-d2dc-448e-b4e3-8aac231959dc) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:15 user nova-compute[75083]: INFO os_vif [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1')
Nov 29 05:50:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBfoehTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:50:15 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:50:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7.part --force-share --output=json" returned: 0 in 0.271s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[47998d25-7a77-401e-992d-887765e72042]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:15 user nova-compute[75083]: INFO nova.compute.manager [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Took 13.18 seconds to spawn the instance on the hypervisor.
Nov 29 05:50:15 user nova-compute[75083]: DEBUG nova.compute.manager [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG nova.virt.images [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] d5b7e520-b0c0-4cfd-b004-0b56e2b9895a was qcow2, converting to raw {{(pid=75083) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG nova.privsep.utils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75083) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7.part /opt/stack/data/nova/instances/_base/6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7.converted {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:50:15 user nova-compute[75083]: No targets found.
Nov 29 05:50:15 user nova-compute[75083]: iSNS:
Nov 29 05:50:15 user nova-compute[75083]: No targets found.
Nov 29 05:50:15 user nova-compute[75083]: STATIC:
Nov 29 05:50:15 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5
Nov 29 05:50:15 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:50:15 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:50:15 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e
Nov 29 05:50:15 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:50:15 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:50:15 user nova-compute[75083]: FIRMWARE:
Nov 29 05:50:15 user nova-compute[75083]: No targets found.
Nov 29 05:50:15 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:50:15 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:50:15 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.043s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[931b2ece-ac8d-4ea1-ac8e-57026eeef820]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[97019553-9757-412b-a298-0c4a5728ea05]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:50:15 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:50:15 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:50:15 user nova-compute[75083]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:50:15 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b84812d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e'): ({'sdi'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Removing single pathed devices sdi {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.048s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c30c95e-24a5-4e73-80d0-4ecd79b08b1b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:15 user nova-compute[75083]: INFO nova.compute.manager [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Took 14.44 seconds to build instance.
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.033s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[97eaec22-e9d1-442d-ae55-80156cc07456]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Flushing IO for device /dev/sdi {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e638e8d-4331-4a50-9d9e-6dbcf5d6317e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.616s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.048s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc1a4bb-de78-4867-b66a-66d037842d14]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG nova.network.neutron [req-24e85ad5-77e0-4368-aac3-5ba0615640f9 req-50608dbb-e3f5-42c5-b8cf-717d40bb1bc8 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Updated VIF entry in instance network info cache for port 8c103582-6856-45ff-ac2b-7a30d3138c75. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:50:15 user nova-compute[75083]: DEBUG nova.network.neutron [req-24e85ad5-77e0-4368-aac3-5ba0615640f9 req-50608dbb-e3f5-42c5-b8cf-717d40bb1bc8 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Updating instance_info_cache with network_info: [{"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-24e85ad5-77e0-4368-aac3-5ba0615640f9 req-50608dbb-e3f5-42c5-b8cf-717d40bb1bc8 service nova] Releasing lock "refresh_cache-47437526-c4e4-4a15-ba9b-51bbae17c77b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.071s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7.part /opt/stack/data/nova/instances/_base/6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7.converted" returned: 0 in 0.404s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77fc61a-eec1-4fb8-bfa9-3d4aedb9f528]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7.converted --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] SCSI volumes sdi have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a88aa5e-c596-44c0-80ab-ffacdc5b2bd4]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecae7ca6-c77d-41a2-8c56-959c31999e92]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e, portal: 172.16.0.220,3260]
Nov 29 05:50:16 user nova-compute[75083]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e, portal: 172.16.0.220,3260] successful.
Nov 29 05:50:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b8072d-648e-4359-8a13-a114776d1a54]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.764s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] <== disconnect_volume: return (766ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Start _get_guest_xml network_info=[{"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '7ce2fae9-626b-4495-80e4-8b415ad2a295', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBfoehTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'e6d49806-cecd-473a-b92f-9255868d35c7', 'attached_at': '', 'detached_at': '', 'volume_id': 'e200b1ae-3a3c-42f0-af89-b218ba46537e', 'serial': 'e200b1ae-3a3c-42f0-af89-b218ba46537e'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.objects.instance [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'numa_topology' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.objects.base [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Object Instance<e6d49806-cecd-473a-b92f-9255868d35c7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:50:16 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:50:16 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7.converted --force-share --output=json" returned: 0 in 0.252s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.288s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7 --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.objects.instance [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.objects.base [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Object Instance<e6d49806-cecd-473a-b92f-9255868d35c7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBfoehTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:50:16 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:50:16 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:50:16 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dace47-7e2a-45ca-a0f0-061651ba3412]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:50:16 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46c8147-b3e8-4f5c-91b7-ae94fe2ae337]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e] added
Nov 29 05:50:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bac8d94-0dcc-473c-a82b-29180f851efb]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7 --force-share --output=json" returned: 0 in 0.212s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7 --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa69667-36a3-41e7-9df0-be64ce0397e9]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KBfoehTa {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KBfoehTa" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[098901dc-1945-4ab1-bf42-6b7e68ed1e6b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KBfoehTa'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb147b93-3307-4e2e-8978-db2b42e94afa]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[69116d25-d628-46ad-8db6-66e1ac5c3d28]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:50:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:50:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a86c031-e546-44aa-a85b-2de172fafd50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e, portal: 172.16.0.220,3260]
Nov 29 05:50:16 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e, portal: 172.16.0.220,3260] successful.
Nov 29 05:50:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7 --force-share --output=json" returned: 0 in 0.223s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7,backing_fmt=raw /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f71ff8f-571a-428d-bee2-ee931c034246]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7,backing_fmt=raw /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk 1073741824" returned: 0 in 0.065s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7 --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6506fad5-a61a-4af5-b264-81f5afbdfefa]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:50:16 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:50:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:50:16 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:50:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.440s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[121ca837-2b9c-4d82-963a-162e3843fbcf]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:50:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBfoehTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:50:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7 --force-share --output=json" returned: 0 in 0.269s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:17 user nova-compute[75083]: DEBUG nova.objects.instance [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'migration_context' on Instance uuid 47437526-c4e4-4a15-ba9b-51bbae17c77b {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:17 user nova-compute[75083]: DEBUG nova.objects.base [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Object Instance<47437526-c4e4-4a15-ba9b-51bbae17c77b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:50:17 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Rebasing disk image.
Nov 29 05:50:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.215s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a -F raw /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.493s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:50:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] <== connect_volume: return (1496ms) {'type': 'block', 'scsi_wwn': '23730613431363365', 'path': '/dev/sdc'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:50:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730613431363365', 'path': '/dev/sdc'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:50:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1653680976',display_name='tempest-AttachVolumeTestJSON-server-1653680976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1653680976',id=1,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOJP1hrn9YscfxvgIeV/wzeq3iJtsHPsw4UYwsBDpY8QrDAnobm8WRbnfZio9s2zPze+QLzStURV3KhLmNcFlFIYVxh1xHzL9FnGoRwL1BjeWphRTOqz9jLnn2TEGffsg==',key_name='tempest-keypair-1515818350',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c4c1cb7a503b446f945f12b3b998035b',ramdisk_id='',reservation_id='r-50iyzeul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1539985865',owner_user_name='tempest-AttachVolumeTestJSON-1539985865-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f2d92aba5c4069b94b8a5cd8b72a46',uuid=e6d49806-cecd-473a-b92f-9255868d35c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:50:18 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converting VIF {"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:50:18 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:50:18 user nova-compute[75083]: DEBUG nova.objects.instance [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'pci_devices' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:18 user nova-compute[75083]: DEBUG nova.objects.base [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Object Instance<e6d49806-cecd-473a-b92f-9255868d35c7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:50:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:50:18 user nova-compute[75083]:   <uuid>e6d49806-cecd-473a-b92f-9255868d35c7</uuid>
Nov 29 05:50:18 user nova-compute[75083]:   <name>instance-00000001</name>
Nov 29 05:50:18 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:50:18 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:50:18 user nova-compute[75083]:   <metadata>
Nov 29 05:50:18 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:50:18 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:50:18 user nova-compute[75083]:       <nova:name>tempest-AttachVolumeTestJSON-server-1653680976</nova:name>
Nov 29 05:50:18 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:50:16</nova:creationTime>
Nov 29 05:50:18 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:50:18 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:50:18 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:50:18 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:50:18 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:50:18 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:50:18 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:50:18 user nova-compute[75083]:       <nova:owner>
Nov 29 05:50:18 user nova-compute[75083]:         <nova:user uuid="25f2d92aba5c4069b94b8a5cd8b72a46">tempest-AttachVolumeTestJSON-1539985865-project-member</nova:user>
Nov 29 05:50:18 user nova-compute[75083]:         <nova:project uuid="c4c1cb7a503b446f945f12b3b998035b">tempest-AttachVolumeTestJSON-1539985865</nova:project>
Nov 29 05:50:18 user nova-compute[75083]:       </nova:owner>
Nov 29 05:50:18 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:50:18 user nova-compute[75083]:       <nova:ports>
Nov 29 05:50:18 user nova-compute[75083]:         <nova:port uuid="1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0">
Nov 29 05:50:18 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 05:50:18 user nova-compute[75083]:         </nova:port>
Nov 29 05:50:18 user nova-compute[75083]:       </nova:ports>
Nov 29 05:50:18 user nova-compute[75083]:     </nova:instance>
Nov 29 05:50:18 user nova-compute[75083]:   </metadata>
Nov 29 05:50:18 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:50:18 user nova-compute[75083]:     <system>
Nov 29 05:50:18 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:50:18 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:50:18 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:50:18 user nova-compute[75083]:       <entry name="serial">e6d49806-cecd-473a-b92f-9255868d35c7</entry>
Nov 29 05:50:18 user nova-compute[75083]:       <entry name="uuid">e6d49806-cecd-473a-b92f-9255868d35c7</entry>
Nov 29 05:50:18 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:50:18 user nova-compute[75083]:     </system>
Nov 29 05:50:18 user nova-compute[75083]:   </sysinfo>
Nov 29 05:50:18 user nova-compute[75083]:   <os>
Nov 29 05:50:18 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:50:18 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:50:18 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:50:18 user nova-compute[75083]:   </os>
Nov 29 05:50:18 user nova-compute[75083]:   <features>
Nov 29 05:50:18 user nova-compute[75083]:     <acpi/>
Nov 29 05:50:18 user nova-compute[75083]:     <apic/>
Nov 29 05:50:18 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:50:18 user nova-compute[75083]:   </features>
Nov 29 05:50:18 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:50:18 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:50:18 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:50:18 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:50:18 user nova-compute[75083]:   </clock>
Nov 29 05:50:18 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:50:18 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:50:18 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:50:18 user nova-compute[75083]:   </cpu>
Nov 29 05:50:18 user nova-compute[75083]:   <devices>
Nov 29 05:50:18 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:50:18 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:50:18 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk"/>
Nov 29 05:50:18 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:50:18 user nova-compute[75083]:     </disk>
Nov 29 05:50:18 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 05:50:18 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:50:18 user nova-compute[75083]:       <source dev="/dev/sdc"/>
Nov 29 05:50:18 user nova-compute[75083]:       <target dev="vdb" bus="virtio"/>
Nov 29 05:50:18 user nova-compute[75083]:       <serial>e200b1ae-3a3c-42f0-af89-b218ba46537e</serial>
Nov 29 05:50:18 user nova-compute[75083]:     </disk>
Nov 29 05:50:18 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:50:18 user nova-compute[75083]:       <mac address="fa:16:3e:7a:b6:78"/>
Nov 29 05:50:18 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:50:18 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:50:18 user nova-compute[75083]:       <target dev="tap1ec74c9e-a1"/>
Nov 29 05:50:18 user nova-compute[75083]:     </interface>
Nov 29 05:50:18 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:50:18 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/console.log" append="off"/>
Nov 29 05:50:18 user nova-compute[75083]:     </serial>
Nov 29 05:50:18 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:50:18 user nova-compute[75083]:     <video>
Nov 29 05:50:18 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:50:18 user nova-compute[75083]:     </video>
Nov 29 05:50:18 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:50:18 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:50:18 user nova-compute[75083]:     </rng>
Nov 29 05:50:18 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:50:18 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:50:18 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:50:18 user nova-compute[75083]:     </memballoon>
Nov 29 05:50:18 user nova-compute[75083]:   </devices>
Nov 29 05:50:18 user nova-compute[75083]: </domain>
Nov 29 05:50:18 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:50:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:50:18 user nova-compute[75083]: DEBUG nova.objects.instance [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'trusted_certs' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:18 user nova-compute[75083]: DEBUG nova.objects.base [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Object Instance<e6d49806-cecd-473a-b92f-9255868d35c7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:50:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.224s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:18 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:50:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Cannot resize image /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG nova.objects.instance [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'migration_context' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG nova.objects.base [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Object Instance<e6d49806-cecd-473a-b92f-9255868d35c7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1653680976',display_name='tempest-AttachVolumeTestJSON-server-1653680976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1653680976',id=1,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOJP1hrn9YscfxvgIeV/wzeq3iJtsHPsw4UYwsBDpY8QrDAnobm8WRbnfZio9s2zPze+QLzStURV3KhLmNcFlFIYVxh1xHzL9FnGoRwL1BjeWphRTOqz9jLnn2TEGffsg==',key_name='tempest-keypair-1515818350',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c4c1cb7a503b446f945f12b3b998035b',ramdisk_id='',reservation_id='r-50iyzeul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1539985865',owner_user_name='tempest-AttachVolumeTestJSON-1539985865-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f2d92aba5c4069b94b8a5cd8b72a46',uuid=e6d49806-cecd-473a-b92f-9255868d35c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converting VIF {"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG os_vif [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05a6127a-48f5-5d96-ae49-756bfea79ee2', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ec74c9e-a1, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ec74c9e-a1, col_values=(('qos', UUID('929e5894-8d4c-4d79-becb-7b18ff92a9de')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ec74c9e-a1, col_values=(('external_ids', {'iface-id': '1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:b6:78', 'vm-uuid': 'e6d49806-cecd-473a-b92f-9255868d35c7'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:50:19 user nova-compute[75083]: INFO os_vif [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1')
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a -F raw /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk" returned: 0 in 2.811s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Ensure instance console log exists: /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Start _get_guest_xml network_info=[{"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='96646b6ce0f9f5b9317d94f46b264dfc',container_format='bare',created_at=2023-11-29T05:48:09Z,direct_url=<?>,disk_format='qcow2',id=d5b7e520-b0c0-4cfd-b004-0b56e2b9895a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-265924046-shelved',owner='d1c63c54083f4a0eba38539e7c196d61',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T05:48:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '412950e6-78bc-42e6-b6cd-a6dcda7c3ac0', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTDptqIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '47437526-c4e4-4a15-ba9b-51bbae17c77b', 'attached_at': '', 'detached_at': '', 'volume_id': 'af19f30c-72b8-4314-8bd3-1ca696377611', 'serial': 'af19f30c-72b8-4314-8bd3-1ca696377611'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:50:20 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:50:20 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='96646b6ce0f9f5b9317d94f46b264dfc',container_format='bare',created_at=2023-11-29T05:48:09Z,direct_url=<?>,disk_format='qcow2',id=d5b7e520-b0c0-4cfd-b004-0b56e2b9895a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-265924046-shelved',owner='d1c63c54083f4a0eba38539e7c196d61',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T05:48:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.objects.instance [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'vcpu_model' on Instance uuid 47437526-c4e4-4a15-ba9b-51bbae17c77b {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.objects.base [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Object Instance<47437526-c4e4-4a15-ba9b-51bbae17c77b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTDptqIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:50:20 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:50:20 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:50:20 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[31edc50e-c60a-48a4-92ab-1da0d42dbe30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:50:20 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[03738678-6a13-472a-b3d7-2a99fc8f3002]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611] added
Nov 29 05:50:20 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e9f576-86a8-4357-9714-4181d132dfef]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[45966fcb-ec6c-46a8-87ab-869db7c6109b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wTDptqIg {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wTDptqIg" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bec4ab8-e0f6-498b-ae73-f6becfedfb5f]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wTDptqIg'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.152s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d03a282-46c3-4f07-afb5-756c12ddfbe6]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[233be5b7-5d85-4378-b744-663808bbcf0f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:50:20 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:50:20 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:50:20 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:50:20 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccc2fc5-2d82-4b69-80ef-d5e2eb6c99c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611, portal: 172.16.0.220,3260]
Nov 29 05:50:20 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611, portal: 172.16.0.220,3260] successful.
Nov 29 05:50:20 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[638f08a3-aee9-4313-9645-7bdbd92d7d3f]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[422a1c73-40c8-4d8a-a87a-14f91042426c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:50:20 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:50:20 user nova-compute[75083]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)
Nov 29 05:50:20 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:50:20 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:50:20 user nova-compute[75083]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)
Nov 29 05:50:20 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.502s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a101fc6-01d6-4e4f-8ecb-42d486e5fdcc]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTDptqIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.552s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] <== connect_volume: return (1554ms) {'type': 'block', 'scsi_wwn': '23865613935303834', 'path': '/dev/sdd'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865613935303834', 'path': '/dev/sdd'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T05:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-265924046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-265924046',id=4,image_ref='d5b7e520-b0c0-4cfd-b004-0b56e2b9895a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1939493904',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d1c63c54083f4a0eba38539e7c196d61',ramdisk_id='',reservation_id='r-1epz6053',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-961204558',owner_user_name='tempest-AttachVolumeShelveTestJSON-961204558-project-member',shelved_at='2023-11-29T05:48:13.798770',shelved_host='user',shelved_image_id='d5b7e520-b0c0-4cfd-b004-0b56e2b9895a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:50:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4e6b7adfb1b469ab5c6c3f26633272a',uuid=47437526-c4e4-4a15-ba9b-51bbae17c77b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converting VIF {"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:74:88,bridge_name='br-int',has_traffic_filtering=True,id=8c103582-6856-45ff-ac2b-7a30d3138c75,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c103582-68') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG nova.objects.instance [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'pci_devices' on Instance uuid 47437526-c4e4-4a15-ba9b-51bbae17c77b {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG nova.objects.base [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Object Instance<47437526-c4e4-4a15-ba9b-51bbae17c77b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:50:21 user nova-compute[75083]:   <uuid>47437526-c4e4-4a15-ba9b-51bbae17c77b</uuid>
Nov 29 05:50:21 user nova-compute[75083]:   <name>instance-00000004</name>
Nov 29 05:50:21 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:50:21 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:50:21 user nova-compute[75083]:   <metadata>
Nov 29 05:50:21 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:50:21 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:50:21 user nova-compute[75083]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-265924046</nova:name>
Nov 29 05:50:21 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:50:20</nova:creationTime>
Nov 29 05:50:21 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:50:21 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:50:21 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:50:21 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:50:21 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:50:21 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:50:21 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:50:21 user nova-compute[75083]:       <nova:owner>
Nov 29 05:50:21 user nova-compute[75083]:         <nova:user uuid="e4e6b7adfb1b469ab5c6c3f26633272a">tempest-AttachVolumeShelveTestJSON-961204558-project-member</nova:user>
Nov 29 05:50:21 user nova-compute[75083]:         <nova:project uuid="d1c63c54083f4a0eba38539e7c196d61">tempest-AttachVolumeShelveTestJSON-961204558</nova:project>
Nov 29 05:50:21 user nova-compute[75083]:       </nova:owner>
Nov 29 05:50:21 user nova-compute[75083]:       <nova:root type="image" uuid="d5b7e520-b0c0-4cfd-b004-0b56e2b9895a"/>
Nov 29 05:50:21 user nova-compute[75083]:       <nova:ports>
Nov 29 05:50:21 user nova-compute[75083]:         <nova:port uuid="8c103582-6856-45ff-ac2b-7a30d3138c75">
Nov 29 05:50:21 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 05:50:21 user nova-compute[75083]:         </nova:port>
Nov 29 05:50:21 user nova-compute[75083]:       </nova:ports>
Nov 29 05:50:21 user nova-compute[75083]:     </nova:instance>
Nov 29 05:50:21 user nova-compute[75083]:   </metadata>
Nov 29 05:50:21 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:50:21 user nova-compute[75083]:     <system>
Nov 29 05:50:21 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:50:21 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:50:21 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:50:21 user nova-compute[75083]:       <entry name="serial">47437526-c4e4-4a15-ba9b-51bbae17c77b</entry>
Nov 29 05:50:21 user nova-compute[75083]:       <entry name="uuid">47437526-c4e4-4a15-ba9b-51bbae17c77b</entry>
Nov 29 05:50:21 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:50:21 user nova-compute[75083]:     </system>
Nov 29 05:50:21 user nova-compute[75083]:   </sysinfo>
Nov 29 05:50:21 user nova-compute[75083]:   <os>
Nov 29 05:50:21 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:50:21 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:50:21 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:50:21 user nova-compute[75083]:   </os>
Nov 29 05:50:21 user nova-compute[75083]:   <features>
Nov 29 05:50:21 user nova-compute[75083]:     <acpi/>
Nov 29 05:50:21 user nova-compute[75083]:     <apic/>
Nov 29 05:50:21 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:50:21 user nova-compute[75083]:   </features>
Nov 29 05:50:21 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:50:21 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:50:21 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:50:21 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:50:21 user nova-compute[75083]:   </clock>
Nov 29 05:50:21 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:50:21 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:50:21 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:50:21 user nova-compute[75083]:   </cpu>
Nov 29 05:50:21 user nova-compute[75083]:   <devices>
Nov 29 05:50:21 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:50:21 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:50:21 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk"/>
Nov 29 05:50:21 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:50:21 user nova-compute[75083]:     </disk>
Nov 29 05:50:21 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 05:50:21 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:50:21 user nova-compute[75083]:       <source dev="/dev/sdd"/>
Nov 29 05:50:21 user nova-compute[75083]:       <target dev="vdc" bus="virtio"/>
Nov 29 05:50:21 user nova-compute[75083]:       <serial>af19f30c-72b8-4314-8bd3-1ca696377611</serial>
Nov 29 05:50:21 user nova-compute[75083]:     </disk>
Nov 29 05:50:21 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:50:21 user nova-compute[75083]:       <mac address="fa:16:3e:bd:74:88"/>
Nov 29 05:50:21 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:50:21 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:50:21 user nova-compute[75083]:       <target dev="tap8c103582-68"/>
Nov 29 05:50:21 user nova-compute[75083]:     </interface>
Nov 29 05:50:21 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:50:21 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/console.log" append="off"/>
Nov 29 05:50:21 user nova-compute[75083]:     </serial>
Nov 29 05:50:21 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:50:21 user nova-compute[75083]:     <video>
Nov 29 05:50:21 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:50:21 user nova-compute[75083]:     </video>
Nov 29 05:50:21 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:50:21 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:50:21 user nova-compute[75083]:     </rng>
Nov 29 05:50:21 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:50:21 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:50:21 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:50:21 user nova-compute[75083]:     </memballoon>
Nov 29 05:50:21 user nova-compute[75083]:   </devices>
Nov 29 05:50:21 user nova-compute[75083]: </domain>
Nov 29 05:50:21 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T05:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-265924046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-265924046',id=4,image_ref='d5b7e520-b0c0-4cfd-b004-0b56e2b9895a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1939493904',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d1c63c54083f4a0eba38539e7c196d61',ramdisk_id='',reservation_id='r-1epz6053',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-961204558',owner_user_name='tempest-AttachVolumeShelveTestJSON-961204558-project-member',shelved_at='2023-11-29T05:48:13.798770',shelved_host='user',shelved_image_id='d5b7e520-b0c0-4cfd-b004-0b56e2b9895a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:50:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4e6b7adfb1b469ab5c6c3f26633272a',uuid=47437526-c4e4-4a15-ba9b-51bbae17c77b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converting VIF {"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:74:88,bridge_name='br-int',has_traffic_filtering=True,id=8c103582-6856-45ff-ac2b-7a30d3138c75,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c103582-68') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG os_vif [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:74:88,bridge_name='br-int',has_traffic_filtering=True,id=8c103582-6856-45ff-ac2b-7a30d3138c75,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c103582-68') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac3c5f32-3dd7-5470-a8d8-555a2ba0df83', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c103582-68, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c103582-68, col_values=(('qos', UUID('e470b3ff-f9d7-4ac3-9f41-3590b506fbee')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c103582-68, col_values=(('external_ids', {'iface-id': '8c103582-6856-45ff-ac2b-7a30d3138c75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:74:88', 'vm-uuid': '47437526-c4e4-4a15-ba9b-51bbae17c77b'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:50:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:21 user nova-compute[75083]: INFO os_vif [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:74:88,bridge_name='br-int',has_traffic_filtering=True,id=8c103582-6856-45ff-ac2b-7a30d3138c75,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c103582-68')
Nov 29 05:50:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:50:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:50:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] No VIF found with MAC fa:16:3e:bd:74:88, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:50:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-5c6bda75-0879-4844-acfd-bafdf91d28e6 req-ab66851a-8c37-48b0-b1e3-4aacec676d5e service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:50:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5c6bda75-0879-4844-acfd-bafdf91d28e6 req-ab66851a-8c37-48b0-b1e3-4aacec676d5e service nova] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5c6bda75-0879-4844-acfd-bafdf91d28e6 req-ab66851a-8c37-48b0-b1e3-4aacec676d5e service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5c6bda75-0879-4844-acfd-bafdf91d28e6 req-ab66851a-8c37-48b0-b1e3-4aacec676d5e service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-5c6bda75-0879-4844-acfd-bafdf91d28e6 req-ab66851a-8c37-48b0-b1e3-4aacec676d5e service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] No waiting events found dispatching network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:50:23 user nova-compute[75083]: WARNING nova.compute.manager [req-5c6bda75-0879-4844-acfd-bafdf91d28e6 req-ab66851a-8c37-48b0-b1e3-4aacec676d5e service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received unexpected event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 for instance with vm_state stopped and task_state powering-on.
Nov 29 05:50:23 user nova-compute[75083]: DEBUG nova.compute.manager [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:50:23 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Instance rebooted successfully.
Nov 29 05:50:23 user nova-compute[75083]: DEBUG nova.compute.manager [None req-27b52dc7-2fff-4c1d-9502-e5fd1ea7fe25 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:50:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:24 user nova-compute[75083]: DEBUG nova.compute.manager [req-82c694de-0f75-4886-b740-7fbb942172e0 req-67a05128-c749-47df-abf9-6147f74325c3 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received event network-vif-plugged-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:50:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-82c694de-0f75-4886-b740-7fbb942172e0 req-67a05128-c749-47df-abf9-6147f74325c3 service nova] Acquiring lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-82c694de-0f75-4886-b740-7fbb942172e0 req-67a05128-c749-47df-abf9-6147f74325c3 service nova] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-82c694de-0f75-4886-b740-7fbb942172e0 req-67a05128-c749-47df-abf9-6147f74325c3 service nova] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:24 user nova-compute[75083]: DEBUG nova.compute.manager [req-82c694de-0f75-4886-b740-7fbb942172e0 req-67a05128-c749-47df-abf9-6147f74325c3 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] No waiting events found dispatching network-vif-plugged-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:50:24 user nova-compute[75083]: WARNING nova.compute.manager [req-82c694de-0f75-4886-b740-7fbb942172e0 req-67a05128-c749-47df-abf9-6147f74325c3 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received unexpected event network-vif-plugged-8c103582-6856-45ff-ac2b-7a30d3138c75 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 05:50:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-9737bfd4-d8cc-45e4-891d-49896f269d46 req-8ffa9d46-5b7b-4f52-a148-675c4fe90428 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:50:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9737bfd4-d8cc-45e4-891d-49896f269d46 req-8ffa9d46-5b7b-4f52-a148-675c4fe90428 service nova] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9737bfd4-d8cc-45e4-891d-49896f269d46 req-8ffa9d46-5b7b-4f52-a148-675c4fe90428 service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9737bfd4-d8cc-45e4-891d-49896f269d46 req-8ffa9d46-5b7b-4f52-a148-675c4fe90428 service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-9737bfd4-d8cc-45e4-891d-49896f269d46 req-8ffa9d46-5b7b-4f52-a148-675c4fe90428 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] No waiting events found dispatching network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:50:25 user nova-compute[75083]: WARNING nova.compute.manager [req-9737bfd4-d8cc-45e4-891d-49896f269d46 req-8ffa9d46-5b7b-4f52-a148-675c4fe90428 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received unexpected event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 for instance with vm_state active and task_state None.
Nov 29 05:50:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-f341ce03-12e8-4d92-aab7-fe1f75e16692 req-35ab000a-87a3-4e41-81f2-d853cbf1a812 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received event network-vif-plugged-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:50:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f341ce03-12e8-4d92-aab7-fe1f75e16692 req-35ab000a-87a3-4e41-81f2-d853cbf1a812 service nova] Acquiring lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f341ce03-12e8-4d92-aab7-fe1f75e16692 req-35ab000a-87a3-4e41-81f2-d853cbf1a812 service nova] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f341ce03-12e8-4d92-aab7-fe1f75e16692 req-35ab000a-87a3-4e41-81f2-d853cbf1a812 service nova] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-f341ce03-12e8-4d92-aab7-fe1f75e16692 req-35ab000a-87a3-4e41-81f2-d853cbf1a812 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] No waiting events found dispatching network-vif-plugged-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:50:26 user nova-compute[75083]: WARNING nova.compute.manager [req-f341ce03-12e8-4d92-aab7-fe1f75e16692 req-35ab000a-87a3-4e41-81f2-d853cbf1a812 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received unexpected event network-vif-plugged-8c103582-6856-45ff-ac2b-7a30d3138c75 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 05:50:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:50:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:50:26 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Instance spawned successfully.
Nov 29 05:50:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:50:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52b8f767-caef-41fe-a28e-243598108fb5 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.380s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquiring lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:29 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:50:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:29 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:50:29 user nova-compute[75083]: INFO nova.compute.claims [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Claim successful on node user
Nov 29 05:50:29 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:50:29 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:50:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:29 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:50:29 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:50:29 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:50:30 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:50:30 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:50:30 user nova-compute[75083]: DEBUG nova.policy [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2615574010e4604b526176f69ccfff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1012483943a489a862040d3a9fddfb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:50:30 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:50:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:50:30 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Creating image(s)
Nov 29 05:50:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "/opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "/opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.362s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.199s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk 1073741824" returned: 0 in 0.068s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:31 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Successfully created port: e58bdd4f-988b-40e7-867b-25c7c306f96f {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:50:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.293s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:31 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:50:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:31 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Cannot resize image /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:50:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:50:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Ensure instance console log exists: /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:50:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:31 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Successfully updated port: e58bdd4f-988b-40e7-867b-25c7c306f96f {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:50:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquiring lock "refresh_cache-eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:50:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquired lock "refresh_cache-eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:50:31 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:50:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-126b7076-37e7-4b1a-9573-14a3a8384dbf req-4f679276-da27-418b-80c2-e6dcc4cbcf03 service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Received event network-changed-e58bdd4f-988b-40e7-867b-25c7c306f96f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:50:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-126b7076-37e7-4b1a-9573-14a3a8384dbf req-4f679276-da27-418b-80c2-e6dcc4cbcf03 service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Refreshing instance network info cache due to event network-changed-e58bdd4f-988b-40e7-867b-25c7c306f96f. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:50:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-126b7076-37e7-4b1a-9573-14a3a8384dbf req-4f679276-da27-418b-80c2-e6dcc4cbcf03 service nova] Acquiring lock "refresh_cache-eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:50:31 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:50:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Updating instance_info_cache with network_info: [{"id": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "address": "fa:16:3e:0f:c8:f5", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape58bdd4f-98", "ovs_interfaceid": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Releasing lock "refresh_cache-eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Instance network_info: |[{"id": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "address": "fa:16:3e:0f:c8:f5", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape58bdd4f-98", "ovs_interfaceid": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-126b7076-37e7-4b1a-9573-14a3a8384dbf req-4f679276-da27-418b-80c2-e6dcc4cbcf03 service nova] Acquired lock "refresh_cache-eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.network.neutron [req-126b7076-37e7-4b1a-9573-14a3a8384dbf req-4f679276-da27-418b-80c2-e6dcc4cbcf03 service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Refreshing network info cache for port e58bdd4f-988b-40e7-867b-25c7c306f96f {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Start _get_guest_xml network_info=[{"id": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "address": "fa:16:3e:0f:c8:f5", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape58bdd4f-98", "ovs_interfaceid": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:50:33 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:50:33 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-794950177',display_name='tempest-VolumesAdminNegativeTest-server-794950177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-794950177',id=13,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOifxrw9oj4jT4psUDDcu8gRts7j7C2WqINDoEEELfOg8Q+KNuGsopf7w9BuKjxFnpF+mTK3WSBQNWmyY07q6cTo1oyFxbaTQLPr8EJbttZwPt/Al8jcgvFbvfrYhWLTqQ==',key_name='tempest-keypair-1799727666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1012483943a489a862040d3a9fddfb6',ramdisk_id='',reservation_id='r-uiztzhe0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-971732472',owner_user_name='tempest-VolumesAdminNegativeTest-971732472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:50:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2615574010e4604b526176f69ccfff0',uuid=eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "address": "fa:16:3e:0f:c8:f5", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape58bdd4f-98", "ovs_interfaceid": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Converting VIF {"id": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "address": "fa:16:3e:0f:c8:f5", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape58bdd4f-98", "ovs_interfaceid": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:c8:f5,bridge_name='br-int',has_traffic_filtering=True,id=e58bdd4f-988b-40e7-867b-25c7c306f96f,network=Network(c6a6ca21-a775-4c8e-9075-4dc10bc6cf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape58bdd4f-98') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.objects.instance [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lazy-loading 'pci_devices' on Instance uuid eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:50:33 user nova-compute[75083]:   <uuid>eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d</uuid>
Nov 29 05:50:33 user nova-compute[75083]:   <name>instance-0000000d</name>
Nov 29 05:50:33 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:50:33 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:50:33 user nova-compute[75083]:   <metadata>
Nov 29 05:50:33 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:50:33 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:50:33 user nova-compute[75083]:       <nova:name>tempest-VolumesAdminNegativeTest-server-794950177</nova:name>
Nov 29 05:50:33 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:50:33</nova:creationTime>
Nov 29 05:50:33 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:50:33 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:50:33 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:50:33 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:50:33 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:50:33 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:50:33 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:50:33 user nova-compute[75083]:       <nova:owner>
Nov 29 05:50:33 user nova-compute[75083]:         <nova:user uuid="a2615574010e4604b526176f69ccfff0">tempest-VolumesAdminNegativeTest-971732472-project-member</nova:user>
Nov 29 05:50:33 user nova-compute[75083]:         <nova:project uuid="c1012483943a489a862040d3a9fddfb6">tempest-VolumesAdminNegativeTest-971732472</nova:project>
Nov 29 05:50:33 user nova-compute[75083]:       </nova:owner>
Nov 29 05:50:33 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:50:33 user nova-compute[75083]:       <nova:ports>
Nov 29 05:50:33 user nova-compute[75083]:         <nova:port uuid="e58bdd4f-988b-40e7-867b-25c7c306f96f">
Nov 29 05:50:33 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 05:50:33 user nova-compute[75083]:         </nova:port>
Nov 29 05:50:33 user nova-compute[75083]:       </nova:ports>
Nov 29 05:50:33 user nova-compute[75083]:     </nova:instance>
Nov 29 05:50:33 user nova-compute[75083]:   </metadata>
Nov 29 05:50:33 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:50:33 user nova-compute[75083]:     <system>
Nov 29 05:50:33 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:50:33 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:50:33 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:50:33 user nova-compute[75083]:       <entry name="serial">eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d</entry>
Nov 29 05:50:33 user nova-compute[75083]:       <entry name="uuid">eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d</entry>
Nov 29 05:50:33 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:50:33 user nova-compute[75083]:     </system>
Nov 29 05:50:33 user nova-compute[75083]:   </sysinfo>
Nov 29 05:50:33 user nova-compute[75083]:   <os>
Nov 29 05:50:33 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:50:33 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:50:33 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:50:33 user nova-compute[75083]:   </os>
Nov 29 05:50:33 user nova-compute[75083]:   <features>
Nov 29 05:50:33 user nova-compute[75083]:     <acpi/>
Nov 29 05:50:33 user nova-compute[75083]:     <apic/>
Nov 29 05:50:33 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:50:33 user nova-compute[75083]:   </features>
Nov 29 05:50:33 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:50:33 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:50:33 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:50:33 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:50:33 user nova-compute[75083]:   </clock>
Nov 29 05:50:33 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:50:33 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:50:33 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:50:33 user nova-compute[75083]:   </cpu>
Nov 29 05:50:33 user nova-compute[75083]:   <devices>
Nov 29 05:50:33 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:50:33 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:50:33 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk"/>
Nov 29 05:50:33 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:50:33 user nova-compute[75083]:     </disk>
Nov 29 05:50:33 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:50:33 user nova-compute[75083]:       <mac address="fa:16:3e:0f:c8:f5"/>
Nov 29 05:50:33 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:50:33 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:50:33 user nova-compute[75083]:       <target dev="tape58bdd4f-98"/>
Nov 29 05:50:33 user nova-compute[75083]:     </interface>
Nov 29 05:50:33 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:50:33 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/console.log" append="off"/>
Nov 29 05:50:33 user nova-compute[75083]:     </serial>
Nov 29 05:50:33 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:50:33 user nova-compute[75083]:     <video>
Nov 29 05:50:33 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:50:33 user nova-compute[75083]:     </video>
Nov 29 05:50:33 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:50:33 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:50:33 user nova-compute[75083]:     </rng>
Nov 29 05:50:33 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:50:33 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:50:33 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:50:33 user nova-compute[75083]:     </memballoon>
Nov 29 05:50:33 user nova-compute[75083]:   </devices>
Nov 29 05:50:33 user nova-compute[75083]: </domain>
Nov 29 05:50:33 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-794950177',display_name='tempest-VolumesAdminNegativeTest-server-794950177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-794950177',id=13,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOifxrw9oj4jT4psUDDcu8gRts7j7C2WqINDoEEELfOg8Q+KNuGsopf7w9BuKjxFnpF+mTK3WSBQNWmyY07q6cTo1oyFxbaTQLPr8EJbttZwPt/Al8jcgvFbvfrYhWLTqQ==',key_name='tempest-keypair-1799727666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1012483943a489a862040d3a9fddfb6',ramdisk_id='',reservation_id='r-uiztzhe0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-971732472',owner_user_name='tempest-VolumesAdminNegativeTest-971732472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:50:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2615574010e4604b526176f69ccfff0',uuid=eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "address": "fa:16:3e:0f:c8:f5", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape58bdd4f-98", "ovs_interfaceid": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Converting VIF {"id": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "address": "fa:16:3e:0f:c8:f5", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape58bdd4f-98", "ovs_interfaceid": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:c8:f5,bridge_name='br-int',has_traffic_filtering=True,id=e58bdd4f-988b-40e7-867b-25c7c306f96f,network=Network(c6a6ca21-a775-4c8e-9075-4dc10bc6cf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape58bdd4f-98') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG os_vif [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:c8:f5,bridge_name='br-int',has_traffic_filtering=True,id=e58bdd4f-988b-40e7-867b-25c7c306f96f,network=Network(c6a6ca21-a775-4c8e-9075-4dc10bc6cf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape58bdd4f-98') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3dc3c59a-cfb7-533f-b5a8-41f100acffbf', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape58bdd4f-98, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape58bdd4f-98, col_values=(('qos', UUID('ec854371-59f4-4f6e-a5d0-27f2869045f2')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape58bdd4f-98, col_values=(('external_ids', {'iface-id': 'e58bdd4f-988b-40e7-867b-25c7c306f96f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:c8:f5', 'vm-uuid': 'eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:33 user nova-compute[75083]: INFO os_vif [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:c8:f5,bridge_name='br-int',has_traffic_filtering=True,id=e58bdd4f-988b-40e7-867b-25c7c306f96f,network=Network(c6a6ca21-a775-4c8e-9075-4dc10bc6cf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape58bdd4f-98')
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] No VIF found with MAC fa:16:3e:0f:c8:f5, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.network.neutron [req-126b7076-37e7-4b1a-9573-14a3a8384dbf req-4f679276-da27-418b-80c2-e6dcc4cbcf03 service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Updated VIF entry in instance network info cache for port e58bdd4f-988b-40e7-867b-25c7c306f96f. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:50:33 user nova-compute[75083]: DEBUG nova.network.neutron [req-126b7076-37e7-4b1a-9573-14a3a8384dbf req-4f679276-da27-418b-80c2-e6dcc4cbcf03 service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Updating instance_info_cache with network_info: [{"id": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "address": "fa:16:3e:0f:c8:f5", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape58bdd4f-98", "ovs_interfaceid": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:50:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-126b7076-37e7-4b1a-9573-14a3a8384dbf req-4f679276-da27-418b-80c2-e6dcc4cbcf03 service nova] Releasing lock "refresh_cache-eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:50:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:36 user nova-compute[75083]: DEBUG nova.compute.manager [req-2d177feb-1748-4642-a54c-b9c68493de2f req-23b22fa1-2486-48e9-9bc8-736894ebfd9d service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Received event network-vif-plugged-e58bdd4f-988b-40e7-867b-25c7c306f96f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:50:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2d177feb-1748-4642-a54c-b9c68493de2f req-23b22fa1-2486-48e9-9bc8-736894ebfd9d service nova] Acquiring lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2d177feb-1748-4642-a54c-b9c68493de2f req-23b22fa1-2486-48e9-9bc8-736894ebfd9d service nova] Lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2d177feb-1748-4642-a54c-b9c68493de2f req-23b22fa1-2486-48e9-9bc8-736894ebfd9d service nova] Lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:36 user nova-compute[75083]: DEBUG nova.compute.manager [req-2d177feb-1748-4642-a54c-b9c68493de2f req-23b22fa1-2486-48e9-9bc8-736894ebfd9d service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] No waiting events found dispatching network-vif-plugged-e58bdd4f-988b-40e7-867b-25c7c306f96f {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:50:36 user nova-compute[75083]: WARNING nova.compute.manager [req-2d177feb-1748-4642-a54c-b9c68493de2f req-23b22fa1-2486-48e9-9bc8-736894ebfd9d service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Received unexpected event network-vif-plugged-e58bdd4f-988b-40e7-867b-25c7c306f96f for instance with vm_state building and task_state spawning.
Nov 29 05:50:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-f6bb79ea-1e4e-4c7f-98dd-66a4b037dbe8 req-df2d17c5-1867-4639-a656-2cb8550c848c service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Received event network-vif-plugged-e58bdd4f-988b-40e7-867b-25c7c306f96f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:50:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f6bb79ea-1e4e-4c7f-98dd-66a4b037dbe8 req-df2d17c5-1867-4639-a656-2cb8550c848c service nova] Acquiring lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f6bb79ea-1e4e-4c7f-98dd-66a4b037dbe8 req-df2d17c5-1867-4639-a656-2cb8550c848c service nova] Lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f6bb79ea-1e4e-4c7f-98dd-66a4b037dbe8 req-df2d17c5-1867-4639-a656-2cb8550c848c service nova] Lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-f6bb79ea-1e4e-4c7f-98dd-66a4b037dbe8 req-df2d17c5-1867-4639-a656-2cb8550c848c service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] No waiting events found dispatching network-vif-plugged-e58bdd4f-988b-40e7-867b-25c7c306f96f {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:50:38 user nova-compute[75083]: WARNING nova.compute.manager [req-f6bb79ea-1e4e-4c7f-98dd-66a4b037dbe8 req-df2d17c5-1867-4639-a656-2cb8550c848c service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Received unexpected event network-vif-plugged-e58bdd4f-988b-40e7-867b-25c7c306f96f for instance with vm_state building and task_state spawning.
Nov 29 05:50:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:50:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:50:38 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Instance spawned successfully.
Nov 29 05:50:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:50:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:50:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:50:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:50:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:50:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:50:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:50:38 user nova-compute[75083]: INFO nova.compute.manager [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Took 8.42 seconds to spawn the instance on the hypervisor.
Nov 29 05:50:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:50:38 user nova-compute[75083]: INFO nova.compute.manager [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Took 9.47 seconds to build instance.
Nov 29 05:50:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f65c55bb-eeed-4aa2-a1f8-4ed345681f07 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.610s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:56 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:50:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Acquiring lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:57 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:50:57 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 05:50:57 user nova-compute[75083]: DEBUG nova.compute.manager [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:50:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:50:57 user nova-compute[75083]: INFO nova.compute.claims [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Claim successful on node user
Nov 29 05:50:58 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:50:58 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:50:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:58 user nova-compute[75083]: DEBUG nova.compute.manager [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:50:58 user nova-compute[75083]: DEBUG nova.compute.manager [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:50:58 user nova-compute[75083]: DEBUG nova.network.neutron [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:50:58 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:50:58 user nova-compute[75083]: DEBUG nova.compute.manager [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:50:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:50:58 user nova-compute[75083]: DEBUG nova.policy [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b064ac59001b4360b9818f486491616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5501672b5066489aa61e9a9e26e9d5e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:50:58 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:50:58 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:50:58 user nova-compute[75083]: DEBUG nova.compute.manager [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:50:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:50:58 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Creating image(s)
Nov 29 05:50:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Acquiring lock "/opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "/opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "/opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.019s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.289s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.250s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4/disk 1073741824" returned: 0 in 0.058s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG nova.network.neutron [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Successfully created port: 85f6598a-8c09-4f42-9eef-143573c095f9 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.191s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Cannot resize image /opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Ensure instance console log exists: /opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:50:59 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.network.neutron [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Successfully updated port: 85f6598a-8c09-4f42-9eef-143573c095f9 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Acquiring lock "refresh_cache-2acbda14-e4bc-49ac-81e2-ce28bc3878d4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Acquired lock "refresh_cache-2acbda14-e4bc-49ac-81e2-ce28bc3878d4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.network.neutron [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.compute.manager [req-ac8d5567-4dc0-4fe2-84de-82cf769d92b7 req-2761b456-d1e0-4501-ae00-bc0f00715b7b service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Received event network-changed-85f6598a-8c09-4f42-9eef-143573c095f9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.compute.manager [req-ac8d5567-4dc0-4fe2-84de-82cf769d92b7 req-2761b456-d1e0-4501-ae00-bc0f00715b7b service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Refreshing instance network info cache due to event network-changed-85f6598a-8c09-4f42-9eef-143573c095f9. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ac8d5567-4dc0-4fe2-84de-82cf769d92b7 req-2761b456-d1e0-4501-ae00-bc0f00715b7b service nova] Acquiring lock "refresh_cache-2acbda14-e4bc-49ac-81e2-ce28bc3878d4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.network.neutron [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.network.neutron [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Updating instance_info_cache with network_info: [{"id": "85f6598a-8c09-4f42-9eef-143573c095f9", "address": "fa:16:3e:8d:52:51", "network": {"id": "6c528f9c-4754-47e2-91db-2d70336b8dd7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-743033576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5501672b5066489aa61e9a9e26e9d5e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6598a-8c", "ovs_interfaceid": "85f6598a-8c09-4f42-9eef-143573c095f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Releasing lock "refresh_cache-2acbda14-e4bc-49ac-81e2-ce28bc3878d4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Instance network_info: |[{"id": "85f6598a-8c09-4f42-9eef-143573c095f9", "address": "fa:16:3e:8d:52:51", "network": {"id": "6c528f9c-4754-47e2-91db-2d70336b8dd7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-743033576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5501672b5066489aa61e9a9e26e9d5e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6598a-8c", "ovs_interfaceid": "85f6598a-8c09-4f42-9eef-143573c095f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ac8d5567-4dc0-4fe2-84de-82cf769d92b7 req-2761b456-d1e0-4501-ae00-bc0f00715b7b service nova] Acquired lock "refresh_cache-2acbda14-e4bc-49ac-81e2-ce28bc3878d4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.network.neutron [req-ac8d5567-4dc0-4fe2-84de-82cf769d92b7 req-2761b456-d1e0-4501-ae00-bc0f00715b7b service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Refreshing network info cache for port 85f6598a-8c09-4f42-9eef-143573c095f9 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Start _get_guest_xml network_info=[{"id": "85f6598a-8c09-4f42-9eef-143573c095f9", "address": "fa:16:3e:8d:52:51", "network": {"id": "6c528f9c-4754-47e2-91db-2d70336b8dd7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-743033576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5501672b5066489aa61e9a9e26e9d5e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6598a-8c", "ovs_interfaceid": "85f6598a-8c09-4f42-9eef-143573c095f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:51:00 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:51:00 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:50:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1458212276',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1458212276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1458212',id=14,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESEkLHEoBdMzdSMb9XzikmlT5YXWY0X3x1v0kujqVArmmUir0E9dflLTURqNUt969HhmNERPMEYvmGUagoE1xhT0kZ8ZH+Lg6sor2h+dEnJln6ZPsmTXYVGeqtvl5mf5g==',key_name='tempest-keypair-1328848208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5501672b5066489aa61e9a9e26e9d5e2',ramdisk_id='',reservation_id='r-b59kriej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1346150636',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b064ac59001b4360b9818f486491616b',uuid=2acbda14-e4bc-49ac-81e2-ce28bc3878d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85f6598a-8c09-4f42-9eef-143573c095f9", "address": "fa:16:3e:8d:52:51", "network": {"id": "6c528f9c-4754-47e2-91db-2d70336b8dd7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-743033576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5501672b5066489aa61e9a9e26e9d5e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6598a-8c", "ovs_interfaceid": "85f6598a-8c09-4f42-9eef-143573c095f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Converting VIF {"id": "85f6598a-8c09-4f42-9eef-143573c095f9", "address": "fa:16:3e:8d:52:51", "network": {"id": "6c528f9c-4754-47e2-91db-2d70336b8dd7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-743033576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5501672b5066489aa61e9a9e26e9d5e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6598a-8c", "ovs_interfaceid": "85f6598a-8c09-4f42-9eef-143573c095f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:52:51,bridge_name='br-int',has_traffic_filtering=True,id=85f6598a-8c09-4f42-9eef-143573c095f9,network=Network(6c528f9c-4754-47e2-91db-2d70336b8dd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f6598a-8c') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.objects.instance [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lazy-loading 'pci_devices' on Instance uuid 2acbda14-e4bc-49ac-81e2-ce28bc3878d4 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:51:00 user nova-compute[75083]:   <uuid>2acbda14-e4bc-49ac-81e2-ce28bc3878d4</uuid>
Nov 29 05:51:00 user nova-compute[75083]:   <name>instance-0000000e</name>
Nov 29 05:51:00 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:51:00 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:51:00 user nova-compute[75083]:   <metadata>
Nov 29 05:51:00 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:51:00 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:51:00 user nova-compute[75083]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1458212276</nova:name>
Nov 29 05:51:00 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:51:00</nova:creationTime>
Nov 29 05:51:00 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:51:00 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:51:00 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:51:00 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:51:00 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:51:00 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:51:00 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:51:00 user nova-compute[75083]:       <nova:owner>
Nov 29 05:51:00 user nova-compute[75083]:         <nova:user uuid="b064ac59001b4360b9818f486491616b">tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member</nova:user>
Nov 29 05:51:00 user nova-compute[75083]:         <nova:project uuid="5501672b5066489aa61e9a9e26e9d5e2">tempest-TestServerVolumeAttachScenarioOldVersion-1346150636</nova:project>
Nov 29 05:51:00 user nova-compute[75083]:       </nova:owner>
Nov 29 05:51:00 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:51:00 user nova-compute[75083]:       <nova:ports>
Nov 29 05:51:00 user nova-compute[75083]:         <nova:port uuid="85f6598a-8c09-4f42-9eef-143573c095f9">
Nov 29 05:51:00 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 05:51:00 user nova-compute[75083]:         </nova:port>
Nov 29 05:51:00 user nova-compute[75083]:       </nova:ports>
Nov 29 05:51:00 user nova-compute[75083]:     </nova:instance>
Nov 29 05:51:00 user nova-compute[75083]:   </metadata>
Nov 29 05:51:00 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:51:00 user nova-compute[75083]:     <system>
Nov 29 05:51:00 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:51:00 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:51:00 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:51:00 user nova-compute[75083]:       <entry name="serial">2acbda14-e4bc-49ac-81e2-ce28bc3878d4</entry>
Nov 29 05:51:00 user nova-compute[75083]:       <entry name="uuid">2acbda14-e4bc-49ac-81e2-ce28bc3878d4</entry>
Nov 29 05:51:00 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:51:00 user nova-compute[75083]:     </system>
Nov 29 05:51:00 user nova-compute[75083]:   </sysinfo>
Nov 29 05:51:00 user nova-compute[75083]:   <os>
Nov 29 05:51:00 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:51:00 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:51:00 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:51:00 user nova-compute[75083]:   </os>
Nov 29 05:51:00 user nova-compute[75083]:   <features>
Nov 29 05:51:00 user nova-compute[75083]:     <acpi/>
Nov 29 05:51:00 user nova-compute[75083]:     <apic/>
Nov 29 05:51:00 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:51:00 user nova-compute[75083]:   </features>
Nov 29 05:51:00 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:51:00 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:51:00 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:51:00 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:51:00 user nova-compute[75083]:   </clock>
Nov 29 05:51:00 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:51:00 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:51:00 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:51:00 user nova-compute[75083]:   </cpu>
Nov 29 05:51:00 user nova-compute[75083]:   <devices>
Nov 29 05:51:00 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:51:00 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:51:00 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4/disk"/>
Nov 29 05:51:00 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:51:00 user nova-compute[75083]:     </disk>
Nov 29 05:51:00 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:51:00 user nova-compute[75083]:       <mac address="fa:16:3e:8d:52:51"/>
Nov 29 05:51:00 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:51:00 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:51:00 user nova-compute[75083]:       <target dev="tap85f6598a-8c"/>
Nov 29 05:51:00 user nova-compute[75083]:     </interface>
Nov 29 05:51:00 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:51:00 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4/console.log" append="off"/>
Nov 29 05:51:00 user nova-compute[75083]:     </serial>
Nov 29 05:51:00 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:51:00 user nova-compute[75083]:     <video>
Nov 29 05:51:00 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:51:00 user nova-compute[75083]:     </video>
Nov 29 05:51:00 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:51:00 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:51:00 user nova-compute[75083]:     </rng>
Nov 29 05:51:00 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:51:00 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:51:00 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:51:00 user nova-compute[75083]:     </memballoon>
Nov 29 05:51:00 user nova-compute[75083]:   </devices>
Nov 29 05:51:00 user nova-compute[75083]: </domain>
Nov 29 05:51:00 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:50:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1458212276',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1458212276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1458212',id=14,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESEkLHEoBdMzdSMb9XzikmlT5YXWY0X3x1v0kujqVArmmUir0E9dflLTURqNUt969HhmNERPMEYvmGUagoE1xhT0kZ8ZH+Lg6sor2h+dEnJln6ZPsmTXYVGeqtvl5mf5g==',key_name='tempest-keypair-1328848208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5501672b5066489aa61e9a9e26e9d5e2',ramdisk_id='',reservation_id='r-b59kriej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1346150636',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b064ac59001b4360b9818f486491616b',uuid=2acbda14-e4bc-49ac-81e2-ce28bc3878d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85f6598a-8c09-4f42-9eef-143573c095f9", "address": "fa:16:3e:8d:52:51", "network": {"id": "6c528f9c-4754-47e2-91db-2d70336b8dd7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-743033576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5501672b5066489aa61e9a9e26e9d5e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6598a-8c", "ovs_interfaceid": "85f6598a-8c09-4f42-9eef-143573c095f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Converting VIF {"id": "85f6598a-8c09-4f42-9eef-143573c095f9", "address": "fa:16:3e:8d:52:51", "network": {"id": "6c528f9c-4754-47e2-91db-2d70336b8dd7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-743033576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5501672b5066489aa61e9a9e26e9d5e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6598a-8c", "ovs_interfaceid": "85f6598a-8c09-4f42-9eef-143573c095f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:52:51,bridge_name='br-int',has_traffic_filtering=True,id=85f6598a-8c09-4f42-9eef-143573c095f9,network=Network(6c528f9c-4754-47e2-91db-2d70336b8dd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f6598a-8c') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG os_vif [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:52:51,bridge_name='br-int',has_traffic_filtering=True,id=85f6598a-8c09-4f42-9eef-143573c095f9,network=Network(6c528f9c-4754-47e2-91db-2d70336b8dd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f6598a-8c') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb4c8de8-d523-5244-bc3e-6481c360b83b', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85f6598a-8c, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85f6598a-8c, col_values=(('qos', UUID('43dc0d9f-4631-45c9-bab8-cb301b08eb55')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85f6598a-8c, col_values=(('external_ids', {'iface-id': '85f6598a-8c09-4f42-9eef-143573c095f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:52:51', 'vm-uuid': '2acbda14-e4bc-49ac-81e2-ce28bc3878d4'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:51:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:00 user nova-compute[75083]: INFO os_vif [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:52:51,bridge_name='br-int',has_traffic_filtering=True,id=85f6598a-8c09-4f42-9eef-143573c095f9,network=Network(6c528f9c-4754-47e2-91db-2d70336b8dd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f6598a-8c')
Nov 29 05:51:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:51:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] No VIF found with MAC fa:16:3e:8d:52:51, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:51:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:51:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:01 user nova-compute[75083]: DEBUG nova.network.neutron [req-ac8d5567-4dc0-4fe2-84de-82cf769d92b7 req-2761b456-d1e0-4501-ae00-bc0f00715b7b service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Updated VIF entry in instance network info cache for port 85f6598a-8c09-4f42-9eef-143573c095f9. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:51:01 user nova-compute[75083]: DEBUG nova.network.neutron [req-ac8d5567-4dc0-4fe2-84de-82cf769d92b7 req-2761b456-d1e0-4501-ae00-bc0f00715b7b service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Updating instance_info_cache with network_info: [{"id": "85f6598a-8c09-4f42-9eef-143573c095f9", "address": "fa:16:3e:8d:52:51", "network": {"id": "6c528f9c-4754-47e2-91db-2d70336b8dd7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-743033576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5501672b5066489aa61e9a9e26e9d5e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6598a-8c", "ovs_interfaceid": "85f6598a-8c09-4f42-9eef-143573c095f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:51:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ac8d5567-4dc0-4fe2-84de-82cf769d92b7 req-2761b456-d1e0-4501-ae00-bc0f00715b7b service nova] Releasing lock "refresh_cache-2acbda14-e4bc-49ac-81e2-ce28bc3878d4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:51:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:51:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:02 user nova-compute[75083]: DEBUG nova.compute.manager [req-bc209be8-12eb-4440-bb2c-9bc0c998a593 req-7a1de754-bd09-4271-a523-3f442fc4ba39 service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Received event network-vif-plugged-85f6598a-8c09-4f42-9eef-143573c095f9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:51:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bc209be8-12eb-4440-bb2c-9bc0c998a593 req-7a1de754-bd09-4271-a523-3f442fc4ba39 service nova] Acquiring lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bc209be8-12eb-4440-bb2c-9bc0c998a593 req-7a1de754-bd09-4271-a523-3f442fc4ba39 service nova] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bc209be8-12eb-4440-bb2c-9bc0c998a593 req-7a1de754-bd09-4271-a523-3f442fc4ba39 service nova] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:02 user nova-compute[75083]: DEBUG nova.compute.manager [req-bc209be8-12eb-4440-bb2c-9bc0c998a593 req-7a1de754-bd09-4271-a523-3f442fc4ba39 service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] No waiting events found dispatching network-vif-plugged-85f6598a-8c09-4f42-9eef-143573c095f9 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:51:02 user nova-compute[75083]: WARNING nova.compute.manager [req-bc209be8-12eb-4440-bb2c-9bc0c998a593 req-7a1de754-bd09-4271-a523-3f442fc4ba39 service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Received unexpected event network-vif-plugged-85f6598a-8c09-4f42-9eef-143573c095f9 for instance with vm_state building and task_state spawning.
Nov 29 05:51:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json" returned: 0 in 0.324s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:51:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk.rescue --force-share --output=json" returned: 0 in 0.385s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk.rescue --force-share --output=json" returned: 0 in 0.384s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.compute.manager [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.compute.manager [req-4405adde-badf-4c3d-b6e3-d5e3c2754b0f req-7f2ae584-4eed-4b7b-bb13-b84cbc31e6c0 service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Received event network-vif-plugged-85f6598a-8c09-4f42-9eef-143573c095f9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4405adde-badf-4c3d-b6e3-d5e3c2754b0f req-7f2ae584-4eed-4b7b-bb13-b84cbc31e6c0 service nova] Acquiring lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4405adde-badf-4c3d-b6e3-d5e3c2754b0f req-7f2ae584-4eed-4b7b-bb13-b84cbc31e6c0 service nova] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4405adde-badf-4c3d-b6e3-d5e3c2754b0f req-7f2ae584-4eed-4b7b-bb13-b84cbc31e6c0 service nova] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.compute.manager [req-4405adde-badf-4c3d-b6e3-d5e3c2754b0f req-7f2ae584-4eed-4b7b-bb13-b84cbc31e6c0 service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] No waiting events found dispatching network-vif-plugged-85f6598a-8c09-4f42-9eef-143573c095f9 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:51:05 user nova-compute[75083]: WARNING nova.compute.manager [req-4405adde-badf-4c3d-b6e3-d5e3c2754b0f req-7f2ae584-4eed-4b7b-bb13-b84cbc31e6c0 service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Received unexpected event network-vif-plugged-85f6598a-8c09-4f42-9eef-143573c095f9 for instance with vm_state building and task_state spawning.
Nov 29 05:51:05 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Instance spawned successfully.
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:51:05 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:51:05 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=7916MB free_disk=25.375064849853516GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:05 user nova-compute[75083]: INFO nova.compute.manager [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Took 7.16 seconds to spawn the instance on the hypervisor.
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.compute.manager [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance e6d49806-cecd-473a-b92f-9255868d35c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance ee1bba24-17d0-4fc3-8bff-1337d86cc9be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 161c6455-90ce-4c40-a33e-7f582989135d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b6d38a2c-a512-41f2-a7df-6a54058f8f8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 47437526-c4e4-4a15-ba9b-51bbae17c77b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 2acbda14-e4bc-49ac-81e2-ce28bc3878d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 05:51:05 user nova-compute[75083]: INFO nova.compute.manager [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Took 8.24 seconds to build instance.
Nov 29 05:51:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-496772ef-6379-4f06-993a-f77ca15360ff tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.445s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:06 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:51:06 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:51:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 05:51:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:07 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:51:07 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:51:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:15 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:51:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:16 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:51:16 user nova-compute[75083]: INFO nova.compute.claims [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Claim successful on node user
Nov 29 05:51:16 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:51:16 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:51:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:16 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:51:16 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:51:16 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:51:16 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:51:16 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:51:16 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:51:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:51:16 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Creating image(s)
Nov 29 05:51:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "/opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "/opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG nova.policy [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7f8a0e94feb47bb875ab4d7f1f2a2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41fbbebd414945beb2130f46013125d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.231s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.210s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk 1073741824" returned: 0 in 0.065s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.214s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Successfully created port: 388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Cannot resize image /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Ensure instance console log exists: /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:18 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Successfully updated port: 388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:51:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:51:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquired lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:51:18 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:51:18 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:51:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-422dffbc-07a6-422d-a3b6-6cc630337c41 req-bf8ce00c-6a50-4fc0-935c-dd15b6fbe2c4 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received event network-changed-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:51:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-422dffbc-07a6-422d-a3b6-6cc630337c41 req-bf8ce00c-6a50-4fc0-935c-dd15b6fbe2c4 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Refreshing instance network info cache due to event network-changed-388c9969-42dc-4e34-8fb8-c2399687751d. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:51:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-422dffbc-07a6-422d-a3b6-6cc630337c41 req-bf8ce00c-6a50-4fc0-935c-dd15b6fbe2c4 service nova] Acquiring lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Updating instance_info_cache with network_info: [{"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Releasing lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Instance network_info: |[{"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-422dffbc-07a6-422d-a3b6-6cc630337c41 req-bf8ce00c-6a50-4fc0-935c-dd15b6fbe2c4 service nova] Acquired lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.network.neutron [req-422dffbc-07a6-422d-a3b6-6cc630337c41 req-bf8ce00c-6a50-4fc0-935c-dd15b6fbe2c4 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Refreshing network info cache for port 388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Start _get_guest_xml network_info=[{"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:51:19 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:51:19 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:51:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1765064185',display_name='tempest-ServerActionsTestOtherB-server-1765064185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1765064185',id=15,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKfQt22BKdk3qqBMkdZDrlzUPc5OzBSJvBUhpD5lx0G7UqWh0HRdHS4+8i15ioAIjPFv14fiTBp00VBH9cOAzOvFWtO61YBHreoMNXT+V9qZ3bdKSP6OX3ggUHyDT/bOg==',key_name='tempest-keypair-1198752933',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41fbbebd414945beb2130f46013125d8',ramdisk_id='',reservation_id='r-349fa5rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1953829293',owner_user_name='tempest-ServerActionsTestOtherB-1953829293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:51:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7f8a0e94feb47bb875ab4d7f1f2a2a1',uuid=fb8244c4-f2a7-4ad8-a210-0f62c165a4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Converting VIF {"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.objects.instance [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lazy-loading 'pci_devices' on Instance uuid fb8244c4-f2a7-4ad8-a210-0f62c165a4dc {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:51:19 user nova-compute[75083]:   <uuid>fb8244c4-f2a7-4ad8-a210-0f62c165a4dc</uuid>
Nov 29 05:51:19 user nova-compute[75083]:   <name>instance-0000000f</name>
Nov 29 05:51:19 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:51:19 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:51:19 user nova-compute[75083]:   <metadata>
Nov 29 05:51:19 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:51:19 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:51:19 user nova-compute[75083]:       <nova:name>tempest-ServerActionsTestOtherB-server-1765064185</nova:name>
Nov 29 05:51:19 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:51:19</nova:creationTime>
Nov 29 05:51:19 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:51:19 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:51:19 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:51:19 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:51:19 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:51:19 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:51:19 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:51:19 user nova-compute[75083]:       <nova:owner>
Nov 29 05:51:19 user nova-compute[75083]:         <nova:user uuid="d7f8a0e94feb47bb875ab4d7f1f2a2a1">tempest-ServerActionsTestOtherB-1953829293-project-member</nova:user>
Nov 29 05:51:19 user nova-compute[75083]:         <nova:project uuid="41fbbebd414945beb2130f46013125d8">tempest-ServerActionsTestOtherB-1953829293</nova:project>
Nov 29 05:51:19 user nova-compute[75083]:       </nova:owner>
Nov 29 05:51:19 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:51:19 user nova-compute[75083]:       <nova:ports>
Nov 29 05:51:19 user nova-compute[75083]:         <nova:port uuid="388c9969-42dc-4e34-8fb8-c2399687751d">
Nov 29 05:51:19 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 05:51:19 user nova-compute[75083]:         </nova:port>
Nov 29 05:51:19 user nova-compute[75083]:       </nova:ports>
Nov 29 05:51:19 user nova-compute[75083]:     </nova:instance>
Nov 29 05:51:19 user nova-compute[75083]:   </metadata>
Nov 29 05:51:19 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:51:19 user nova-compute[75083]:     <system>
Nov 29 05:51:19 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:51:19 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:51:19 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:51:19 user nova-compute[75083]:       <entry name="serial">fb8244c4-f2a7-4ad8-a210-0f62c165a4dc</entry>
Nov 29 05:51:19 user nova-compute[75083]:       <entry name="uuid">fb8244c4-f2a7-4ad8-a210-0f62c165a4dc</entry>
Nov 29 05:51:19 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:51:19 user nova-compute[75083]:     </system>
Nov 29 05:51:19 user nova-compute[75083]:   </sysinfo>
Nov 29 05:51:19 user nova-compute[75083]:   <os>
Nov 29 05:51:19 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:51:19 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:51:19 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:51:19 user nova-compute[75083]:   </os>
Nov 29 05:51:19 user nova-compute[75083]:   <features>
Nov 29 05:51:19 user nova-compute[75083]:     <acpi/>
Nov 29 05:51:19 user nova-compute[75083]:     <apic/>
Nov 29 05:51:19 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:51:19 user nova-compute[75083]:   </features>
Nov 29 05:51:19 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:51:19 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:51:19 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:51:19 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:51:19 user nova-compute[75083]:   </clock>
Nov 29 05:51:19 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:51:19 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:51:19 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:51:19 user nova-compute[75083]:   </cpu>
Nov 29 05:51:19 user nova-compute[75083]:   <devices>
Nov 29 05:51:19 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:51:19 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:51:19 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk"/>
Nov 29 05:51:19 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:51:19 user nova-compute[75083]:     </disk>
Nov 29 05:51:19 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:51:19 user nova-compute[75083]:       <mac address="fa:16:3e:8c:af:fc"/>
Nov 29 05:51:19 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:51:19 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:51:19 user nova-compute[75083]:       <target dev="tap388c9969-42"/>
Nov 29 05:51:19 user nova-compute[75083]:     </interface>
Nov 29 05:51:19 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:51:19 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/console.log" append="off"/>
Nov 29 05:51:19 user nova-compute[75083]:     </serial>
Nov 29 05:51:19 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:51:19 user nova-compute[75083]:     <video>
Nov 29 05:51:19 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:51:19 user nova-compute[75083]:     </video>
Nov 29 05:51:19 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:51:19 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:51:19 user nova-compute[75083]:     </rng>
Nov 29 05:51:19 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:51:19 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:51:19 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:51:19 user nova-compute[75083]:     </memballoon>
Nov 29 05:51:19 user nova-compute[75083]:   </devices>
Nov 29 05:51:19 user nova-compute[75083]: </domain>
Nov 29 05:51:19 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:51:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1765064185',display_name='tempest-ServerActionsTestOtherB-server-1765064185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1765064185',id=15,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKfQt22BKdk3qqBMkdZDrlzUPc5OzBSJvBUhpD5lx0G7UqWh0HRdHS4+8i15ioAIjPFv14fiTBp00VBH9cOAzOvFWtO61YBHreoMNXT+V9qZ3bdKSP6OX3ggUHyDT/bOg==',key_name='tempest-keypair-1198752933',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41fbbebd414945beb2130f46013125d8',ramdisk_id='',reservation_id='r-349fa5rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1953829293',owner_user_name='tempest-ServerActionsTestOtherB-1953829293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:51:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7f8a0e94feb47bb875ab4d7f1f2a2a1',uuid=fb8244c4-f2a7-4ad8-a210-0f62c165a4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Converting VIF {"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG os_vif [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ac88727-4ed1-5098-9195-9904c3eebfcc', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap388c9969-42, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap388c9969-42, col_values=(('qos', UUID('2fd56f51-d04f-4db6-80fb-234d17840c54')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap388c9969-42, col_values=(('external_ids', {'iface-id': '388c9969-42dc-4e34-8fb8-c2399687751d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:af:fc', 'vm-uuid': 'fb8244c4-f2a7-4ad8-a210-0f62c165a4dc'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:19 user nova-compute[75083]: INFO os_vif [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42')
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] No VIF found with MAC fa:16:3e:8c:af:fc, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.network.neutron [req-422dffbc-07a6-422d-a3b6-6cc630337c41 req-bf8ce00c-6a50-4fc0-935c-dd15b6fbe2c4 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Updated VIF entry in instance network info cache for port 388c9969-42dc-4e34-8fb8-c2399687751d. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG nova.network.neutron [req-422dffbc-07a6-422d-a3b6-6cc630337c41 req-bf8ce00c-6a50-4fc0-935c-dd15b6fbe2c4 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Updating instance_info_cache with network_info: [{"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:51:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-422dffbc-07a6-422d-a3b6-6cc630337c41 req-bf8ce00c-6a50-4fc0-935c-dd15b6fbe2c4 service nova] Releasing lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:51:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:21 user nova-compute[75083]: DEBUG nova.compute.manager [req-627b3cf2-9ef6-4e7b-becc-1f4fa331308b req-2e4cf1e8-7691-45ed-880d-3f46455ae1bb service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received event network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:51:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-627b3cf2-9ef6-4e7b-becc-1f4fa331308b req-2e4cf1e8-7691-45ed-880d-3f46455ae1bb service nova] Acquiring lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-627b3cf2-9ef6-4e7b-becc-1f4fa331308b req-2e4cf1e8-7691-45ed-880d-3f46455ae1bb service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-627b3cf2-9ef6-4e7b-becc-1f4fa331308b req-2e4cf1e8-7691-45ed-880d-3f46455ae1bb service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:21 user nova-compute[75083]: DEBUG nova.compute.manager [req-627b3cf2-9ef6-4e7b-becc-1f4fa331308b req-2e4cf1e8-7691-45ed-880d-3f46455ae1bb service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] No waiting events found dispatching network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:51:21 user nova-compute[75083]: WARNING nova.compute.manager [req-627b3cf2-9ef6-4e7b-becc-1f4fa331308b req-2e4cf1e8-7691-45ed-880d-3f46455ae1bb service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received unexpected event network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d for instance with vm_state building and task_state spawning.
Nov 29 05:51:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-6b659ab8-f30a-4b37-84d5-1fb151a6d6a3 req-e5d6e7d1-8f23-404a-865f-d76895521ac6 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received event network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:51:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6b659ab8-f30a-4b37-84d5-1fb151a6d6a3 req-e5d6e7d1-8f23-404a-865f-d76895521ac6 service nova] Acquiring lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6b659ab8-f30a-4b37-84d5-1fb151a6d6a3 req-e5d6e7d1-8f23-404a-865f-d76895521ac6 service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6b659ab8-f30a-4b37-84d5-1fb151a6d6a3 req-e5d6e7d1-8f23-404a-865f-d76895521ac6 service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-6b659ab8-f30a-4b37-84d5-1fb151a6d6a3 req-e5d6e7d1-8f23-404a-865f-d76895521ac6 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] No waiting events found dispatching network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:51:23 user nova-compute[75083]: WARNING nova.compute.manager [req-6b659ab8-f30a-4b37-84d5-1fb151a6d6a3 req-e5d6e7d1-8f23-404a-865f-d76895521ac6 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received unexpected event network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d for instance with vm_state building and task_state spawning.
Nov 29 05:51:23 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:51:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:51:23 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Instance spawned successfully.
Nov 29 05:51:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:51:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:51:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:51:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:51:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:51:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:51:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:51:23 user nova-compute[75083]: INFO nova.compute.manager [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Took 6.85 seconds to spawn the instance on the hypervisor.
Nov 29 05:51:23 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:51:23 user nova-compute[75083]: INFO nova.compute.manager [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Took 7.73 seconds to build instance.
Nov 29 05:51:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ebd9eb25-f3fd-491d-8de6-e9dba11088f7 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.833s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Acquiring lock "7c693239-226b-42b1-928e-9a8b7a2a114c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:31 user nova-compute[75083]: DEBUG nova.compute.manager [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:51:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:31 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:51:31 user nova-compute[75083]: INFO nova.compute.claims [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Claim successful on node user
Nov 29 05:51:31 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:51:31 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:51:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:31 user nova-compute[75083]: DEBUG nova.compute.manager [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:51:31 user nova-compute[75083]: DEBUG nova.compute.manager [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:51:31 user nova-compute[75083]: DEBUG nova.network.neutron [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:51:31 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:51:31 user nova-compute[75083]: DEBUG nova.compute.manager [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:51:31 user nova-compute[75083]: INFO nova.virt.block_device [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Booting with volume 74a643c4-1330-47fc-9deb-fe33aa3bd043 at /dev/vda
Nov 29 05:51:31 user nova-compute[75083]: DEBUG nova.policy [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49154159b8244161981fb442e2014067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8356c76a38d4b798fbc756795fab89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:51:31 user nova-compute[75083]: DEBUG os_brick.utils [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:51:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:31 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9abaad-4f8e-4ee2-984e-da04e24ca667]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[679609d6-2250-4314-8018-d6e9e884c60b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72c0c23-1850-4faf-b213-61ed0a52cc69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d49e34c-ff9c-4ab2-8b62-de33b9e572de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:51:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:51:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:51:32 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:51:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce01c640-0b18-45e3-8477-b7d934520ec8]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:51:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:51:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:51:32 user nova-compute[75083]: DEBUG os_brick.utils [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:51:32 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Updating existing volume attachment record: 2ec4b1cf-7a74-498a-a239-b61305200e07 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:51:32 user nova-compute[75083]: DEBUG nova.network.neutron [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Successfully created port: 5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:51:33 user nova-compute[75083]: DEBUG nova.network.neutron [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Successfully updated port: 5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:51:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Acquiring lock "refresh_cache-7c693239-226b-42b1-928e-9a8b7a2a114c" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:51:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Acquired lock "refresh_cache-7c693239-226b-42b1-928e-9a8b7a2a114c" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:51:33 user nova-compute[75083]: DEBUG nova.network.neutron [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:51:33 user nova-compute[75083]: DEBUG nova.compute.manager [req-1cf73ebf-2bbb-4612-bafc-16d50d2f6eaf req-5034ac11-4fa0-4aee-9877-11b05e09e4b4 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Received event network-changed-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:51:33 user nova-compute[75083]: DEBUG nova.compute.manager [req-1cf73ebf-2bbb-4612-bafc-16d50d2f6eaf req-5034ac11-4fa0-4aee-9877-11b05e09e4b4 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Refreshing instance network info cache due to event network-changed-5581c9a9-ec9e-49f5-b9bb-8e2112b54377. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:51:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-1cf73ebf-2bbb-4612-bafc-16d50d2f6eaf req-5034ac11-4fa0-4aee-9877-11b05e09e4b4 service nova] Acquiring lock "refresh_cache-7c693239-226b-42b1-928e-9a8b7a2a114c" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:51:33 user nova-compute[75083]: DEBUG nova.network.neutron [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:51:33 user nova-compute[75083]: DEBUG nova.network.neutron [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Updating instance_info_cache with network_info: [{"id": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "address": "fa:16:3e:02:29:04", "network": {"id": "338c6d36-9867-4d30-b8b9-5209dd6ae7dc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1555128941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8356c76a38d4b798fbc756795fab89b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5581c9a9-ec", "ovs_interfaceid": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:51:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Releasing lock "refresh_cache-7c693239-226b-42b1-928e-9a8b7a2a114c" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:51:33 user nova-compute[75083]: DEBUG nova.compute.manager [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Instance network_info: |[{"id": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "address": "fa:16:3e:02:29:04", "network": {"id": "338c6d36-9867-4d30-b8b9-5209dd6ae7dc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1555128941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8356c76a38d4b798fbc756795fab89b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5581c9a9-ec", "ovs_interfaceid": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:51:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-1cf73ebf-2bbb-4612-bafc-16d50d2f6eaf req-5034ac11-4fa0-4aee-9877-11b05e09e4b4 service nova] Acquired lock "refresh_cache-7c693239-226b-42b1-928e-9a8b7a2a114c" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:51:33 user nova-compute[75083]: DEBUG nova.network.neutron [req-1cf73ebf-2bbb-4612-bafc-16d50d2f6eaf req-5034ac11-4fa0-4aee-9877-11b05e09e4b4 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Refreshing network info cache for port 5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:51:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:34 user nova-compute[75083]: DEBUG nova.network.neutron [req-1cf73ebf-2bbb-4612-bafc-16d50d2f6eaf req-5034ac11-4fa0-4aee-9877-11b05e09e4b4 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Updated VIF entry in instance network info cache for port 5581c9a9-ec9e-49f5-b9bb-8e2112b54377. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:51:34 user nova-compute[75083]: DEBUG nova.network.neutron [req-1cf73ebf-2bbb-4612-bafc-16d50d2f6eaf req-5034ac11-4fa0-4aee-9877-11b05e09e4b4 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Updating instance_info_cache with network_info: [{"id": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "address": "fa:16:3e:02:29:04", "network": {"id": "338c6d36-9867-4d30-b8b9-5209dd6ae7dc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1555128941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8356c76a38d4b798fbc756795fab89b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5581c9a9-ec", "ovs_interfaceid": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:51:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-1cf73ebf-2bbb-4612-bafc-16d50d2f6eaf req-5034ac11-4fa0-4aee-9877-11b05e09e4b4 service nova] Releasing lock "refresh_cache-7c693239-226b-42b1-928e-9a8b7a2a114c" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:51:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.compute.manager [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:51:40 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Creating image(s)
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Did not create local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Ensure instance console log exists: /opt/stack/data/nova/instances/7c693239-226b-42b1-928e-9a8b7a2a114c/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Start _get_guest_xml network_info=[{"id": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "address": "fa:16:3e:02:29:04", "network": {"id": "338c6d36-9867-4d30-b8b9-5209dd6ae7dc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1555128941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8356c76a38d4b798fbc756795fab89b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5581c9a9-ec", "ovs_interfaceid": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '2ec4b1cf-7a74-498a-a239-b61305200e07', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnuPAXgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c693239-226b-42b1-928e-9a8b7a2a114c', 'attached_at': '', 'detached_at': '', 'volume_id': '74a643c4-1330-47fc-9deb-fe33aa3bd043', 'serial': '74a643c4-1330-47fc-9deb-fe33aa3bd043'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:51:40 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:51:40 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnuPAXgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:51:40 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:51:40 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:51:40 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[df92a2c2-3163-4007-a402-2a5d63b58a78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:51:40 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46019b4-140c-480f-8ee8-12158a6adc0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043] added
Nov 29 05:51:40 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6edb72-ea84-4bdf-aad1-31a2e5fa2399]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b52bf6-6c3d-423f-8998-2f604c63ef0a]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BnuPAXgE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BnuPAXgE" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cb7750-c5fe-4ac3-9559-02b84e8b1e34]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BnuPAXgE'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8a3cf8-3013-4fa6-8894-ec3486037190]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4045e373-d08b-4b39-9c38-6b262466e1f6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:51:40 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:51:40 user nova-compute[75083]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)
Nov 29 05:51:40 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:51:40 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:51:40 user nova-compute[75083]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)
Nov 29 05:51:40 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d1bfa4-0033-4eb9-9b31-6894fb97f0cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043, portal: 172.16.0.220,3260]
Nov 29 05:51:40 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043, portal: 172.16.0.220,3260] successful.
Nov 29 05:51:40 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d05161c-a63c-4149-b825-9263c4084442]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f17b67-1be9-4f80-b45f-36c43deb5c84]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:51:40 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:51:40 user nova-compute[75083]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)
Nov 29 05:51:40 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:51:40 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:51:40 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:51:40 user nova-compute[75083]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)
Nov 29 05:51:40 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:51:40 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d8ef3a-82e9-4ad8-aede-8dc0c65d6a42]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:51:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnuPAXgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23161383539333162', 'path': '/dev/sde'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161383539333162', 'path': '/dev/sde'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1923190517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1923190517',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVqlBFSwsVSd5Vcbhdct55aXuVEeazXqKnt3H0YMw0ee5MXXhI16+ZwPyHVIMGfFxjyzswiZlnB6srSTk54bx0+gEyQjqkJlEeRzN4KuV8BBahtwESFhSg9w8kgSjIeaQ==',key_name='tempest-keypair-718905469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8356c76a38d4b798fbc756795fab89b',ramdisk_id='',reservation_id='r-zu96bv1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-226818069',owner_user_name='tempest-ServerActionsV293TestJSON-226818069-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:51:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49154159b8244161981fb442e2014067',uuid=7c693239-226b-42b1-928e-9a8b7a2a114c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "address": "fa:16:3e:02:29:04", "network": {"id": "338c6d36-9867-4d30-b8b9-5209dd6ae7dc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1555128941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8356c76a38d4b798fbc756795fab89b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5581c9a9-ec", "ovs_interfaceid": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Converting VIF {"id": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "address": "fa:16:3e:02:29:04", "network": {"id": "338c6d36-9867-4d30-b8b9-5209dd6ae7dc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1555128941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8356c76a38d4b798fbc756795fab89b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5581c9a9-ec", "ovs_interfaceid": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:29:04,bridge_name='br-int',has_traffic_filtering=True,id=5581c9a9-ec9e-49f5-b9bb-8e2112b54377,network=Network(338c6d36-9867-4d30-b8b9-5209dd6ae7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5581c9a9-ec') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG nova.objects.instance [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c693239-226b-42b1-928e-9a8b7a2a114c {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:51:42 user nova-compute[75083]:   <uuid>7c693239-226b-42b1-928e-9a8b7a2a114c</uuid>
Nov 29 05:51:42 user nova-compute[75083]:   <name>instance-00000010</name>
Nov 29 05:51:42 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:51:42 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:51:42 user nova-compute[75083]:   <metadata>
Nov 29 05:51:42 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:51:42 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:51:42 user nova-compute[75083]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1923190517</nova:name>
Nov 29 05:51:42 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:51:40</nova:creationTime>
Nov 29 05:51:42 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:51:42 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:51:42 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:51:42 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:51:42 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:51:42 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:51:42 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:51:42 user nova-compute[75083]:       <nova:owner>
Nov 29 05:51:42 user nova-compute[75083]:         <nova:user uuid="49154159b8244161981fb442e2014067">tempest-ServerActionsV293TestJSON-226818069-project-member</nova:user>
Nov 29 05:51:42 user nova-compute[75083]:         <nova:project uuid="c8356c76a38d4b798fbc756795fab89b">tempest-ServerActionsV293TestJSON-226818069</nova:project>
Nov 29 05:51:42 user nova-compute[75083]:       </nova:owner>
Nov 29 05:51:42 user nova-compute[75083]:       <nova:ports>
Nov 29 05:51:42 user nova-compute[75083]:         <nova:port uuid="5581c9a9-ec9e-49f5-b9bb-8e2112b54377">
Nov 29 05:51:42 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 05:51:42 user nova-compute[75083]:         </nova:port>
Nov 29 05:51:42 user nova-compute[75083]:       </nova:ports>
Nov 29 05:51:42 user nova-compute[75083]:     </nova:instance>
Nov 29 05:51:42 user nova-compute[75083]:   </metadata>
Nov 29 05:51:42 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:51:42 user nova-compute[75083]:     <system>
Nov 29 05:51:42 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:51:42 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:51:42 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:51:42 user nova-compute[75083]:       <entry name="serial">7c693239-226b-42b1-928e-9a8b7a2a114c</entry>
Nov 29 05:51:42 user nova-compute[75083]:       <entry name="uuid">7c693239-226b-42b1-928e-9a8b7a2a114c</entry>
Nov 29 05:51:42 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:51:42 user nova-compute[75083]:     </system>
Nov 29 05:51:42 user nova-compute[75083]:   </sysinfo>
Nov 29 05:51:42 user nova-compute[75083]:   <os>
Nov 29 05:51:42 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:51:42 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:51:42 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:51:42 user nova-compute[75083]:   </os>
Nov 29 05:51:42 user nova-compute[75083]:   <features>
Nov 29 05:51:42 user nova-compute[75083]:     <acpi/>
Nov 29 05:51:42 user nova-compute[75083]:     <apic/>
Nov 29 05:51:42 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:51:42 user nova-compute[75083]:   </features>
Nov 29 05:51:42 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:51:42 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:51:42 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:51:42 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:51:42 user nova-compute[75083]:   </clock>
Nov 29 05:51:42 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:51:42 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:51:42 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:51:42 user nova-compute[75083]:   </cpu>
Nov 29 05:51:42 user nova-compute[75083]:   <devices>
Nov 29 05:51:42 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 05:51:42 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:51:42 user nova-compute[75083]:       <source dev="/dev/sde"/>
Nov 29 05:51:42 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:51:42 user nova-compute[75083]:       <serial>74a643c4-1330-47fc-9deb-fe33aa3bd043</serial>
Nov 29 05:51:42 user nova-compute[75083]:     </disk>
Nov 29 05:51:42 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:51:42 user nova-compute[75083]:       <mac address="fa:16:3e:02:29:04"/>
Nov 29 05:51:42 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:51:42 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:51:42 user nova-compute[75083]:       <target dev="tap5581c9a9-ec"/>
Nov 29 05:51:42 user nova-compute[75083]:     </interface>
Nov 29 05:51:42 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:51:42 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/7c693239-226b-42b1-928e-9a8b7a2a114c/console.log" append="off"/>
Nov 29 05:51:42 user nova-compute[75083]:     </serial>
Nov 29 05:51:42 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:51:42 user nova-compute[75083]:     <video>
Nov 29 05:51:42 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:51:42 user nova-compute[75083]:     </video>
Nov 29 05:51:42 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:51:42 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:51:42 user nova-compute[75083]:     </rng>
Nov 29 05:51:42 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:51:42 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:51:42 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:51:42 user nova-compute[75083]:     </memballoon>
Nov 29 05:51:42 user nova-compute[75083]:   </devices>
Nov 29 05:51:42 user nova-compute[75083]: </domain>
Nov 29 05:51:42 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1923190517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1923190517',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVqlBFSwsVSd5Vcbhdct55aXuVEeazXqKnt3H0YMw0ee5MXXhI16+ZwPyHVIMGfFxjyzswiZlnB6srSTk54bx0+gEyQjqkJlEeRzN4KuV8BBahtwESFhSg9w8kgSjIeaQ==',key_name='tempest-keypair-718905469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8356c76a38d4b798fbc756795fab89b',ramdisk_id='',reservation_id='r-zu96bv1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-226818069',owner_user_name='tempest-ServerActionsV293TestJSON-226818069-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:51:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49154159b8244161981fb442e2014067',uuid=7c693239-226b-42b1-928e-9a8b7a2a114c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "address": "fa:16:3e:02:29:04", "network": {"id": "338c6d36-9867-4d30-b8b9-5209dd6ae7dc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1555128941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8356c76a38d4b798fbc756795fab89b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5581c9a9-ec", "ovs_interfaceid": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Converting VIF {"id": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "address": "fa:16:3e:02:29:04", "network": {"id": "338c6d36-9867-4d30-b8b9-5209dd6ae7dc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1555128941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8356c76a38d4b798fbc756795fab89b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5581c9a9-ec", "ovs_interfaceid": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:29:04,bridge_name='br-int',has_traffic_filtering=True,id=5581c9a9-ec9e-49f5-b9bb-8e2112b54377,network=Network(338c6d36-9867-4d30-b8b9-5209dd6ae7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5581c9a9-ec') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG os_vif [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:29:04,bridge_name='br-int',has_traffic_filtering=True,id=5581c9a9-ec9e-49f5-b9bb-8e2112b54377,network=Network(338c6d36-9867-4d30-b8b9-5209dd6ae7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5581c9a9-ec') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94b3f938-017d-5fc7-85ff-543b3f290008', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5581c9a9-ec, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5581c9a9-ec, col_values=(('qos', UUID('5285c664-76d5-4d3b-a340-d2339f022401')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5581c9a9-ec, col_values=(('external_ids', {'iface-id': '5581c9a9-ec9e-49f5-b9bb-8e2112b54377', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:29:04', 'vm-uuid': '7c693239-226b-42b1-928e-9a8b7a2a114c'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:42 user nova-compute[75083]: INFO os_vif [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:29:04,bridge_name='br-int',has_traffic_filtering=True,id=5581c9a9-ec9e-49f5-b9bb-8e2112b54377,network=Network(338c6d36-9867-4d30-b8b9-5209dd6ae7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5581c9a9-ec')
Nov 29 05:51:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:51:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] No VIF found with MAC fa:16:3e:02:29:04, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:51:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-ed24ce2b-f2d9-4fc4-b9c5-0a7fd9ac4060 req-93a4e1a7-da20-4e8a-98f3-024d358c11a3 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Received event network-vif-plugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:51:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ed24ce2b-f2d9-4fc4-b9c5-0a7fd9ac4060 req-93a4e1a7-da20-4e8a-98f3-024d358c11a3 service nova] Acquiring lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ed24ce2b-f2d9-4fc4-b9c5-0a7fd9ac4060 req-93a4e1a7-da20-4e8a-98f3-024d358c11a3 service nova] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ed24ce2b-f2d9-4fc4-b9c5-0a7fd9ac4060 req-93a4e1a7-da20-4e8a-98f3-024d358c11a3 service nova] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-ed24ce2b-f2d9-4fc4-b9c5-0a7fd9ac4060 req-93a4e1a7-da20-4e8a-98f3-024d358c11a3 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] No waiting events found dispatching network-vif-plugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:51:43 user nova-compute[75083]: WARNING nova.compute.manager [req-ed24ce2b-f2d9-4fc4-b9c5-0a7fd9ac4060 req-93a4e1a7-da20-4e8a-98f3-024d358c11a3 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Received unexpected event network-vif-plugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 for instance with vm_state building and task_state spawning.
Nov 29 05:51:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:51:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:51:45 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Instance spawned successfully.
Nov 29 05:51:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:51:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:51:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:51:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:51:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:51:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:51:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:51:45 user nova-compute[75083]: INFO nova.compute.manager [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Took 5.06 seconds to spawn the instance on the hypervisor.
Nov 29 05:51:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:51:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-89ef1a5d-4693-4b07-83cc-eff364540f9f req-dd03b878-3cbc-44ef-8f20-579eb074d8a2 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Received event network-vif-plugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:51:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-89ef1a5d-4693-4b07-83cc-eff364540f9f req-dd03b878-3cbc-44ef-8f20-579eb074d8a2 service nova] Acquiring lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-89ef1a5d-4693-4b07-83cc-eff364540f9f req-dd03b878-3cbc-44ef-8f20-579eb074d8a2 service nova] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-89ef1a5d-4693-4b07-83cc-eff364540f9f req-dd03b878-3cbc-44ef-8f20-579eb074d8a2 service nova] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-89ef1a5d-4693-4b07-83cc-eff364540f9f req-dd03b878-3cbc-44ef-8f20-579eb074d8a2 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] No waiting events found dispatching network-vif-plugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:51:45 user nova-compute[75083]: WARNING nova.compute.manager [req-89ef1a5d-4693-4b07-83cc-eff364540f9f req-dd03b878-3cbc-44ef-8f20-579eb074d8a2 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Received unexpected event network-vif-plugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 for instance with vm_state building and task_state spawning.
Nov 29 05:51:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:45 user nova-compute[75083]: INFO nova.compute.manager [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Took 14.45 seconds to build instance.
Nov 29 05:51:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0eb81875-f188-4afb-b0a1-8d5e736fa675 tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.573s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquiring lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:47 user nova-compute[75083]: DEBUG nova.compute.manager [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:51:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:51:47 user nova-compute[75083]: INFO nova.compute.claims [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Claim successful on node user
Nov 29 05:51:48 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.586s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG nova.compute.manager [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG nova.compute.manager [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG nova.network.neutron [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:51:48 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:51:48 user nova-compute[75083]: DEBUG nova.compute.manager [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG nova.policy [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4fd22380d304dac9cc3db3ad3c971d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385f39574be145b6b47e5a7dddf9415e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:51:48 user nova-compute[75083]: INFO nova.virt.block_device [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Booting with volume 637c2fd0-db61-4184-8eee-be13661c3256 at /dev/vda
Nov 29 05:51:48 user nova-compute[75083]: DEBUG os_brick.utils [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f064943c-cbbc-4904-8889-95ac90e48b9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3aff927-41ea-4d2b-bd7c-4fee20598aa6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b8bfeb-22a1-42a6-9042-59ad581516f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[37399213-5e35-49aa-9d74-91414144fe8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:51:48 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:51:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[388a2a69-f162-4e05-8a84-0a6a3e6474d6]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG os_brick.utils [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:51:48 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Updating existing volume attachment record: 853f5523-1776-4740-a966-b488b5ebb9dc {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:51:49 user nova-compute[75083]: DEBUG nova.network.neutron [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Successfully created port: df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:51:49 user nova-compute[75083]: DEBUG nova.network.neutron [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Successfully updated port: df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:51:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquiring lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:51:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquired lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:51:49 user nova-compute[75083]: DEBUG nova.network.neutron [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:51:49 user nova-compute[75083]: DEBUG nova.compute.manager [req-4a56d7fe-8035-4162-a627-804a20d83c39 req-7393b33f-abae-452c-bbc3-7c6a94ff7592 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received event network-changed-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:51:49 user nova-compute[75083]: DEBUG nova.compute.manager [req-4a56d7fe-8035-4162-a627-804a20d83c39 req-7393b33f-abae-452c-bbc3-7c6a94ff7592 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Refreshing instance network info cache due to event network-changed-df73cb37-8475-4c21-89c7-b02949297b63. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:51:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4a56d7fe-8035-4162-a627-804a20d83c39 req-7393b33f-abae-452c-bbc3-7c6a94ff7592 service nova] Acquiring lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:51:49 user nova-compute[75083]: DEBUG nova.network.neutron [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:51:50 user nova-compute[75083]: DEBUG nova.network.neutron [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Updating instance_info_cache with network_info: [{"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:51:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Releasing lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:51:50 user nova-compute[75083]: DEBUG nova.compute.manager [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Instance network_info: |[{"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:51:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4a56d7fe-8035-4162-a627-804a20d83c39 req-7393b33f-abae-452c-bbc3-7c6a94ff7592 service nova] Acquired lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:51:50 user nova-compute[75083]: DEBUG nova.network.neutron [req-4a56d7fe-8035-4162-a627-804a20d83c39 req-7393b33f-abae-452c-bbc3-7c6a94ff7592 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Refreshing network info cache for port df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:51:50 user nova-compute[75083]: DEBUG nova.network.neutron [req-4a56d7fe-8035-4162-a627-804a20d83c39 req-7393b33f-abae-452c-bbc3-7c6a94ff7592 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Updated VIF entry in instance network info cache for port df73cb37-8475-4c21-89c7-b02949297b63. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:51:50 user nova-compute[75083]: DEBUG nova.network.neutron [req-4a56d7fe-8035-4162-a627-804a20d83c39 req-7393b33f-abae-452c-bbc3-7c6a94ff7592 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Updating instance_info_cache with network_info: [{"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:51:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4a56d7fe-8035-4162-a627-804a20d83c39 req-7393b33f-abae-452c-bbc3-7c6a94ff7592 service nova] Releasing lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:51:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:52 user nova-compute[75083]: DEBUG nova.compute.manager [req-3c42bfef-ca2e-4a52-81a4-4b937874dda2 req-148cfd6f-b0f4-4d6a-b68e-80fc88668a9e service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Received event network-changed-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:51:52 user nova-compute[75083]: DEBUG nova.compute.manager [req-3c42bfef-ca2e-4a52-81a4-4b937874dda2 req-148cfd6f-b0f4-4d6a-b68e-80fc88668a9e service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Refreshing instance network info cache due to event network-changed-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:51:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3c42bfef-ca2e-4a52-81a4-4b937874dda2 req-148cfd6f-b0f4-4d6a-b68e-80fc88668a9e service nova] Acquiring lock "refresh_cache-b6d38a2c-a512-41f2-a7df-6a54058f8f8b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:51:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3c42bfef-ca2e-4a52-81a4-4b937874dda2 req-148cfd6f-b0f4-4d6a-b68e-80fc88668a9e service nova] Acquired lock "refresh_cache-b6d38a2c-a512-41f2-a7df-6a54058f8f8b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:51:52 user nova-compute[75083]: DEBUG nova.network.neutron [req-3c42bfef-ca2e-4a52-81a4-4b937874dda2 req-148cfd6f-b0f4-4d6a-b68e-80fc88668a9e service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Refreshing network info cache for port cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:51:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "47437526-c4e4-4a15-ba9b-51bbae17c77b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:53 user nova-compute[75083]: INFO nova.compute.manager [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Detaching volume af19f30c-72b8-4314-8bd3-1ca696377611
Nov 29 05:51:53 user nova-compute[75083]: INFO nova.virt.block_device [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Attempting to driver detach volume af19f30c-72b8-4314-8bd3-1ca696377611 from mountpoint /dev/vdc
Nov 29 05:51:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Attempting to detach device vdc from instance 47437526-c4e4-4a15-ba9b-51bbae17c77b from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:51:53 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:51:53 user nova-compute[75083]:   <source dev="/dev/sdd"/>
Nov 29 05:51:53 user nova-compute[75083]:   <target dev="vdc" bus="virtio"/>
Nov 29 05:51:53 user nova-compute[75083]:   <serial>af19f30c-72b8-4314-8bd3-1ca696377611</serial>
Nov 29 05:51:53 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 05:51:53 user nova-compute[75083]: </disk>
Nov 29 05:51:53 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:51:53 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Successfully detached device vdc from instance 47437526-c4e4-4a15-ba9b-51bbae17c77b from the persistent domain config.
Nov 29 05:51:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 47437526-c4e4-4a15-ba9b-51bbae17c77b from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:51:53 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:51:53 user nova-compute[75083]:   <source dev="/dev/sdd"/>
Nov 29 05:51:53 user nova-compute[75083]:   <target dev="vdc" bus="virtio"/>
Nov 29 05:51:53 user nova-compute[75083]:   <serial>af19f30c-72b8-4314-8bd3-1ca696377611</serial>
Nov 29 05:51:53 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 05:51:53 user nova-compute[75083]: </disk>
Nov 29 05:51:53 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG nova.objects.instance [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lazy-loading 'flavor' on Instance uuid b6d38a2c-a512-41f2-a7df-6a54058f8f8b {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:53 user nova-compute[75083]: INFO nova.compute.manager [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Attaching volume d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 to /dev/vdb
Nov 29 05:51:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 47437526-c4e4-4a15-ba9b-51bbae17c77b {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG nova.network.neutron [req-3c42bfef-ca2e-4a52-81a4-4b937874dda2 req-148cfd6f-b0f4-4d6a-b68e-80fc88668a9e service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Updated VIF entry in instance network info cache for port cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG nova.network.neutron [req-3c42bfef-ca2e-4a52-81a4-4b937874dda2 req-148cfd6f-b0f4-4d6a-b68e-80fc88668a9e service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Updating instance_info_cache with network_info: [{"id": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "address": "fa:16:3e:f6:1e:5c", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf04f87a-6d", "ovs_interfaceid": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3c42bfef-ca2e-4a52-81a4-4b937874dda2 req-148cfd6f-b0f4-4d6a-b68e-80fc88668a9e service nova] Releasing lock "refresh_cache-b6d38a2c-a512-41f2-a7df-6a54058f8f8b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG os_brick.utils [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7808c10f-c4d7-4a62-be8f-ca037ed414d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0965b8eb-e9b9-418c-ab4c-e83a6aaabebc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[66798b0f-d2f8-46f2-8e9f-43c06db62816]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d378d3-1e52-4b80-9be8-43eea6740d16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:51:53 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:51:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71bc8d8-6a2c-4547-a951-40c52934854d]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG os_brick.utils [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:51:53 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Updating existing volume attachment record: 02c6e418-a45b-4189-b9fd-37a38f687013 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:51:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:55 user nova-compute[75083]: INFO nova.compute.manager [None req-c116825d-a58f-4616-99d0-37747fc3e1e7 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Unrescuing
Nov 29 05:51:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c116825d-a58f-4616-99d0-37747fc3e1e7 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:51:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c116825d-a58f-4616-99d0-37747fc3e1e7 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquired lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:51:55 user nova-compute[75083]: DEBUG nova.network.neutron [None req-c116825d-a58f-4616-99d0-37747fc3e1e7 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:51:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:56 user nova-compute[75083]: DEBUG nova.network.neutron [None req-c116825d-a58f-4616-99d0-37747fc3e1e7 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Updating instance_info_cache with network_info: [{"id": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "address": "fa:16:3e:76:b7:47", "network": {"id": "0e6492fc-5e8d-4df7-8fac-2da472312c4d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d625d0d60faf4a4f9073df250039f58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ddf4bb-5d", "ovs_interfaceid": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:51:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c116825d-a58f-4616-99d0-37747fc3e1e7 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Releasing lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:51:56 user nova-compute[75083]: DEBUG nova.objects.instance [None req-c116825d-a58f-4616-99d0-37747fc3e1e7 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lazy-loading 'flavor' on Instance uuid ee1bba24-17d0-4fc3-8bff-1337d86cc9be {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:51:56 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:51:56 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:51:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:56 user nova-compute[75083]: DEBUG nova.compute.manager [req-17356ef8-0479-478f-8c2c-a9f3e0cf2245 req-ef726755-dac9-4bde-9501-3b25498e9b83 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received event network-vif-unplugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:51:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-17356ef8-0479-478f-8c2c-a9f3e0cf2245 req-ef726755-dac9-4bde-9501-3b25498e9b83 service nova] Acquiring lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-17356ef8-0479-478f-8c2c-a9f3e0cf2245 req-ef726755-dac9-4bde-9501-3b25498e9b83 service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-17356ef8-0479-478f-8c2c-a9f3e0cf2245 req-ef726755-dac9-4bde-9501-3b25498e9b83 service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:56 user nova-compute[75083]: DEBUG nova.compute.manager [req-17356ef8-0479-478f-8c2c-a9f3e0cf2245 req-ef726755-dac9-4bde-9501-3b25498e9b83 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] No waiting events found dispatching network-vif-unplugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:51:56 user nova-compute[75083]: WARNING nova.compute.manager [req-17356ef8-0479-478f-8c2c-a9f3e0cf2245 req-ef726755-dac9-4bde-9501-3b25498e9b83 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received unexpected event network-vif-unplugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 for instance with vm_state rescued and task_state unrescuing.
Nov 29 05:51:56 user nova-compute[75083]: DEBUG nova.compute.manager [req-868f83f5-7a8a-49a2-85d6-61913fed9084 req-9a0da9a4-6b2e-4d7b-8be2-8f4edb3d28e2 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received event network-changed-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:51:56 user nova-compute[75083]: DEBUG nova.compute.manager [req-868f83f5-7a8a-49a2-85d6-61913fed9084 req-9a0da9a4-6b2e-4d7b-8be2-8f4edb3d28e2 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Refreshing instance network info cache due to event network-changed-b4ddf4bb-5def-4760-8d1b-f020942dedf8. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:51:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-868f83f5-7a8a-49a2-85d6-61913fed9084 req-9a0da9a4-6b2e-4d7b-8be2-8f4edb3d28e2 service nova] Acquiring lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:51:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-868f83f5-7a8a-49a2-85d6-61913fed9084 req-9a0da9a4-6b2e-4d7b-8be2-8f4edb3d28e2 service nova] Acquired lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:51:56 user nova-compute[75083]: DEBUG nova.network.neutron [req-868f83f5-7a8a-49a2-85d6-61913fed9084 req-9a0da9a4-6b2e-4d7b-8be2-8f4edb3d28e2 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Refreshing network info cache for port b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.compute.manager [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:51:57 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Creating image(s)
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Did not create local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Ensure instance console log exists: /opt/stack/data/nova/instances/cb63619b-6d75-49d0-80ef-d98aa21b7d4a/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Start _get_guest_xml network_info=[{"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '853f5523-1776-4740-a966-b488b5ebb9dc', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHCjmAZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cb63619b-6d75-49d0-80ef-d98aa21b7d4a', 'attached_at': '', 'detached_at': '', 'volume_id': '637c2fd0-db61-4184-8eee-be13661c3256', 'serial': '637c2fd0-db61-4184-8eee-be13661c3256'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:51:57 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:51:57 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHCjmAZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:51:57 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:51:57 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:51:57 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b652ab-6fa8-4797-aa31-3d9520a6e265]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:51:57 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[91178eae-5e4a-4953-bcec-130ff2a5ac9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256] added
Nov 29 05:51:57 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06e0429-62c9-408a-8c29-02e9abc3566b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce89741-d759-4d08-bdb9-42f4b0452b2c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RHCjmAZK {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RHCjmAZK" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4ba8bb-4c7e-4b8f-abc4-bc83da88d807]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RHCjmAZK'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:51:57 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Instance destroyed successfully.
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d205f5ca-24de-44ff-b70f-b686760a54b1]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d38f11d-3981-4b59-b72f-9821ec1a347c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:51:57 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:51:57 user nova-compute[75083]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)
Nov 29 05:51:57 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:51:57 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:51:57 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:51:57 user nova-compute[75083]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)
Nov 29 05:51:57 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:51:57 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2566659-e15c-402d-b27d-a792b23e0dd7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256, portal: 172.16.0.220,3260]
Nov 29 05:51:57 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256, portal: 172.16.0.220,3260] successful.
Nov 29 05:51:57 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.076s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4453467-6897-41f7-9b9f-54840f6ee2cd]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.network.neutron [req-868f83f5-7a8a-49a2-85d6-61913fed9084 req-9a0da9a4-6b2e-4d7b-8be2-8f4edb3d28e2 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Updated VIF entry in instance network info cache for port b4ddf4bb-5def-4760-8d1b-f020942dedf8. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG nova.network.neutron [req-868f83f5-7a8a-49a2-85d6-61913fed9084 req-9a0da9a4-6b2e-4d7b-8be2-8f4edb3d28e2 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Updating instance_info_cache with network_info: [{"id": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "address": "fa:16:3e:76:b7:47", "network": {"id": "0e6492fc-5e8d-4df7-8fac-2da472312c4d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d625d0d60faf4a4f9073df250039f58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ddf4bb-5d", "ovs_interfaceid": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-868f83f5-7a8a-49a2-85d6-61913fed9084 req-9a0da9a4-6b2e-4d7b-8be2-8f4edb3d28e2 service nova] Releasing lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb163128-1ee2-47ce-9667-cee2de3ec6e5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:51:57 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:51:57 user nova-compute[75083]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)
Nov 29 05:51:57 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:51:57 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:51:57 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:51:57 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:51:57 user nova-compute[75083]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)
Nov 29 05:51:57 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:51:57 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:51:57 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.481s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.029s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc880c8-bc00-4e92-a67f-b85e24d35a39]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHCjmAZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:51:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.533s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] <== connect_volume: return (1534ms) {'type': 'block', 'scsi_wwn': '23462323163323363', 'path': '/dev/sdf'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462323163323363', 'path': '/dev/sdf'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2116511993',display_name='tempest-TestShelveInstance-server-2116511993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2116511993',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3XRiOYiMyy1cMKrc1L5kmaEw25NqJKhIhaSi9XAjuBjymTSblD1gvpU4X9lRZjCdo4ELni/eCQVBbsZcwHCjK+TtBxYCIy7uoJiDP2ByGmZdSvxYSiXvrvCVbCnPZgcQ==',key_name='tempest-TestShelveInstance-728939459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='385f39574be145b6b47e5a7dddf9415e',ramdisk_id='',reservation_id='r-oqenqftq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-925751842',owner_user_name='tempest-TestShelveInstance-925751842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:51:48Z,user_data=None,user_id='d4fd22380d304dac9cc3db3ad3c971d9',uuid=cb63619b-6d75-49d0-80ef-d98aa21b7d4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Converting VIF {"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:23:d3,bridge_name='br-int',has_traffic_filtering=True,id=df73cb37-8475-4c21-89c7-b02949297b63,network=Network(4c9f102f-b100-4ec2-95cb-4c66dafebf29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf73cb37-84') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG nova.objects.instance [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lazy-loading 'pci_devices' on Instance uuid cb63619b-6d75-49d0-80ef-d98aa21b7d4a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:51:58 user nova-compute[75083]:   <uuid>cb63619b-6d75-49d0-80ef-d98aa21b7d4a</uuid>
Nov 29 05:51:58 user nova-compute[75083]:   <name>instance-00000011</name>
Nov 29 05:51:58 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:51:58 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:51:58 user nova-compute[75083]:   <metadata>
Nov 29 05:51:58 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:51:58 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:51:58 user nova-compute[75083]:       <nova:name>tempest-TestShelveInstance-server-2116511993</nova:name>
Nov 29 05:51:58 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:51:57</nova:creationTime>
Nov 29 05:51:58 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:51:58 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:51:58 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:51:58 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:51:58 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:51:58 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:51:58 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:51:58 user nova-compute[75083]:       <nova:owner>
Nov 29 05:51:58 user nova-compute[75083]:         <nova:user uuid="d4fd22380d304dac9cc3db3ad3c971d9">tempest-TestShelveInstance-925751842-project-member</nova:user>
Nov 29 05:51:58 user nova-compute[75083]:         <nova:project uuid="385f39574be145b6b47e5a7dddf9415e">tempest-TestShelveInstance-925751842</nova:project>
Nov 29 05:51:58 user nova-compute[75083]:       </nova:owner>
Nov 29 05:51:58 user nova-compute[75083]:       <nova:ports>
Nov 29 05:51:58 user nova-compute[75083]:         <nova:port uuid="df73cb37-8475-4c21-89c7-b02949297b63">
Nov 29 05:51:58 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 05:51:58 user nova-compute[75083]:         </nova:port>
Nov 29 05:51:58 user nova-compute[75083]:       </nova:ports>
Nov 29 05:51:58 user nova-compute[75083]:     </nova:instance>
Nov 29 05:51:58 user nova-compute[75083]:   </metadata>
Nov 29 05:51:58 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:51:58 user nova-compute[75083]:     <system>
Nov 29 05:51:58 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:51:58 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:51:58 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:51:58 user nova-compute[75083]:       <entry name="serial">cb63619b-6d75-49d0-80ef-d98aa21b7d4a</entry>
Nov 29 05:51:58 user nova-compute[75083]:       <entry name="uuid">cb63619b-6d75-49d0-80ef-d98aa21b7d4a</entry>
Nov 29 05:51:58 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:51:58 user nova-compute[75083]:     </system>
Nov 29 05:51:58 user nova-compute[75083]:   </sysinfo>
Nov 29 05:51:58 user nova-compute[75083]:   <os>
Nov 29 05:51:58 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:51:58 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:51:58 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:51:58 user nova-compute[75083]:   </os>
Nov 29 05:51:58 user nova-compute[75083]:   <features>
Nov 29 05:51:58 user nova-compute[75083]:     <acpi/>
Nov 29 05:51:58 user nova-compute[75083]:     <apic/>
Nov 29 05:51:58 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:51:58 user nova-compute[75083]:   </features>
Nov 29 05:51:58 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:51:58 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:51:58 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:51:58 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:51:58 user nova-compute[75083]:   </clock>
Nov 29 05:51:58 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:51:58 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:51:58 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:51:58 user nova-compute[75083]:   </cpu>
Nov 29 05:51:58 user nova-compute[75083]:   <devices>
Nov 29 05:51:58 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 05:51:58 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:51:58 user nova-compute[75083]:       <source dev="/dev/sdf"/>
Nov 29 05:51:58 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:51:58 user nova-compute[75083]:       <serial>637c2fd0-db61-4184-8eee-be13661c3256</serial>
Nov 29 05:51:58 user nova-compute[75083]:     </disk>
Nov 29 05:51:58 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:51:58 user nova-compute[75083]:       <mac address="fa:16:3e:58:23:d3"/>
Nov 29 05:51:58 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:51:58 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:51:58 user nova-compute[75083]:       <target dev="tapdf73cb37-84"/>
Nov 29 05:51:58 user nova-compute[75083]:     </interface>
Nov 29 05:51:58 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:51:58 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/cb63619b-6d75-49d0-80ef-d98aa21b7d4a/console.log" append="off"/>
Nov 29 05:51:58 user nova-compute[75083]:     </serial>
Nov 29 05:51:58 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:51:58 user nova-compute[75083]:     <video>
Nov 29 05:51:58 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:51:58 user nova-compute[75083]:     </video>
Nov 29 05:51:58 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:51:58 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:51:58 user nova-compute[75083]:     </rng>
Nov 29 05:51:58 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:51:58 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:51:58 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:51:58 user nova-compute[75083]:     </memballoon>
Nov 29 05:51:58 user nova-compute[75083]:   </devices>
Nov 29 05:51:58 user nova-compute[75083]: </domain>
Nov 29 05:51:58 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2116511993',display_name='tempest-TestShelveInstance-server-2116511993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2116511993',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3XRiOYiMyy1cMKrc1L5kmaEw25NqJKhIhaSi9XAjuBjymTSblD1gvpU4X9lRZjCdo4ELni/eCQVBbsZcwHCjK+TtBxYCIy7uoJiDP2ByGmZdSvxYSiXvrvCVbCnPZgcQ==',key_name='tempest-TestShelveInstance-728939459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='385f39574be145b6b47e5a7dddf9415e',ramdisk_id='',reservation_id='r-oqenqftq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-925751842',owner_user_name='tempest-TestShelveInstance-925751842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:51:48Z,user_data=None,user_id='d4fd22380d304dac9cc3db3ad3c971d9',uuid=cb63619b-6d75-49d0-80ef-d98aa21b7d4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Converting VIF {"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:23:d3,bridge_name='br-int',has_traffic_filtering=True,id=df73cb37-8475-4c21-89c7-b02949297b63,network=Network(4c9f102f-b100-4ec2-95cb-4c66dafebf29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf73cb37-84') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG os_vif [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:23:d3,bridge_name='br-int',has_traffic_filtering=True,id=df73cb37-8475-4c21-89c7-b02949297b63,network=Network(4c9f102f-b100-4ec2-95cb-4c66dafebf29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf73cb37-84') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c44e3a13-0b39-5911-b497-3985626fe852', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf73cb37-84, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf73cb37-84, col_values=(('qos', UUID('4e481196-1192-424e-9d56-866db6f90de2')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf73cb37-84, col_values=(('external_ids', {'iface-id': 'df73cb37-8475-4c21-89c7-b02949297b63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:23:d3', 'vm-uuid': 'cb63619b-6d75-49d0-80ef-d98aa21b7d4a'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:58 user nova-compute[75083]: INFO os_vif [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:23:d3,bridge_name='br-int',has_traffic_filtering=True,id=df73cb37-8475-4c21-89c7-b02949297b63,network=Network(4c9f102f-b100-4ec2-95cb-4c66dafebf29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf73cb37-84')
Nov 29 05:51:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] No VIF found with MAC fa:16:3e:58:23:d3, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG nova.compute.manager [req-6b8ae1d2-1a65-4bba-98f2-4de1526f2e49 req-5f1587b5-e00d-4e9d-a55d-71be729639ad service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received event network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6b8ae1d2-1a65-4bba-98f2-4de1526f2e49 req-5f1587b5-e00d-4e9d-a55d-71be729639ad service nova] Acquiring lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6b8ae1d2-1a65-4bba-98f2-4de1526f2e49 req-5f1587b5-e00d-4e9d-a55d-71be729639ad service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6b8ae1d2-1a65-4bba-98f2-4de1526f2e49 req-5f1587b5-e00d-4e9d-a55d-71be729639ad service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG nova.compute.manager [req-6b8ae1d2-1a65-4bba-98f2-4de1526f2e49 req-5f1587b5-e00d-4e9d-a55d-71be729639ad service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] No waiting events found dispatching network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:51:58 user nova-compute[75083]: WARNING nova.compute.manager [req-6b8ae1d2-1a65-4bba-98f2-4de1526f2e49 req-5f1587b5-e00d-4e9d-a55d-71be729639ad service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received unexpected event network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 for instance with vm_state rescued and task_state unrescuing.
Nov 29 05:51:58 user nova-compute[75083]: DEBUG nova.compute.manager [req-912049cf-8500-4557-a246-5f62bb05ae0d req-179a0df8-ec74-418c-8921-e7d267a1c736 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received event network-changed-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG nova.compute.manager [req-912049cf-8500-4557-a246-5f62bb05ae0d req-179a0df8-ec74-418c-8921-e7d267a1c736 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Refreshing instance network info cache due to event network-changed-b4ddf4bb-5def-4760-8d1b-f020942dedf8. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-912049cf-8500-4557-a246-5f62bb05ae0d req-179a0df8-ec74-418c-8921-e7d267a1c736 service nova] Acquiring lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-912049cf-8500-4557-a246-5f62bb05ae0d req-179a0df8-ec74-418c-8921-e7d267a1c736 service nova] Acquired lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:51:58 user nova-compute[75083]: DEBUG nova.network.neutron [req-912049cf-8500-4557-a246-5f62bb05ae0d req-179a0df8-ec74-418c-8921-e7d267a1c736 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Refreshing network info cache for port b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:51:59 user nova-compute[75083]: DEBUG nova.network.neutron [req-912049cf-8500-4557-a246-5f62bb05ae0d req-179a0df8-ec74-418c-8921-e7d267a1c736 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Updated VIF entry in instance network info cache for port b4ddf4bb-5def-4760-8d1b-f020942dedf8. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:51:59 user nova-compute[75083]: DEBUG nova.network.neutron [req-912049cf-8500-4557-a246-5f62bb05ae0d req-179a0df8-ec74-418c-8921-e7d267a1c736 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Updating instance_info_cache with network_info: [{"id": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "address": "fa:16:3e:76:b7:47", "network": {"id": "0e6492fc-5e8d-4df7-8fac-2da472312c4d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d625d0d60faf4a4f9073df250039f58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ddf4bb-5d", "ovs_interfaceid": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:51:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-912049cf-8500-4557-a246-5f62bb05ae0d req-179a0df8-ec74-418c-8921-e7d267a1c736 service nova] Releasing lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:51:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:51:59 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:51:59 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:51:59 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:52:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:52:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:00 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 05:52:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received event network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] Acquiring lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] No waiting events found dispatching network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:52:01 user nova-compute[75083]: WARNING nova.compute.manager [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received unexpected event network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 for instance with vm_state rescued and task_state unrescuing.
Nov 29 05:52:01 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received event network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] Acquiring lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] No waiting events found dispatching network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:52:01 user nova-compute[75083]: WARNING nova.compute.manager [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received unexpected event network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 for instance with vm_state rescued and task_state unrescuing.
Nov 29 05:52:01 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received event network-vif-plugged-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] Acquiring lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] No waiting events found dispatching network-vif-plugged-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:52:01 user nova-compute[75083]: WARNING nova.compute.manager [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received unexpected event network-vif-plugged-df73cb37-8475-4c21-89c7-b02949297b63 for instance with vm_state building and task_state spawning.
Nov 29 05:52:01 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received event network-vif-plugged-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] Acquiring lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] No waiting events found dispatching network-vif-plugged-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:52:01 user nova-compute[75083]: WARNING nova.compute.manager [req-ea59851a-f88b-4c65-9531-c4f75b6cd7e4 req-9594f8e0-1892-4eef-b504-642b1c5a13be service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received unexpected event network-vif-plugged-df73cb37-8475-4c21-89c7-b02949297b63 for instance with vm_state building and task_state spawning.
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG nova.compute.manager [None req-c116825d-a58f-4616-99d0-37747fc3e1e7 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Acquiring lock "f3f2df31-d316-48a4-8d9e-c68c5349a739" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "f3f2df31-d316-48a4-8d9e-c68c5349a739" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG nova.compute.manager [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MafARzSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:52:02 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:52:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:52:02 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:52:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:52:02 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG nova.compute.manager [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:52:02 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Instance spawned successfully.
Nov 29 05:52:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260" returned: 21 in 0.038s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9ac110-6718-47d5-bd35-eaed7eca32b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:52:02 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.058s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90c9e7b-17db-46f8-b861-9f643c722855]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5] added
Nov 29 05:52:02 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa922d0-2368-408f-aaaa-5d951b52cc91]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8b44b8-7b05-42d7-9590-e24638b4bcbd]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:02 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MafARzSH {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:03 user nova-compute[75083]: INFO nova.compute.manager [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Took 5.90 seconds to spawn the instance on the hypervisor.
Nov 29 05:52:03 user nova-compute[75083]: DEBUG nova.compute.manager [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MafARzSH" returned: 0 in 0.033s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[736b60a5-ab16-4ea3-a837-d961e7a348b9]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MafARzSH'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:52:03 user nova-compute[75083]: INFO nova.compute.claims [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Claim successful on node user
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[574aea61-971a-41a0-b943-4410bd541cf8]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:03 user nova-compute[75083]: INFO nova.compute.manager [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Took 15.51 seconds to build instance.
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a075f5-da6d-4e3a-ac26-0a71be680e41]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:52:03 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:52:03 user nova-compute[75083]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)
Nov 29 05:52:03 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:52:03 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:52:03 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:52:03 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:52:03 user nova-compute[75083]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)
Nov 29 05:52:03 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:52:03 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:52:03 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3ae3f555-0192-4ae7-a454-7c4288640338 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.620s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[772349a8-004f-4e69-b669-166a231d7c16]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5, portal: 172.16.0.220,3260]
Nov 29 05:52:03 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5, portal: 172.16.0.220,3260] successful.
Nov 29 05:52:03 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Refreshing inventories for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42e6f88-820b-4f32-954d-77038277f1bb]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Updating ProviderTree inventory for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Updating inventory in ProviderTree for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cbe996-08fc-405d-bdd5-5c4518380f79]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:52:03 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:52:03 user nova-compute[75083]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)
Nov 29 05:52:03 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:52:03 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:52:03 user nova-compute[75083]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:52:03 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:52:03 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:52:03 user nova-compute[75083]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)
Nov 29 05:52:03 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:52:03 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:52:03 user nova-compute[75083]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:52:03 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.514s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] HCTL ('38', '-', '-', 0) found on session 21 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Refreshing aggregate associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, aggregates: None {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.033s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d19dbc-ec0a-45ca-9005-83e272a841b1]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Refreshing trait associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, traits: HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MafARzSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.850s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG nova.compute.manager [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG nova.compute.manager [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:52:03 user nova-compute[75083]: DEBUG nova.network.neutron [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:52:03 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:52:04 user nova-compute[75083]: DEBUG nova.compute.manager [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG nova.policy [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '203e79e1d87b4a74bfc9c665b6cef19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9994d0f11f4f3d9d5efd77db3dd8b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG nova.compute.manager [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:52:04 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Creating image(s)
Nov 29 05:52:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3f2df31-d316-48a4-8d9e-c68c5349a739/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "/opt/stack/data/nova/instances/f3f2df31-d316-48a4-8d9e-c68c5349a739/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "/opt/stack/data/nova/instances/f3f2df31-d316-48a4-8d9e-c68c5349a739/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.191s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.656s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] <== connect_volume: return (1659ms) {'type': 'block', 'scsi_wwn': '23137376234383463', 'path': '/dev/sdg'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137376234383463', 'path': '/dev/sdg'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG nova.objects.instance [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lazy-loading 'flavor' on Instance uuid b6d38a2c-a512-41f2-a7df-6a54058f8f8b {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:52:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 05:52:04 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:52:04 user nova-compute[75083]:   <source dev="/dev/sdg"/>
Nov 29 05:52:04 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:52:04 user nova-compute[75083]:   <serial>d3f4708c-c8b0-495e-9eb4-5c01a957ebd5</serial>
Nov 29 05:52:04 user nova-compute[75083]: </disk>
Nov 29 05:52:04 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.network.neutron [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Successfully created port: 607671f2-8606-44a1-8100-8b1406c05b4d {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 1.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/f3f2df31-d316-48a4-8d9e-c68c5349a739/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/f3f2df31-d316-48a4-8d9e-c68c5349a739/disk 1073741824" returned: 0 in 0.069s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 1.256s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "e6d49806-cecd-473a-b92f-9255868d35c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.005s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:05 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:52:05 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=7545MB free_disk=25.283321380615234GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:05 user nova-compute[75083]: INFO nova.compute.manager [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Detaching volume e200b1ae-3a3c-42f0-af89-b218ba46537e
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] No VIF found with MAC fa:16:3e:f6:1e:5c, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:05 user nova-compute[75083]: INFO nova.virt.block_device [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Attempting to driver detach volume e200b1ae-3a3c-42f0-af89-b218ba46537e from mountpoint /dev/vdb
Nov 29 05:52:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.225s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3f2df31-d316-48a4-8d9e-c68c5349a739/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f2df31-d316-48a4-8d9e-c68c5349a739/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance e6d49806-cecd-473a-b92f-9255868d35c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance ee1bba24-17d0-4fc3-8bff-1337d86cc9be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 161c6455-90ce-4c40-a33e-7f582989135d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b6d38a2c-a512-41f2-a7df-6a54058f8f8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 47437526-c4e4-4a15-ba9b-51bbae17c77b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 2acbda14-e4bc-49ac-81e2-ce28bc3878d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fb8244c4-f2a7-4ad8-a210-0f62c165a4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 7c693239-226b-42b1-928e-9a8b7a2a114c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance cb63619b-6d75-49d0-80ef-d98aa21b7d4a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance f3f2df31-d316-48a4-8d9e-c68c5349a739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Attempting to detach device vdb from instance e6d49806-cecd-473a-b92f-9255868d35c7 from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:52:05 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:52:05 user nova-compute[75083]:   <source dev="/dev/sdc"/>
Nov 29 05:52:05 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:52:05 user nova-compute[75083]:   <serial>e200b1ae-3a3c-42f0-af89-b218ba46537e</serial>
Nov 29 05:52:05 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 05:52:05 user nova-compute[75083]: </disk>
Nov 29 05:52:05 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dfc02eaf-46a9-4ce2-b1c4-21d26021fc34 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.367s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:05 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Successfully detached device vdb from instance e6d49806-cecd-473a-b92f-9255868d35c7 from the persistent domain config.
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e6d49806-cecd-473a-b92f-9255868d35c7 from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 05:52:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:52:05 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:52:05 user nova-compute[75083]:   <source dev="/dev/sdc"/>
Nov 29 05:52:05 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:52:05 user nova-compute[75083]:   <serial>e200b1ae-3a3c-42f0-af89-b218ba46537e</serial>
Nov 29 05:52:05 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 05:52:05 user nova-compute[75083]: </disk>
Nov 29 05:52:05 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f2df31-d316-48a4-8d9e-c68c5349a739/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Cannot resize image /opt/stack/data/nova/instances/f3f2df31-d316-48a4-8d9e-c68c5349a739/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Ensure instance console log exists: /opt/stack/data/nova/instances/f3f2df31-d316-48a4-8d9e-c68c5349a739/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.network.neutron [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Successfully updated port: 607671f2-8606-44a1-8100-8b1406c05b4d {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Acquiring lock "refresh_cache-f3f2df31-d316-48a4-8d9e-c68c5349a739" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Acquired lock "refresh_cache-f3f2df31-d316-48a4-8d9e-c68c5349a739" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.network.neutron [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-ca6a861b-ddef-4d1d-a455-4a8fd10f7164 req-ac85f763-1727-4662-a66b-0c45a8b58c83 service nova] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Received event network-changed-607671f2-8606-44a1-8100-8b1406c05b4d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-ca6a861b-ddef-4d1d-a455-4a8fd10f7164 req-ac85f763-1727-4662-a66b-0c45a8b58c83 service nova] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Refreshing instance network info cache due to event network-changed-607671f2-8606-44a1-8100-8b1406c05b4d. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ca6a861b-ddef-4d1d-a455-4a8fd10f7164 req-ac85f763-1727-4662-a66b-0c45a8b58c83 service nova] Acquiring lock "refresh_cache-f3f2df31-d316-48a4-8d9e-c68c5349a739" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.network.neutron [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.665s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] There are 0 instances to clean {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75083) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.network.neutron [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Updating instance_info_cache with network_info: [{"id": "607671f2-8606-44a1-8100-8b1406c05b4d", "address": "fa:16:3e:89:cf:a4", "network": {"id": "39ff6758-4cee-4758-b66f-7a071d9c68e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-274780460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e9994d0f11f4f3d9d5efd77db3dd8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607671f2-86", "ovs_interfaceid": "607671f2-8606-44a1-8100-8b1406c05b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Releasing lock "refresh_cache-f3f2df31-d316-48a4-8d9e-c68c5349a739" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.compute.manager [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Instance network_info: |[{"id": "607671f2-8606-44a1-8100-8b1406c05b4d", "address": "fa:16:3e:89:cf:a4", "network": {"id": "39ff6758-4cee-4758-b66f-7a071d9c68e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-274780460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e9994d0f11f4f3d9d5efd77db3dd8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607671f2-86", "ovs_interfaceid": "607671f2-8606-44a1-8100-8b1406c05b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ca6a861b-ddef-4d1d-a455-4a8fd10f7164 req-ac85f763-1727-4662-a66b-0c45a8b58c83 service nova] Acquired lock "refresh_cache-f3f2df31-d316-48a4-8d9e-c68c5349a739" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.network.neutron [req-ca6a861b-ddef-4d1d-a455-4a8fd10f7164 req-ac85f763-1727-4662-a66b-0c45a8b58c83 service nova] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Refreshing network info cache for port 607671f2-8606-44a1-8100-8b1406c05b4d {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Start _get_guest_xml network_info=[{"id": "607671f2-8606-44a1-8100-8b1406c05b4d", "address": "fa:16:3e:89:cf:a4", "network": {"id": "39ff6758-4cee-4758-b66f-7a071d9c68e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-274780460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e9994d0f11f4f3d9d5efd77db3dd8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607671f2-86", "ovs_interfaceid": "607671f2-8606-44a1-8100-8b1406c05b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:52:06 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:52:06 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-411703319',display_name='tempest-VolumesActionsTest-instance-411703319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-411703319',id=18,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e9994d0f11f4f3d9d5efd77db3dd8b6',ramdisk_id='',reservation_id='r-w6w3sidb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-357770937',owner_user_name='tempest-VolumesActionsTest-357770937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:52:04Z,user_data=None,user_id='203e79e1d87b4a74bfc9c665b6cef19d',uuid=f3f2df31-d316-48a4-8d9e-c68c5349a739,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "607671f2-8606-44a1-8100-8b1406c05b4d", "address": "fa:16:3e:89:cf:a4", "network": {"id": "39ff6758-4cee-4758-b66f-7a071d9c68e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-274780460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e9994d0f11f4f3d9d5efd77db3dd8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607671f2-86", "ovs_interfaceid": "607671f2-8606-44a1-8100-8b1406c05b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Converting VIF {"id": "607671f2-8606-44a1-8100-8b1406c05b4d", "address": "fa:16:3e:89:cf:a4", "network": {"id": "39ff6758-4cee-4758-b66f-7a071d9c68e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-274780460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e9994d0f11f4f3d9d5efd77db3dd8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607671f2-86", "ovs_interfaceid": "607671f2-8606-44a1-8100-8b1406c05b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:cf:a4,bridge_name='br-int',has_traffic_filtering=True,id=607671f2-8606-44a1-8100-8b1406c05b4d,network=Network(39ff6758-4cee-4758-b66f-7a071d9c68e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607671f2-86') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.objects.instance [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lazy-loading 'pci_devices' on Instance uuid f3f2df31-d316-48a4-8d9e-c68c5349a739 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:52:06 user nova-compute[75083]:   <uuid>f3f2df31-d316-48a4-8d9e-c68c5349a739</uuid>
Nov 29 05:52:06 user nova-compute[75083]:   <name>instance-00000012</name>
Nov 29 05:52:06 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:52:06 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:52:06 user nova-compute[75083]:   <metadata>
Nov 29 05:52:06 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:52:06 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:52:06 user nova-compute[75083]:       <nova:name>tempest-VolumesActionsTest-instance-411703319</nova:name>
Nov 29 05:52:06 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:52:06</nova:creationTime>
Nov 29 05:52:06 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:52:06 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:52:06 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:52:06 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:52:06 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:52:06 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:52:06 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:52:06 user nova-compute[75083]:       <nova:owner>
Nov 29 05:52:06 user nova-compute[75083]:         <nova:user uuid="203e79e1d87b4a74bfc9c665b6cef19d">tempest-VolumesActionsTest-357770937-project-member</nova:user>
Nov 29 05:52:06 user nova-compute[75083]:         <nova:project uuid="8e9994d0f11f4f3d9d5efd77db3dd8b6">tempest-VolumesActionsTest-357770937</nova:project>
Nov 29 05:52:06 user nova-compute[75083]:       </nova:owner>
Nov 29 05:52:06 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:52:06 user nova-compute[75083]:       <nova:ports>
Nov 29 05:52:06 user nova-compute[75083]:         <nova:port uuid="607671f2-8606-44a1-8100-8b1406c05b4d">
Nov 29 05:52:06 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 05:52:06 user nova-compute[75083]:         </nova:port>
Nov 29 05:52:06 user nova-compute[75083]:       </nova:ports>
Nov 29 05:52:06 user nova-compute[75083]:     </nova:instance>
Nov 29 05:52:06 user nova-compute[75083]:   </metadata>
Nov 29 05:52:06 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:52:06 user nova-compute[75083]:     <system>
Nov 29 05:52:06 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:52:06 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:52:06 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:52:06 user nova-compute[75083]:       <entry name="serial">f3f2df31-d316-48a4-8d9e-c68c5349a739</entry>
Nov 29 05:52:06 user nova-compute[75083]:       <entry name="uuid">f3f2df31-d316-48a4-8d9e-c68c5349a739</entry>
Nov 29 05:52:06 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:52:06 user nova-compute[75083]:     </system>
Nov 29 05:52:06 user nova-compute[75083]:   </sysinfo>
Nov 29 05:52:06 user nova-compute[75083]:   <os>
Nov 29 05:52:06 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:52:06 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:52:06 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:52:06 user nova-compute[75083]:   </os>
Nov 29 05:52:06 user nova-compute[75083]:   <features>
Nov 29 05:52:06 user nova-compute[75083]:     <acpi/>
Nov 29 05:52:06 user nova-compute[75083]:     <apic/>
Nov 29 05:52:06 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:52:06 user nova-compute[75083]:   </features>
Nov 29 05:52:06 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:52:06 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:52:06 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:52:06 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:52:06 user nova-compute[75083]:   </clock>
Nov 29 05:52:06 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:52:06 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:52:06 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:52:06 user nova-compute[75083]:   </cpu>
Nov 29 05:52:06 user nova-compute[75083]:   <devices>
Nov 29 05:52:06 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:52:06 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:52:06 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/f3f2df31-d316-48a4-8d9e-c68c5349a739/disk"/>
Nov 29 05:52:06 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:52:06 user nova-compute[75083]:     </disk>
Nov 29 05:52:06 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:52:06 user nova-compute[75083]:       <mac address="fa:16:3e:89:cf:a4"/>
Nov 29 05:52:06 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:52:06 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:52:06 user nova-compute[75083]:       <target dev="tap607671f2-86"/>
Nov 29 05:52:06 user nova-compute[75083]:     </interface>
Nov 29 05:52:06 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:52:06 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/f3f2df31-d316-48a4-8d9e-c68c5349a739/console.log" append="off"/>
Nov 29 05:52:06 user nova-compute[75083]:     </serial>
Nov 29 05:52:06 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:52:06 user nova-compute[75083]:     <video>
Nov 29 05:52:06 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:52:06 user nova-compute[75083]:     </video>
Nov 29 05:52:06 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:52:06 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:52:06 user nova-compute[75083]:     </rng>
Nov 29 05:52:06 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:52:06 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:52:06 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:52:06 user nova-compute[75083]:     </memballoon>
Nov 29 05:52:06 user nova-compute[75083]:   </devices>
Nov 29 05:52:06 user nova-compute[75083]: </domain>
Nov 29 05:52:06 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-411703319',display_name='tempest-VolumesActionsTest-instance-411703319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-411703319',id=18,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e9994d0f11f4f3d9d5efd77db3dd8b6',ramdisk_id='',reservation_id='r-w6w3sidb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-357770937',owner_user_name='tempest-VolumesActionsTest-357770937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:52:04Z,user_data=None,user_id='203e79e1d87b4a74bfc9c665b6cef19d',uuid=f3f2df31-d316-48a4-8d9e-c68c5349a739,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "607671f2-8606-44a1-8100-8b1406c05b4d", "address": "fa:16:3e:89:cf:a4", "network": {"id": "39ff6758-4cee-4758-b66f-7a071d9c68e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-274780460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e9994d0f11f4f3d9d5efd77db3dd8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607671f2-86", "ovs_interfaceid": "607671f2-8606-44a1-8100-8b1406c05b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Converting VIF {"id": "607671f2-8606-44a1-8100-8b1406c05b4d", "address": "fa:16:3e:89:cf:a4", "network": {"id": "39ff6758-4cee-4758-b66f-7a071d9c68e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-274780460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e9994d0f11f4f3d9d5efd77db3dd8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607671f2-86", "ovs_interfaceid": "607671f2-8606-44a1-8100-8b1406c05b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:cf:a4,bridge_name='br-int',has_traffic_filtering=True,id=607671f2-8606-44a1-8100-8b1406c05b4d,network=Network(39ff6758-4cee-4758-b66f-7a071d9c68e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607671f2-86') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG os_vif [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:cf:a4,bridge_name='br-int',has_traffic_filtering=True,id=607671f2-8606-44a1-8100-8b1406c05b4d,network=Network(39ff6758-4cee-4758-b66f-7a071d9c68e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607671f2-86') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '259637a1-5ae0-54da-bb0a-70a8924a616a', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap607671f2-86, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap607671f2-86, col_values=(('qos', UUID('8954debf-096f-4da2-a0d8-b7fbb4cbc530')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap607671f2-86, col_values=(('external_ids', {'iface-id': '607671f2-8606-44a1-8100-8b1406c05b4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:cf:a4', 'vm-uuid': 'f3f2df31-d316-48a4-8d9e-c68c5349a739'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:06 user nova-compute[75083]: INFO os_vif [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:cf:a4,bridge_name='br-int',has_traffic_filtering=True,id=607671f2-8606-44a1-8100-8b1406c05b4d,network=Network(39ff6758-4cee-4758-b66f-7a071d9c68e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607671f2-86')
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:52:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] No VIF found with MAC fa:16:3e:89:cf:a4, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:52:07 user nova-compute[75083]: DEBUG nova.network.neutron [req-ca6a861b-ddef-4d1d-a455-4a8fd10f7164 req-ac85f763-1727-4662-a66b-0c45a8b58c83 service nova] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Updated VIF entry in instance network info cache for port 607671f2-8606-44a1-8100-8b1406c05b4d. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:52:07 user nova-compute[75083]: DEBUG nova.network.neutron [req-ca6a861b-ddef-4d1d-a455-4a8fd10f7164 req-ac85f763-1727-4662-a66b-0c45a8b58c83 service nova] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Updating instance_info_cache with network_info: [{"id": "607671f2-8606-44a1-8100-8b1406c05b4d", "address": "fa:16:3e:89:cf:a4", "network": {"id": "39ff6758-4cee-4758-b66f-7a071d9c68e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-274780460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e9994d0f11f4f3d9d5efd77db3dd8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607671f2-86", "ovs_interfaceid": "607671f2-8606-44a1-8100-8b1406c05b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:52:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ca6a861b-ddef-4d1d-a455-4a8fd10f7164 req-ac85f763-1727-4662-a66b-0c45a8b58c83 service nova] Releasing lock "refresh_cache-f3f2df31-d316-48a4-8d9e-c68c5349a739" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:52:07 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:52:07 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 05:52:07 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 05:52:07 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Skipping network cache update for instance because it is Building. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 05:52:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:52:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:52:07 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 05:52:07 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lazy-loading 'info_cache' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:52:07 user nova-compute[75083]: INFO nova.compute.manager [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Rebuilding instance
Nov 29 05:52:07 user nova-compute[75083]: DEBUG nova.compute.manager [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Updating instance_info_cache with network_info: [{"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG nova.compute.manager [req-f5035d1e-3a55-4e5b-bdbb-83750c36ba65 req-b970665a-b9a5-4362-863b-c002fba601a6 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Received event network-vif-unplugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f5035d1e-3a55-4e5b-bdbb-83750c36ba65 req-b970665a-b9a5-4362-863b-c002fba601a6 service nova] Acquiring lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f5035d1e-3a55-4e5b-bdbb-83750c36ba65 req-b970665a-b9a5-4362-863b-c002fba601a6 service nova] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f5035d1e-3a55-4e5b-bdbb-83750c36ba65 req-b970665a-b9a5-4362-863b-c002fba601a6 service nova] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG nova.compute.manager [req-f5035d1e-3a55-4e5b-bdbb-83750c36ba65 req-b970665a-b9a5-4362-863b-c002fba601a6 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] No waiting events found dispatching network-vif-unplugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:52:08 user nova-compute[75083]: WARNING nova.compute.manager [req-f5035d1e-3a55-4e5b-bdbb-83750c36ba65 req-b970665a-b9a5-4362-863b-c002fba601a6 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Received unexpected event network-vif-unplugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 for instance with vm_state active and task_state rebuilding.
Nov 29 05:52:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG nova.compute.manager [req-5dba889a-8a31-4725-bef1-f422553a62de req-1df369c8-3e1c-42e4-8a10-eeb10d7ea66e service nova] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Received event network-vif-plugged-607671f2-8606-44a1-8100-8b1406c05b4d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5dba889a-8a31-4725-bef1-f422553a62de req-1df369c8-3e1c-42e4-8a10-eeb10d7ea66e service nova] Acquiring lock "f3f2df31-d316-48a4-8d9e-c68c5349a739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5dba889a-8a31-4725-bef1-f422553a62de req-1df369c8-3e1c-42e4-8a10-eeb10d7ea66e service nova] Lock "f3f2df31-d316-48a4-8d9e-c68c5349a739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5dba889a-8a31-4725-bef1-f422553a62de req-1df369c8-3e1c-42e4-8a10-eeb10d7ea66e service nova] Lock "f3f2df31-d316-48a4-8d9e-c68c5349a739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.009s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:08 user nova-compute[75083]: DEBUG nova.compute.manager [req-5dba889a-8a31-4725-bef1-f422553a62de req-1df369c8-3e1c-42e4-8a10-eeb10d7ea66e service nova] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] No waiting events found dispatching network-vif-plugged-607671f2-8606-44a1-8100-8b1406c05b4d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:52:08 user nova-compute[75083]: WARNING nova.compute.manager [req-5dba889a-8a31-4725-bef1-f422553a62de req-1df369c8-3e1c-42e4-8a10-eeb10d7ea66e service nova] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Received unexpected event network-vif-plugged-607671f2-8606-44a1-8100-8b1406c05b4d for instance with vm_state building and task_state spawning.
Nov 29 05:52:09 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Instance destroyed successfully.
Nov 29 05:52:09 user nova-compute[75083]: INFO nova.compute.manager [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Detaching volume d3f4708c-c8b0-495e-9eb4-5c01a957ebd5
Nov 29 05:52:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:09 user nova-compute[75083]: INFO nova.virt.block_device [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Attempting to driver detach volume d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 from mountpoint /dev/vdb
Nov 29 05:52:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Attempting to detach device vdb from instance b6d38a2c-a512-41f2-a7df-6a54058f8f8b from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:52:09 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:52:09 user nova-compute[75083]:   <source dev="/dev/sdg"/>
Nov 29 05:52:09 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:52:09 user nova-compute[75083]:   <serial>d3f4708c-c8b0-495e-9eb4-5c01a957ebd5</serial>
Nov 29 05:52:09 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 05:52:09 user nova-compute[75083]: </disk>
Nov 29 05:52:09 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:52:09 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Successfully detached device vdb from instance b6d38a2c-a512-41f2-a7df-6a54058f8f8b from the persistent domain config.
Nov 29 05:52:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MafARzSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:52:09 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 05:52:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[212731f0-9852-42b5-bd36-3418e20d6a9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:52:09 user nova-compute[75083]: No targets found.
Nov 29 05:52:09 user nova-compute[75083]: iSNS:
Nov 29 05:52:09 user nova-compute[75083]: No targets found.
Nov 29 05:52:09 user nova-compute[75083]: STATIC:
Nov 29 05:52:09 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5
Nov 29 05:52:09 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:09 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:09 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256
Nov 29 05:52:09 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:09 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:09 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5
Nov 29 05:52:09 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:09 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:09 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e
Nov 29 05:52:09 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:09 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:09 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043
Nov 29 05:52:09 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:09 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:09 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611
Nov 29 05:52:09 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:09 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:09 user nova-compute[75083]: FIRMWARE:
Nov 29 05:52:09 user nova-compute[75083]: No targets found.
Nov 29 05:52:09 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:52:09 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:52:09 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba556a4-36fd-4c98-8354-41d4b276a696]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c439e761-873e-4f2f-9184-fac3e681110d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:52:09 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:52:09 user nova-compute[75083]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)
Nov 29 05:52:09 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:52:09 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:52:09 user nova-compute[75083]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:52:09 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:52:09 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:52:09 user nova-compute[75083]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)
Nov 29 05:52:09 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:52:09 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:52:09 user nova-compute[75083]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:52:09 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b83276d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5'): ({'sdg'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Removing single pathed devices sdg {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[111fdbaa-9818-4572-8ae4-76d8d11bc00f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e3cde2-2921-4b8b-8424-d557b2bc13c3]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Flushing IO for device /dev/sdg {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2416755f-417f-44f0-b2e1-9912e408ef77]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a40ea4-4b15-4e41-831f-b31832ede186]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] SCSI volumes sdg have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[540a0831-db32-42c9-b579-c29f9909b28e]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84f392c-2d35-43d0-bd64-9db9e068d40f]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5, portal: 172.16.0.220,3260]
Nov 29 05:52:09 user nova-compute[75083]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5, portal: 172.16.0.220,3260] successful.
Nov 29 05:52:09 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86b655c-4634-4906-86af-fc91f29527f6]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] <== disconnect_volume: return (381ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:52:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-36cd49ec-6e46-4dbe-8655-5f7a4592d0be req-17e00dd0-994d-4996-84cc-ea2ce37b99b9 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Received event network-vif-plugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-36cd49ec-6e46-4dbe-8655-5f7a4592d0be req-17e00dd0-994d-4996-84cc-ea2ce37b99b9 service nova] Acquiring lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-36cd49ec-6e46-4dbe-8655-5f7a4592d0be req-17e00dd0-994d-4996-84cc-ea2ce37b99b9 service nova] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-36cd49ec-6e46-4dbe-8655-5f7a4592d0be req-17e00dd0-994d-4996-84cc-ea2ce37b99b9 service nova] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-36cd49ec-6e46-4dbe-8655-5f7a4592d0be req-17e00dd0-994d-4996-84cc-ea2ce37b99b9 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] No waiting events found dispatching network-vif-plugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:52:10 user nova-compute[75083]: WARNING nova.compute.manager [req-36cd49ec-6e46-4dbe-8655-5f7a4592d0be req-17e00dd0-994d-4996-84cc-ea2ce37b99b9 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Received unexpected event network-vif-plugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 for instance with vm_state active and task_state rebuilding.
Nov 29 05:52:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-f540a871-cd7a-4120-b92f-af40a0812458 req-b8cefe1b-ee94-4f7e-9f6c-a1f8e46fb96b service nova] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Received event network-vif-plugged-607671f2-8606-44a1-8100-8b1406c05b4d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f540a871-cd7a-4120-b92f-af40a0812458 req-b8cefe1b-ee94-4f7e-9f6c-a1f8e46fb96b service nova] Acquiring lock "f3f2df31-d316-48a4-8d9e-c68c5349a739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f540a871-cd7a-4120-b92f-af40a0812458 req-b8cefe1b-ee94-4f7e-9f6c-a1f8e46fb96b service nova] Lock "f3f2df31-d316-48a4-8d9e-c68c5349a739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f540a871-cd7a-4120-b92f-af40a0812458 req-b8cefe1b-ee94-4f7e-9f6c-a1f8e46fb96b service nova] Lock "f3f2df31-d316-48a4-8d9e-c68c5349a739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-f540a871-cd7a-4120-b92f-af40a0812458 req-b8cefe1b-ee94-4f7e-9f6c-a1f8e46fb96b service nova] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] No waiting events found dispatching network-vif-plugged-607671f2-8606-44a1-8100-8b1406c05b4d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:52:10 user nova-compute[75083]: WARNING nova.compute.manager [req-f540a871-cd7a-4120-b92f-af40a0812458 req-b8cefe1b-ee94-4f7e-9f6c-a1f8e46fb96b service nova] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Received unexpected event network-vif-plugged-607671f2-8606-44a1-8100-8b1406c05b4d for instance with vm_state building and task_state spawning.
Nov 29 05:52:10 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Instance destroyed successfully.
Nov 29 05:52:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:50:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-767389487',display_name='tempest-ServerActionsTestOtherA-server-1845157183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-767389487',id=12,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfvHF6/oSNRPLODGah+lUX+h6/YktVuSfbjhiVUADedZo8ZZa8yTY3sj5iWRDCdXv2wxDvaROa6nC6uX8hHjhEFAijNYi3sdzIr+uRnWW/58teiEfkLjGJRSM5qLnzVvA==',key_name='tempest-keypair-720253988',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:50:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='95d0f3dd09bf436498e67d7bfdd904bf',ramdisk_id='',reservation_id='r-z46r3ddw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2114836332',owner_user_name='tempest-ServerActionsTestOtherA-2114836332-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:52:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbd7f863ad7c4229957c4b08601b5003',uuid=b6d38a2c-a512-41f2-a7df-6a54058f8f8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "address": "fa:16:3e:f6:1e:5c", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf04f87a-6d", "ovs_interfaceid": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converting VIF {"id": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "address": "fa:16:3e:f6:1e:5c", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf04f87a-6d", "ovs_interfaceid": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf04f87a-6d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG os_vif [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf04f87a-6d') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf04f87a-6d, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=020de7c2-3440-4313-b552-95c530deddaf) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:52:10 user nova-compute[75083]: INFO os_vif [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf04f87a-6d')
Nov 29 05:52:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MafARzSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:52:10 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 05:52:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd71d3e-8ee7-42e0-8f8b-be39cf9c39ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:52:10 user nova-compute[75083]: No targets found.
Nov 29 05:52:10 user nova-compute[75083]: iSNS:
Nov 29 05:52:10 user nova-compute[75083]: No targets found.
Nov 29 05:52:10 user nova-compute[75083]: STATIC:
Nov 29 05:52:10 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5
Nov 29 05:52:10 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:10 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:10 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256
Nov 29 05:52:10 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:10 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:10 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e
Nov 29 05:52:10 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:10 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:10 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043
Nov 29 05:52:10 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:10 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:10 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611
Nov 29 05:52:10 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:10 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:10 user nova-compute[75083]: FIRMWARE:
Nov 29 05:52:10 user nova-compute[75083]: No targets found.
Nov 29 05:52:10 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:52:10 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:52:10 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG nova.compute.manager [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:52:10 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Instance spawned successfully.
Nov 29 05:52:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba4729e-6a63-4f83-b1fe-7e214225d0f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[596c7964-2d30-49c3-8069-38dda7212da1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:52:10 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:52:10 user nova-compute[75083]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)
Nov 29 05:52:10 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:52:10 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:52:10 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:52:10 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:52:10 user nova-compute[75083]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)
Nov 29 05:52:10 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:52:10 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:52:10 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b83279a0>, {}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Disconnecting from: [] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.094s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] <== disconnect_volume: return (96ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:52:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:52:10 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Deleting instance files /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b_del
Nov 29 05:52:10 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Deletion of /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b_del complete
Nov 29 05:52:10 user nova-compute[75083]: INFO nova.compute.manager [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Took 6.80 seconds to spawn the instance on the hypervisor.
Nov 29 05:52:10 user nova-compute[75083]: DEBUG nova.compute.manager [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:52:11 user nova-compute[75083]: INFO nova.virt.block_device [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Booting with volume d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 at /dev/vdb
Nov 29 05:52:11 user nova-compute[75083]: INFO nova.compute.manager [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Took 8.25 seconds to build instance.
Nov 29 05:52:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4c0bde93-3770-4d18-b355-6d5c4daeef6f tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "f3f2df31-d316-48a4-8d9e-c68c5349a739" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.352s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG os_brick.utils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b23aac-fa24-46ad-8fdc-75c7daf71428]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c20f58-0f1a-4d8a-b92b-8b08a252305e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6703c6-b38e-4314-a0f3-56544eb5e11a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a30b2c8-c166-42aa-91ad-6cb80e82252b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:52:11 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:52:11 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f8562d-e805-401a-8570-9ba814d2ae25]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG os_brick.utils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:52:11 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Updating existing volume attachment record: bba1c1ae-7f5d-4f59-b104-a82e72c26fdb {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:52:13 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 47437526-c4e4-4a15-ba9b-51bbae17c77b is timed out.
Nov 29 05:52:13 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Successfully detached device vdc from instance 47437526-c4e4-4a15-ba9b-51bbae17c77b from the live domain config.
Nov 29 05:52:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTDptqIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:52:13 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:52:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[71971da9-4c9b-43d0-b144-20c220491e3e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:52:13 user nova-compute[75083]: No targets found.
Nov 29 05:52:13 user nova-compute[75083]: iSNS:
Nov 29 05:52:13 user nova-compute[75083]: No targets found.
Nov 29 05:52:13 user nova-compute[75083]: STATIC:
Nov 29 05:52:13 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5
Nov 29 05:52:13 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:13 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:13 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256
Nov 29 05:52:13 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:13 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:13 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e
Nov 29 05:52:13 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:13 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:13 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043
Nov 29 05:52:13 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:13 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:13 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611
Nov 29 05:52:13 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:13 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:13 user nova-compute[75083]: FIRMWARE:
Nov 29 05:52:13 user nova-compute[75083]: No targets found.
Nov 29 05:52:13 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:52:13 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:52:13 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b857e9-ef3a-4a13-afb1-5b251257fae6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[942503da-a7d3-49fd-ab79-245659b39c2d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:52:13 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:52:13 user nova-compute[75083]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)
Nov 29 05:52:13 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:52:13 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:52:13 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:52:13 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:52:13 user nova-compute[75083]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 (non-flash)
Nov 29 05:52:13 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:52:13 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:52:13 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b83d4430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611'): ({'sdd'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Removing single pathed devices sdd {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6802ae14-cd17-4671-b39c-87a08d4679bc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcd446b-f827-4e5a-b92a-1b87e881116e]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Flushing IO for device /dev/sdd {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b5e73a-2cf8-4ca7-90ae-1826dbd4faab]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b19cd7-eea7-48f4-8b0e-d907bd2f348a]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] SCSI volumes sdd have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d9d363-b26e-465a-9a0b-e47d80fa2a49]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c13540b-701d-423a-8f2f-315b5f41a89e]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611, portal: 172.16.0.220,3260]
Nov 29 05:52:13 user nova-compute[75083]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611, portal: 172.16.0.220,3260] successful.
Nov 29 05:52:13 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af19f30c-72b8-4314-8bd3-1ca696377611 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[00744dd8-d1df-483c-bc93-8dfd3c04171b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] <== disconnect_volume: return (384ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:52:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:52:15 user nova-compute[75083]: DEBUG nova.objects.instance [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'flavor' on Instance uuid 47437526-c4e4-4a15-ba9b-51bbae17c77b {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:52:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1e44c921-3daa-432f-a1b5-b646022227a7 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.193s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:52:19 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Creating image(s)
Nov 29 05:52:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "/opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "/opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.184s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.203s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.compute.manager [req-d2a4b377-5672-42fc-b0d6-153f2a7da655 req-3d26f8d3-f803-44d5-8eb1-bc3f79dd4df4 service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Received event network-changed-e58bdd4f-988b-40e7-867b-25c7c306f96f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.compute.manager [req-d2a4b377-5672-42fc-b0d6-153f2a7da655 req-3d26f8d3-f803-44d5-8eb1-bc3f79dd4df4 service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Refreshing instance network info cache due to event network-changed-e58bdd4f-988b-40e7-867b-25c7c306f96f. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d2a4b377-5672-42fc-b0d6-153f2a7da655 req-3d26f8d3-f803-44d5-8eb1-bc3f79dd4df4 service nova] Acquiring lock "refresh_cache-eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d2a4b377-5672-42fc-b0d6-153f2a7da655 req-3d26f8d3-f803-44d5-8eb1-bc3f79dd4df4 service nova] Acquired lock "refresh_cache-eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.network.neutron [req-d2a4b377-5672-42fc-b0d6-153f2a7da655 req-3d26f8d3-f803-44d5-8eb1-bc3f79dd4df4 service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Refreshing network info cache for port e58bdd4f-988b-40e7-867b-25c7c306f96f {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk 1073741824" returned: 0 in 0.081s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.184s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Cannot resize image /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Ensure instance console log exists: /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Start _get_guest_xml network_info=[{"id": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "address": "fa:16:3e:f6:1e:5c", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf04f87a-6d", "ovs_interfaceid": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'bba1c1ae-7f5d-4f59-b104-a82e72c26fdb', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MafARzSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b6d38a2c-a512-41f2-a7df-6a54058f8f8b', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3f4708c-c8b0-495e-9eb4-5c01a957ebd5', 'serial': 'd3f4708c-c8b0-495e-9eb4-5c01a957ebd5'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:52:20 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 05:52:20 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.objects.instance [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lazy-loading 'vcpu_model' on Instance uuid b6d38a2c-a512-41f2-a7df-6a54058f8f8b {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MafARzSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:52:20 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 05:52:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:52:20 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 05:52:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:52:20 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69010b2-97c0-4e74-9e17-b377c24a6181]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:52:20 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56f1943-2661-4d9d-a59b-203389c8c76e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5] added
Nov 29 05:52:20 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cebf44-1312-451d-b548-0ad638153be6]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ad6070-761e-48a2-87ec-51e0a18c2716]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MafARzSH {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MafARzSH" returned: 0 in 0.039s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4370a83-e779-45f3-9816-5e0abccc87ba]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MafARzSH'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4948991d-bfb5-4245-a9a6-fae332280a31]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e2723e-3205-4d89-b2cb-ae1e7fc5400b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:52:20 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:52:20 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:52:20 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:52:20 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:52:20 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:52:20 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:52:20 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:52:20 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a7e29b-665b-4f1c-932f-8374b8fe1e29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5, portal: 172.16.0.220,3260]
Nov 29 05:52:20 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5, portal: 172.16.0.220,3260] successful.
Nov 29 05:52:20 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1789e415-51f4-4c88-b8b1-ee8d42f49058]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:21 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc757f1e-c3eb-491d-9bec-9cce238f9bdc]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:52:21 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:52:21 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:52:21 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:52:21 user nova-compute[75083]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:52:21 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:52:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:52:21 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:52:21 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:52:21 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:52:21 user nova-compute[75083]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:52:21 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:52:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:52:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:52:21 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:52:21 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:52:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:21 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4264dc3-5c4e-40d1-8bd7-4b5043c5f9d9]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:21 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:52:21 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MafARzSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:52:21 user nova-compute[75083]: DEBUG nova.network.neutron [req-d2a4b377-5672-42fc-b0d6-153f2a7da655 req-3d26f8d3-f803-44d5-8eb1-bc3f79dd4df4 service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Updated VIF entry in instance network info cache for port e58bdd4f-988b-40e7-867b-25c7c306f96f. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:52:21 user nova-compute[75083]: DEBUG nova.network.neutron [req-d2a4b377-5672-42fc-b0d6-153f2a7da655 req-3d26f8d3-f803-44d5-8eb1-bc3f79dd4df4 service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Updating instance_info_cache with network_info: [{"id": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "address": "fa:16:3e:0f:c8:f5", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape58bdd4f-98", "ovs_interfaceid": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:52:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d2a4b377-5672-42fc-b0d6-153f2a7da655 req-3d26f8d3-f803-44d5-8eb1-bc3f79dd4df4 service nova] Releasing lock "refresh_cache-eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23137376234383463', 'path': '/dev/sdd'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137376234383463', 'path': '/dev/sdd'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T05:50:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-767389487',display_name='tempest-ServerActionsTestOtherA-server-1845157183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-767389487',id=12,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfvHF6/oSNRPLODGah+lUX+h6/YktVuSfbjhiVUADedZo8ZZa8yTY3sj5iWRDCdXv2wxDvaROa6nC6uX8hHjhEFAijNYi3sdzIr+uRnWW/58teiEfkLjGJRSM5qLnzVvA==',key_name='tempest-keypair-720253988',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:50:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='95d0f3dd09bf436498e67d7bfdd904bf',ramdisk_id='',reservation_id='r-z46r3ddw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2114836332',owner_user_name='tempest-ServerActionsTestOtherA-2114836332-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:52:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbd7f863ad7c4229957c4b08601b5003',uuid=b6d38a2c-a512-41f2-a7df-6a54058f8f8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "address": "fa:16:3e:f6:1e:5c", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf04f87a-6d", "ovs_interfaceid": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converting VIF {"id": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "address": "fa:16:3e:f6:1e:5c", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf04f87a-6d", "ovs_interfaceid": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf04f87a-6d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:52:22 user nova-compute[75083]:   <uuid>b6d38a2c-a512-41f2-a7df-6a54058f8f8b</uuid>
Nov 29 05:52:22 user nova-compute[75083]:   <name>instance-0000000c</name>
Nov 29 05:52:22 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:52:22 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:52:22 user nova-compute[75083]:   <metadata>
Nov 29 05:52:22 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:52:22 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:52:22 user nova-compute[75083]:       <nova:name>tempest-ServerActionsTestOtherA-server-1845157183</nova:name>
Nov 29 05:52:22 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:52:20</nova:creationTime>
Nov 29 05:52:22 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:52:22 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:52:22 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:52:22 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:52:22 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:52:22 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:52:22 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:52:22 user nova-compute[75083]:       <nova:owner>
Nov 29 05:52:22 user nova-compute[75083]:         <nova:user uuid="cbd7f863ad7c4229957c4b08601b5003">tempest-ServerActionsTestOtherA-2114836332-project-member</nova:user>
Nov 29 05:52:22 user nova-compute[75083]:         <nova:project uuid="95d0f3dd09bf436498e67d7bfdd904bf">tempest-ServerActionsTestOtherA-2114836332</nova:project>
Nov 29 05:52:22 user nova-compute[75083]:       </nova:owner>
Nov 29 05:52:22 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:52:22 user nova-compute[75083]:       <nova:ports>
Nov 29 05:52:22 user nova-compute[75083]:         <nova:port uuid="cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3">
Nov 29 05:52:22 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 05:52:22 user nova-compute[75083]:         </nova:port>
Nov 29 05:52:22 user nova-compute[75083]:       </nova:ports>
Nov 29 05:52:22 user nova-compute[75083]:     </nova:instance>
Nov 29 05:52:22 user nova-compute[75083]:   </metadata>
Nov 29 05:52:22 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:52:22 user nova-compute[75083]:     <system>
Nov 29 05:52:22 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:52:22 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:52:22 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:52:22 user nova-compute[75083]:       <entry name="serial">b6d38a2c-a512-41f2-a7df-6a54058f8f8b</entry>
Nov 29 05:52:22 user nova-compute[75083]:       <entry name="uuid">b6d38a2c-a512-41f2-a7df-6a54058f8f8b</entry>
Nov 29 05:52:22 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:52:22 user nova-compute[75083]:     </system>
Nov 29 05:52:22 user nova-compute[75083]:   </sysinfo>
Nov 29 05:52:22 user nova-compute[75083]:   <os>
Nov 29 05:52:22 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:52:22 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:52:22 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:52:22 user nova-compute[75083]:   </os>
Nov 29 05:52:22 user nova-compute[75083]:   <features>
Nov 29 05:52:22 user nova-compute[75083]:     <acpi/>
Nov 29 05:52:22 user nova-compute[75083]:     <apic/>
Nov 29 05:52:22 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:52:22 user nova-compute[75083]:   </features>
Nov 29 05:52:22 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:52:22 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:52:22 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:52:22 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:52:22 user nova-compute[75083]:   </clock>
Nov 29 05:52:22 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:52:22 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:52:22 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:52:22 user nova-compute[75083]:   </cpu>
Nov 29 05:52:22 user nova-compute[75083]:   <devices>
Nov 29 05:52:22 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:52:22 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:52:22 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk"/>
Nov 29 05:52:22 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:52:22 user nova-compute[75083]:     </disk>
Nov 29 05:52:22 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 05:52:22 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:52:22 user nova-compute[75083]:       <source dev="/dev/sdd"/>
Nov 29 05:52:22 user nova-compute[75083]:       <target dev="vdb" bus="virtio"/>
Nov 29 05:52:22 user nova-compute[75083]:       <serial>d3f4708c-c8b0-495e-9eb4-5c01a957ebd5</serial>
Nov 29 05:52:22 user nova-compute[75083]:     </disk>
Nov 29 05:52:22 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:52:22 user nova-compute[75083]:       <mac address="fa:16:3e:f6:1e:5c"/>
Nov 29 05:52:22 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:52:22 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:52:22 user nova-compute[75083]:       <target dev="tapcf04f87a-6d"/>
Nov 29 05:52:22 user nova-compute[75083]:     </interface>
Nov 29 05:52:22 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:52:22 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/console.log" append="off"/>
Nov 29 05:52:22 user nova-compute[75083]:     </serial>
Nov 29 05:52:22 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:52:22 user nova-compute[75083]:     <video>
Nov 29 05:52:22 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:52:22 user nova-compute[75083]:     </video>
Nov 29 05:52:22 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:52:22 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:52:22 user nova-compute[75083]:     </rng>
Nov 29 05:52:22 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:52:22 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:52:22 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:52:22 user nova-compute[75083]:     </memballoon>
Nov 29 05:52:22 user nova-compute[75083]:   </devices>
Nov 29 05:52:22 user nova-compute[75083]: </domain>
Nov 29 05:52:22 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T05:50:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-767389487',display_name='tempest-ServerActionsTestOtherA-server-1845157183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-767389487',id=12,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfvHF6/oSNRPLODGah+lUX+h6/YktVuSfbjhiVUADedZo8ZZa8yTY3sj5iWRDCdXv2wxDvaROa6nC6uX8hHjhEFAijNYi3sdzIr+uRnWW/58teiEfkLjGJRSM5qLnzVvA==',key_name='tempest-keypair-720253988',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:50:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='95d0f3dd09bf436498e67d7bfdd904bf',ramdisk_id='',reservation_id='r-z46r3ddw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2114836332',owner_user_name='tempest-ServerActionsTestOtherA-2114836332-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:52:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbd7f863ad7c4229957c4b08601b5003',uuid=b6d38a2c-a512-41f2-a7df-6a54058f8f8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "address": "fa:16:3e:f6:1e:5c", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf04f87a-6d", "ovs_interfaceid": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converting VIF {"id": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "address": "fa:16:3e:f6:1e:5c", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf04f87a-6d", "ovs_interfaceid": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf04f87a-6d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG os_vif [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf04f87a-6d') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'faee9eb5-f060-56db-bfdd-8af10be93d01', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf04f87a-6d, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf04f87a-6d, col_values=(('qos', UUID('9a4c555d-d015-4a21-937d-117ccd8695a8')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf04f87a-6d, col_values=(('external_ids', {'iface-id': 'cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:1e:5c', 'vm-uuid': 'b6d38a2c-a512-41f2-a7df-6a54058f8f8b'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:22 user nova-compute[75083]: INFO os_vif [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf04f87a-6d')
Nov 29 05:52:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] No VIF found with MAC fa:16:3e:f6:1e:5c, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-23c27574-ad79-4def-8701-6105ae731f47 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquiring lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-23c27574-ad79-4def-8701-6105ae731f47 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG nova.objects.instance [None req-23c27574-ad79-4def-8701-6105ae731f47 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lazy-loading 'flavor' on Instance uuid eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:52:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-23c27574-ad79-4def-8701-6105ae731f47 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-23c27574-ad79-4def-8701-6105ae731f47 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquiring lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-23c27574-ad79-4def-8701-6105ae731f47 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:23 user nova-compute[75083]: INFO nova.compute.manager [None req-23c27574-ad79-4def-8701-6105ae731f47 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Attaching volume ac10221b-5455-4c4a-847a-1f0009a4d8e8 to /dev/vdb
Nov 29 05:52:23 user nova-compute[75083]: DEBUG os_brick.utils [None req-23c27574-ad79-4def-8701-6105ae731f47 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c50ec2-f14c-4a61-9b0f-6266be740f92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f926a0a-0288-4cec-a8ca-8dfe43c20aa6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ac528b-2a85-4bc5-9e98-8029acd6801f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[890e13bc-3edf-413c-a502-751bfc1f2e62]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-23c27574-ad79-4def-8701-6105ae731f47 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-23c27574-ad79-4def-8701-6105ae731f47 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23c27574-ad79-4def-8701-6105ae731f47 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:52:23 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:52:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04c2423-e95d-4fa6-9251-27a364d0a3da]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-23c27574-ad79-4def-8701-6105ae731f47 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-23c27574-ad79-4def-8701-6105ae731f47 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-23c27574-ad79-4def-8701-6105ae731f47 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG os_brick.utils [None req-23c27574-ad79-4def-8701-6105ae731f47 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-23c27574-ad79-4def-8701-6105ae731f47 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Updating existing volume attachment record: f9c8f542-419f-4f8e-8c97-ac8c2265cc07 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:24 user nova-compute[75083]: DEBUG nova.compute.manager [req-a4b21374-ef9d-406f-93a3-a5b7aa94ae91 req-22b64962-4d2a-4431-b0a1-0b63858904cd service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Received event network-vif-plugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a4b21374-ef9d-406f-93a3-a5b7aa94ae91 req-22b64962-4d2a-4431-b0a1-0b63858904cd service nova] Acquiring lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a4b21374-ef9d-406f-93a3-a5b7aa94ae91 req-22b64962-4d2a-4431-b0a1-0b63858904cd service nova] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a4b21374-ef9d-406f-93a3-a5b7aa94ae91 req-22b64962-4d2a-4431-b0a1-0b63858904cd service nova] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:24 user nova-compute[75083]: DEBUG nova.compute.manager [req-a4b21374-ef9d-406f-93a3-a5b7aa94ae91 req-22b64962-4d2a-4431-b0a1-0b63858904cd service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] No waiting events found dispatching network-vif-plugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:52:24 user nova-compute[75083]: WARNING nova.compute.manager [req-a4b21374-ef9d-406f-93a3-a5b7aa94ae91 req-22b64962-4d2a-4431-b0a1-0b63858904cd service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Received unexpected event network-vif-plugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 05:52:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-9ae2c446-2a82-4612-b110-eafc448d717d req-c9388681-0fbe-45d6-98ca-527101a2e3b4 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Received event network-vif-plugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9ae2c446-2a82-4612-b110-eafc448d717d req-c9388681-0fbe-45d6-98ca-527101a2e3b4 service nova] Acquiring lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9ae2c446-2a82-4612-b110-eafc448d717d req-c9388681-0fbe-45d6-98ca-527101a2e3b4 service nova] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9ae2c446-2a82-4612-b110-eafc448d717d req-c9388681-0fbe-45d6-98ca-527101a2e3b4 service nova] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-9ae2c446-2a82-4612-b110-eafc448d717d req-c9388681-0fbe-45d6-98ca-527101a2e3b4 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] No waiting events found dispatching network-vif-plugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:52:26 user nova-compute[75083]: WARNING nova.compute.manager [req-9ae2c446-2a82-4612-b110-eafc448d717d req-c9388681-0fbe-45d6-98ca-527101a2e3b4 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Received unexpected event network-vif-plugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 05:52:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:52:26 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Instance spawned successfully.
Nov 29 05:52:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:52:26 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e6d49806-cecd-473a-b92f-9255868d35c7 is timed out.
Nov 29 05:52:26 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Successfully detached device vdb from instance e6d49806-cecd-473a-b92f-9255868d35c7 from the live domain config.
Nov 29 05:52:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBfoehTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:52:26 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:52:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[da658bcb-ed75-441c-9a4e-436e20316543]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:52:26 user nova-compute[75083]: No targets found.
Nov 29 05:52:26 user nova-compute[75083]: iSNS:
Nov 29 05:52:26 user nova-compute[75083]: No targets found.
Nov 29 05:52:26 user nova-compute[75083]: STATIC:
Nov 29 05:52:26 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5
Nov 29 05:52:26 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:26 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:26 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256
Nov 29 05:52:26 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:26 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:26 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5
Nov 29 05:52:26 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:26 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:26 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e
Nov 29 05:52:26 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:26 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:26 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043
Nov 29 05:52:26 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:26 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:26 user nova-compute[75083]: FIRMWARE:
Nov 29 05:52:26 user nova-compute[75083]: No targets found.
Nov 29 05:52:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:52:26 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:52:26 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ce06b7-6e1d-4893-95b3-cd376adab9b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG nova.objects.instance [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75083) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d4c468-4575-4645-b8c4-9e5a4fed2975]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:52:26 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:52:26 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:52:26 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:52:26 user nova-compute[75083]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:52:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:52:26 user nova-compute[75083]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e (non-flash)
Nov 29 05:52:26 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:52:26 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:52:26 user nova-compute[75083]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:52:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b83e7be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e'): ({'sdc'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Removing single pathed devices sdc {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[21468304-c773-4edd-83a6-8bd288f12e7c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[97eb2e1e-f020-46ef-bf18-85d29b2d7fc9]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Flushing IO for device /dev/sdc {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1ac3830-251f-4853-bbae-afd757c58a8b tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.080s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.028s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ccd994-abee-4fbd-bddf-9aa3944a1eab]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[334433a2-8495-46e9-8350-3c20f46126c3]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a97b4e-e94a-4b25-a009-5d28f55efb7e]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b034c6a5-004a-4c80-8148-cbafc78c6b60]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e, portal: 172.16.0.220,3260]
Nov 29 05:52:26 user nova-compute[75083]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e, portal: 172.16.0.220,3260] successful.
Nov 29 05:52:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e200b1ae-3a3c-42f0-af89-b218ba46537e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb5c4b8-ede0-47b6-aae2-e6597e0d12dc]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] <== disconnect_volume: return (361ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:52:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:52:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:27 user nova-compute[75083]: DEBUG nova.objects.instance [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'flavor' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:52:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0d075d3d-f29c-4df3-9bf2-780e94d71ca2 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "e6d49806-cecd-473a-b92f-9255868d35c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.164s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.volume.cinder [None req-23c27574-ad79-4def-8701-6105ae731f47 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Update attachment failed for attachment f9c8f542-419f-4f8e-8c97-ac8c2265cc07. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6e0f93da-80ab-4ad7-aa98-1be599b5d39b) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6e0f93da-80ab-4ad7-aa98-1be599b5d39b)
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [None req-23c27574-ad79-4def-8701-6105ae731f47 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Failed to attach ac10221b-5455-4c4a-847a-1f0009a4d8e8 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6e0f93da-80ab-4ad7-aa98-1be599b5d39b)
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Traceback (most recent call last):
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]     ret_val = method(obj, context, *args, **kwargs)
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]     self._do_attach(context, instance, volume, volume_api,
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]     self._volume_attach(context, volume, connector, instance,
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]     connection_info = volume_api.attachment_update(
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]     res = method(self, ctx, *args, **kwargs)
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]     with excutils.save_and_reraise_exception():
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]     self.force_reraise()
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]     raise self.value
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]     context, '3.44', skip_version_check=True).attachments.update(
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]     return method.func(obj, *args, **kwargs)
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]     resp = self._update('/attachments/%s' % id, body)
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]     return self._cs_request(url, 'PUT', **kwargs)
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]     return self.request(url, method, **kwargs)
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d]     raise exceptions.from_response(resp, body)
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6e0f93da-80ab-4ad7-aa98-1be599b5d39b)
Nov 29 05:52:28 user nova-compute[75083]: ERROR nova.compute.manager [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] 
Nov 29 05:52:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-23c27574-ad79-4def-8701-6105ae731f47 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.198s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server [None req-23c27574-ad79-4def-8701-6105ae731f47 tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6e0f93da-80ab-4ad7-aa98-1be599b5d39b)
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6e0f93da-80ab-4ad7-aa98-1be599b5d39b)
Nov 29 05:52:28 user nova-compute[75083]: ERROR oslo_messaging.rpc.server 
Nov 29 05:52:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-94f657b3-2897-44a8-9ab3-9780116cfd18 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-94f657b3-2897-44a8-9ab3-9780116cfd18 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "e6d49806-cecd-473a-b92f-9255868d35c7" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-94f657b3-2897-44a8-9ab3-9780116cfd18 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:52:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-94f657b3-2897-44a8-9ab3-9780116cfd18 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75083) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 29 05:52:28 user nova-compute[75083]: DEBUG nova.objects.instance [None req-94f657b3-2897-44a8-9ab3-9780116cfd18 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'flavor' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:52:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:28 user nova-compute[75083]: INFO nova.compute.manager [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Detaching volume 7cabbe02-0d11-483c-b05e-9d94c28862a5
Nov 29 05:52:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-286453b6-cfbf-4cbc-8f92-682bc8789953 req-67479ab9-614a-4dfd-a596-7820669e98cd service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received event network-vif-unplugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-286453b6-cfbf-4cbc-8f92-682bc8789953 req-67479ab9-614a-4dfd-a596-7820669e98cd service nova] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-286453b6-cfbf-4cbc-8f92-682bc8789953 req-67479ab9-614a-4dfd-a596-7820669e98cd service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-286453b6-cfbf-4cbc-8f92-682bc8789953 req-67479ab9-614a-4dfd-a596-7820669e98cd service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-286453b6-cfbf-4cbc-8f92-682bc8789953 req-67479ab9-614a-4dfd-a596-7820669e98cd service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] No waiting events found dispatching network-vif-unplugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:52:28 user nova-compute[75083]: WARNING nova.compute.manager [req-286453b6-cfbf-4cbc-8f92-682bc8789953 req-67479ab9-614a-4dfd-a596-7820669e98cd service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received unexpected event network-vif-unplugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 for instance with vm_state active and task_state powering-off.
Nov 29 05:52:28 user nova-compute[75083]: INFO nova.virt.block_device [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Attempting to driver detach volume 7cabbe02-0d11-483c-b05e-9d94c28862a5 from mountpoint /dev/vdb
Nov 29 05:52:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Attempting to detach device vdb from instance ee1bba24-17d0-4fc3-8bff-1337d86cc9be from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 05:52:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:52:28 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:52:28 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 05:52:28 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:52:28 user nova-compute[75083]:   <serial>7cabbe02-0d11-483c-b05e-9d94c28862a5</serial>
Nov 29 05:52:28 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 05:52:28 user nova-compute[75083]: </disk>
Nov 29 05:52:28 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:52:28 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Successfully detached device vdb from instance ee1bba24-17d0-4fc3-8bff-1337d86cc9be from the persistent domain config.
Nov 29 05:52:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ee1bba24-17d0-4fc3-8bff-1337d86cc9be from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 05:52:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:52:28 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:52:28 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 05:52:28 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:52:28 user nova-compute[75083]:   <serial>7cabbe02-0d11-483c-b05e-9d94c28862a5</serial>
Nov 29 05:52:28 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 05:52:28 user nova-compute[75083]: </disk>
Nov 29 05:52:28 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:52:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:29 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ee1bba24-17d0-4fc3-8bff-1337d86cc9be {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 05:52:29 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Instance destroyed successfully.
Nov 29 05:52:29 user nova-compute[75083]: DEBUG nova.compute.manager [None req-94f657b3-2897-44a8-9ab3-9780116cfd18 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:52:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-94f657b3-2897-44a8-9ab3-9780116cfd18 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "e6d49806-cecd-473a-b92f-9255868d35c7" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.150s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG nova.compute.manager [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG nova.compute.manager [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] No waiting events found dispatching network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:52:30 user nova-compute[75083]: WARNING nova.compute.manager [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received unexpected event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 for instance with vm_state stopped and task_state None.
Nov 29 05:52:30 user nova-compute[75083]: DEBUG nova.compute.manager [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG nova.compute.manager [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] No waiting events found dispatching network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:52:30 user nova-compute[75083]: WARNING nova.compute.manager [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received unexpected event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 for instance with vm_state stopped and task_state None.
Nov 29 05:52:30 user nova-compute[75083]: DEBUG nova.compute.manager [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG nova.compute.manager [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] No waiting events found dispatching network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:52:30 user nova-compute[75083]: WARNING nova.compute.manager [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received unexpected event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 for instance with vm_state stopped and task_state None.
Nov 29 05:52:30 user nova-compute[75083]: DEBUG nova.compute.manager [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received event network-vif-unplugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG nova.compute.manager [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] No waiting events found dispatching network-vif-unplugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:52:30 user nova-compute[75083]: WARNING nova.compute.manager [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received unexpected event network-vif-unplugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 for instance with vm_state stopped and task_state None.
Nov 29 05:52:30 user nova-compute[75083]: DEBUG nova.compute.manager [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:30 user nova-compute[75083]: DEBUG nova.compute.manager [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] No waiting events found dispatching network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:52:30 user nova-compute[75083]: WARNING nova.compute.manager [req-aa29d732-776a-4db2-9108-15bd471abea2 req-0323be27-4d07-4db1-bfb0-51656720f031 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received unexpected event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 for instance with vm_state stopped and task_state None.
Nov 29 05:52:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid ee1bba24-17d0-4fc3-8bff-1337d86cc9be {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid 47437526-c4e4-4a15-ba9b-51bbae17c77b {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid 161c6455-90ce-4c40-a33e-7f582989135d {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid b6d38a2c-a512-41f2-a7df-6a54058f8f8b {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid 2acbda14-e4bc-49ac-81e2-ce28bc3878d4 {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid fb8244c4-f2a7-4ad8-a210-0f62c165a4dc {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid 7c693239-226b-42b1-928e-9a8b7a2a114c {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid cb63619b-6d75-49d0-80ef-d98aa21b7d4a {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid f3f2df31-d316-48a4-8d9e-c68c5349a739 {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "e6d49806-cecd-473a-b92f-9255868d35c7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "47437526-c4e4-4a15-ba9b-51bbae17c77b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "161c6455-90ce-4c40-a33e-7f582989135d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "161c6455-90ce-4c40-a33e-7f582989135d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "7c693239-226b-42b1-928e-9a8b7a2a114c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "f3f2df31-d316-48a4-8d9e-c68c5349a739" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "f3f2df31-d316-48a4-8d9e-c68c5349a739" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "e6d49806-cecd-473a-b92f-9255868d35c7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "161c6455-90ce-4c40-a33e-7f582989135d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "f3f2df31-d316-48a4-8d9e-c68c5349a739" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "47437526-c4e4-4a15-ba9b-51bbae17c77b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:43 user nova-compute[75083]: INFO nova.compute.manager [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Terminating instance
Nov 29 05:52:43 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:52:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-18fb51a1-3d4f-4f61-ac06-b9a0fcaa562f req-32a2ab22-1c62-4caa-b2e0-ac118a4720b7 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received event network-vif-unplugged-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-18fb51a1-3d4f-4f61-ac06-b9a0fcaa562f req-32a2ab22-1c62-4caa-b2e0-ac118a4720b7 service nova] Acquiring lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-18fb51a1-3d4f-4f61-ac06-b9a0fcaa562f req-32a2ab22-1c62-4caa-b2e0-ac118a4720b7 service nova] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-18fb51a1-3d4f-4f61-ac06-b9a0fcaa562f req-32a2ab22-1c62-4caa-b2e0-ac118a4720b7 service nova] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-18fb51a1-3d4f-4f61-ac06-b9a0fcaa562f req-32a2ab22-1c62-4caa-b2e0-ac118a4720b7 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] No waiting events found dispatching network-vif-unplugged-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:52:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-18fb51a1-3d4f-4f61-ac06-b9a0fcaa562f req-32a2ab22-1c62-4caa-b2e0-ac118a4720b7 service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received event network-vif-unplugged-8c103582-6856-45ff-ac2b-7a30d3138c75 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:52:44 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Instance destroyed successfully.
Nov 29 05:52:44 user nova-compute[75083]: DEBUG nova.objects.instance [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'resources' on Instance uuid 47437526-c4e4-4a15-ba9b-51bbae17c77b {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:52:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T05:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-265924046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-265924046',id=4,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9NfR5g6BHWgn8iHt68HXMvMqojnsSO+GsTi9O2T9R8+QSKnFuCWKp/x2ygTv5FkO6YZWsNIF2DV0Sb3TLFZytdS0uwbMQGN94Yb7Idf4fw6TKFh/TgmCvwWzSqCHn5Tw==',key_name='tempest-keypair-1939493904',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:50:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1c63c54083f4a0eba38539e7c196d61',ramdisk_id='',reservation_id='r-1epz6053',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-961204558',owner_user_name='tempest-AttachVolumeShelveTestJSON-961204558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:50:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4e6b7adfb1b469ab5c6c3f26633272a',uuid=47437526-c4e4-4a15-ba9b-51bbae17c77b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:52:44 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converting VIF {"id": "8c103582-6856-45ff-ac2b-7a30d3138c75", "address": "fa:16:3e:bd:74:88", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c103582-68", "ovs_interfaceid": "8c103582-6856-45ff-ac2b-7a30d3138c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:52:44 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:74:88,bridge_name='br-int',has_traffic_filtering=True,id=8c103582-6856-45ff-ac2b-7a30d3138c75,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c103582-68') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:52:44 user nova-compute[75083]: DEBUG os_vif [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:74:88,bridge_name='br-int',has_traffic_filtering=True,id=8c103582-6856-45ff-ac2b-7a30d3138c75,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c103582-68') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:52:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c103582-68, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:52:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:52:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e470b3ff-f9d7-4ac3-9f41-3590b506fbee) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:52:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:52:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:44 user nova-compute[75083]: INFO os_vif [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:74:88,bridge_name='br-int',has_traffic_filtering=True,id=8c103582-6856-45ff-ac2b-7a30d3138c75,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c103582-68')
Nov 29 05:52:44 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Deleting instance files /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b_del
Nov 29 05:52:44 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Deletion of /opt/stack/data/nova/instances/47437526-c4e4-4a15-ba9b-51bbae17c77b_del complete
Nov 29 05:52:44 user nova-compute[75083]: INFO nova.compute.manager [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 05:52:44 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 05:52:44 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 05:52:44 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 05:52:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:44 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:52:44 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Took 0.72 seconds to deallocate network for instance.
Nov 29 05:52:44 user nova-compute[75083]: DEBUG nova.compute.manager [req-712e51a0-26af-446d-8d92-667780b09b2e req-bcfca9cb-22a5-49be-bedd-bb9ba1f9282a service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received event network-vif-deleted-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:44 user nova-compute[75083]: INFO nova.compute.manager [req-712e51a0-26af-446d-8d92-667780b09b2e req-bcfca9cb-22a5-49be-bedd-bb9ba1f9282a service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Neutron deleted interface 8c103582-6856-45ff-ac2b-7a30d3138c75; detaching it from the instance and deleting it from the info cache
Nov 29 05:52:44 user nova-compute[75083]: DEBUG nova.network.neutron [req-712e51a0-26af-446d-8d92-667780b09b2e req-bcfca9cb-22a5-49be-bedd-bb9ba1f9282a service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:52:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-712e51a0-26af-446d-8d92-667780b09b2e req-bcfca9cb-22a5-49be-bedd-bb9ba1f9282a service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Detach interface failed, port_id=8c103582-6856-45ff-ac2b-7a30d3138c75, reason: Instance 47437526-c4e4-4a15-ba9b-51bbae17c77b could not be found. {{(pid=75083) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 05:52:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:45 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:52:45 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:52:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:45 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Deleted allocations for instance 47437526-c4e4-4a15-ba9b-51bbae17c77b
Nov 29 05:52:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d84ffb8b-f8b6-4676-b169-99879bb7a0b1 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.151s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-846ddcb6-f929-4e94-9958-ca6019e1a4cb req-dcbcf997-bd0e-4939-91d7-74b9a3ba68af service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received event network-vif-plugged-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-846ddcb6-f929-4e94-9958-ca6019e1a4cb req-dcbcf997-bd0e-4939-91d7-74b9a3ba68af service nova] Acquiring lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-846ddcb6-f929-4e94-9958-ca6019e1a4cb req-dcbcf997-bd0e-4939-91d7-74b9a3ba68af service nova] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-846ddcb6-f929-4e94-9958-ca6019e1a4cb req-dcbcf997-bd0e-4939-91d7-74b9a3ba68af service nova] Lock "47437526-c4e4-4a15-ba9b-51bbae17c77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-846ddcb6-f929-4e94-9958-ca6019e1a4cb req-dcbcf997-bd0e-4939-91d7-74b9a3ba68af service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] No waiting events found dispatching network-vif-plugged-8c103582-6856-45ff-ac2b-7a30d3138c75 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:52:45 user nova-compute[75083]: WARNING nova.compute.manager [req-846ddcb6-f929-4e94-9958-ca6019e1a4cb req-dcbcf997-bd0e-4939-91d7-74b9a3ba68af service nova] [instance: 47437526-c4e4-4a15-ba9b-51bbae17c77b] Received unexpected event network-vif-plugged-8c103582-6856-45ff-ac2b-7a30d3138c75 for instance with vm_state deleted and task_state None.
Nov 29 05:52:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:48 user nova-compute[75083]: DEBUG nova.compute.manager [req-8dd3936f-f76e-4c0f-a6f4-a9588ad7a282 req-4012923d-2ca6-42cf-98a7-a116519de202 service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Received event network-changed-85f6598a-8c09-4f42-9eef-143573c095f9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:52:48 user nova-compute[75083]: DEBUG nova.compute.manager [req-8dd3936f-f76e-4c0f-a6f4-a9588ad7a282 req-4012923d-2ca6-42cf-98a7-a116519de202 service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Refreshing instance network info cache due to event network-changed-85f6598a-8c09-4f42-9eef-143573c095f9. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:52:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8dd3936f-f76e-4c0f-a6f4-a9588ad7a282 req-4012923d-2ca6-42cf-98a7-a116519de202 service nova] Acquiring lock "refresh_cache-2acbda14-e4bc-49ac-81e2-ce28bc3878d4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:52:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8dd3936f-f76e-4c0f-a6f4-a9588ad7a282 req-4012923d-2ca6-42cf-98a7-a116519de202 service nova] Acquired lock "refresh_cache-2acbda14-e4bc-49ac-81e2-ce28bc3878d4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:52:48 user nova-compute[75083]: DEBUG nova.network.neutron [req-8dd3936f-f76e-4c0f-a6f4-a9588ad7a282 req-4012923d-2ca6-42cf-98a7-a116519de202 service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Refreshing network info cache for port 85f6598a-8c09-4f42-9eef-143573c095f9 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:52:48 user nova-compute[75083]: DEBUG nova.network.neutron [req-8dd3936f-f76e-4c0f-a6f4-a9588ad7a282 req-4012923d-2ca6-42cf-98a7-a116519de202 service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Updated VIF entry in instance network info cache for port 85f6598a-8c09-4f42-9eef-143573c095f9. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:52:48 user nova-compute[75083]: DEBUG nova.network.neutron [req-8dd3936f-f76e-4c0f-a6f4-a9588ad7a282 req-4012923d-2ca6-42cf-98a7-a116519de202 service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Updating instance_info_cache with network_info: [{"id": "85f6598a-8c09-4f42-9eef-143573c095f9", "address": "fa:16:3e:8d:52:51", "network": {"id": "6c528f9c-4754-47e2-91db-2d70336b8dd7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-743033576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5501672b5066489aa61e9a9e26e9d5e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6598a-8c", "ovs_interfaceid": "85f6598a-8c09-4f42-9eef-143573c095f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:52:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8dd3936f-f76e-4c0f-a6f4-a9588ad7a282 req-4012923d-2ca6-42cf-98a7-a116519de202 service nova] Releasing lock "refresh_cache-2acbda14-e4bc-49ac-81e2-ce28bc3878d4" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:49 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ee1bba24-17d0-4fc3-8bff-1337d86cc9be is timed out.
Nov 29 05:52:49 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Successfully detached device vdb from instance ee1bba24-17d0-4fc3-8bff-1337d86cc9be from the live domain config.
Nov 29 05:52:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MsfWBgNZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:52:49 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:52:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e4988a-085a-49e8-be35-d93af2a1bc82]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:52:49 user nova-compute[75083]: No targets found.
Nov 29 05:52:49 user nova-compute[75083]: iSNS:
Nov 29 05:52:49 user nova-compute[75083]: No targets found.
Nov 29 05:52:49 user nova-compute[75083]: STATIC:
Nov 29 05:52:49 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5
Nov 29 05:52:49 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:49 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:49 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256
Nov 29 05:52:49 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:49 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:49 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5
Nov 29 05:52:49 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:49 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:49 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043
Nov 29 05:52:49 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:52:49 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:52:49 user nova-compute[75083]: FIRMWARE:
Nov 29 05:52:49 user nova-compute[75083]: No targets found.
Nov 29 05:52:49 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:52:49 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:52:49 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f28755-67dc-45f6-af1c-d4a767c138b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed9f1c7-bc24-416f-90b4-bbdd63d26a9f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:52:49 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:52:49 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:52:49 user nova-compute[75083]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:52:49 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 (non-flash)
Nov 29 05:52:49 user nova-compute[75083]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:52:49 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:52:49 user nova-compute[75083]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:52:49 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0d8139cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c3f9be-2542-49c9-aaf4-02a27d89f961]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed262cd-bb5c-4134-9995-96431768f880]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f49e99d-d93c-4d37-8430-e111fd7fb571]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7becee1-49da-476f-b267-9c63c845f51c]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdd99d5-c541-4902-932a-20e18d956675]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79f9acc-fd0b-46b3-a6a0-3a600d386e7d]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5, portal: 172.16.0.220,3260]
Nov 29 05:52:49 user nova-compute[75083]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5, portal: 172.16.0.220,3260] successful.
Nov 29 05:52:49 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cabbe02-0d11-483c-b05e-9d94c28862a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f93b44-5d88-4b0e-bce7-143f6b41c55d]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] <== disconnect_volume: return (325ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:52:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:52:50 user nova-compute[75083]: DEBUG nova.objects.instance [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lazy-loading 'flavor' on Instance uuid ee1bba24-17d0-4fc3-8bff-1337d86cc9be {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:52:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-92054765-220b-45d9-a78d-703d510cb38f tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.944s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.674s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Acquiring lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG nova.objects.instance [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lazy-loading 'flavor' on Instance uuid 2acbda14-e4bc-49ac-81e2-ce28bc3878d4 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Acquiring lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:52:52 user nova-compute[75083]: INFO nova.compute.manager [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Attaching volume a79b101e-239c-4d81-92c6-a820c8efd9c7 to /dev/vdb
Nov 29 05:52:52 user nova-compute[75083]: DEBUG os_brick.utils [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4563321d-6730-4b71-b18d-b55712f98d81]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f23d46-e7d5-4663-b3d8-fb491224cd56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[78520b72-4d79-403f-83a6-db228cb23d4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e51537-bdf6-44f4-95f1-6693d1c30e02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:52:52 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:52:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a1d83e-8cfc-4278-ac1c-8e38aaace166]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG os_brick.utils [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:52:52 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Updating existing volume attachment record: 0d173cd2-05ca-4d3c-8814-6cdcdb1a7cf7 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:52:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:56 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:52:57 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:52:57 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 05:52:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:52:59 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WIsrBfmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:53:00 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:53:00 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:53:00 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b43af7b-3ea9-4b9f-8766-851ceeb7116b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:53:00 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb30160-cd8e-4e69-a677-771f892c6d92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7] added
Nov 29 05:53:00 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.108s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2b4144-e5fc-4b0e-881a-9db8c9281382]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf1caec-cd91-4075-85a7-84bb1fac121f]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WIsrBfmw {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WIsrBfmw" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ae052e-e045-460b-8df8-1879dd2e578e]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WIsrBfmw'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0224eb6-b490-4fa8-94c2-7b2922184918]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7dffe5-1a1f-4bdb-b9ca-bd244349743c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:53:00 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:53:00 user nova-compute[75083]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:53:00 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:53:00 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:53:00 user nova-compute[75083]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:53:00 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd18745d-c707-41a6-90aa-cf685315db8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7, portal: 172.16.0.220,3260]
Nov 29 05:53:00 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7, portal: 172.16.0.220,3260] successful.
Nov 29 05:53:00 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[015b9f30-d4c6-4893-a868-ed61c7fa8ecf]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0f28d1-d561-4a17-bd6a-acb12aa575ac]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:53:00 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:53:00 user nova-compute[75083]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:53:00 user nova-compute[75083]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 (non-flash)
Nov 29 05:53:00 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:53:00 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:53:00 user nova-compute[75083]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:53:00 user nova-compute[75083]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 (non-flash)
Nov 29 05:53:00 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96e711c-03a4-42cb-a96c-c1142b344b76]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WIsrBfmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:53:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:53:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23635393536306437', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:53:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635393536306437', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:53:01 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:53:01 user nova-compute[75083]: DEBUG nova.objects.instance [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lazy-loading 'flavor' on Instance uuid 2acbda14-e4bc-49ac-81e2-ce28bc3878d4 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:53:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 05:53:01 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:53:01 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 05:53:01 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:53:01 user nova-compute[75083]:   <serial>a79b101e-239c-4d81-92c6-a820c8efd9c7</serial>
Nov 29 05:53:01 user nova-compute[75083]: </disk>
Nov 29 05:53:01 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 05:53:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:53:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:53:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] No VIF found with MAC fa:16:3e:8d:52:51, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:53:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-828576e3-9222-4bc6-acc8-cd193bf8b485 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.441s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:02 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:53:02 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 05:53:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:53:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:53:02 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 05:53:03 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Updating instance_info_cache with network_info: [{"id": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "address": "fa:16:3e:76:b7:47", "network": {"id": "0e6492fc-5e8d-4df7-8fac-2da472312c4d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d625d0d60faf4a4f9073df250039f58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ddf4bb-5d", "ovs_interfaceid": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:53:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-ee1bba24-17d0-4fc3-8bff-1337d86cc9be" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:53:03 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 05:53:03 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:53:03 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:53:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:03 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 05:53:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Acquiring lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:03 user nova-compute[75083]: INFO nova.compute.manager [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Detaching volume a79b101e-239c-4d81-92c6-a820c8efd9c7
Nov 29 05:53:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:03 user nova-compute[75083]: INFO nova.virt.block_device [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Attempting to driver detach volume a79b101e-239c-4d81-92c6-a820c8efd9c7 from mountpoint /dev/vdb
Nov 29 05:53:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Attempting to detach device vdb from instance 2acbda14-e4bc-49ac-81e2-ce28bc3878d4 from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 05:53:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:53:04 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:53:04 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 05:53:04 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:53:04 user nova-compute[75083]:   <serial>a79b101e-239c-4d81-92c6-a820c8efd9c7</serial>
Nov 29 05:53:04 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 05:53:04 user nova-compute[75083]: </disk>
Nov 29 05:53:04 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:53:04 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Successfully detached device vdb from instance 2acbda14-e4bc-49ac-81e2-ce28bc3878d4 from the persistent domain config.
Nov 29 05:53:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2acbda14-e4bc-49ac-81e2-ce28bc3878d4 from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 05:53:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:53:04 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:53:04 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 05:53:04 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:53:04 user nova-compute[75083]:   <serial>a79b101e-239c-4d81-92c6-a820c8efd9c7</serial>
Nov 29 05:53:04 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 05:53:04 user nova-compute[75083]: </disk>
Nov 29 05:53:04 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:53:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2acbda14-e4bc-49ac-81e2-ce28bc3878d4 {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 05:53:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f2df31-d316-48a4-8d9e-c68c5349a739/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f2df31-d316-48a4-8d9e-c68c5349a739/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f2df31-d316-48a4-8d9e-c68c5349a739/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f2df31-d316-48a4-8d9e-c68c5349a739/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:53:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:53:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:53:06 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:53:06 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:53:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=7368MB free_disk=25.278892517089844GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 05:53:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance e6d49806-cecd-473a-b92f-9255868d35c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:53:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance ee1bba24-17d0-4fc3-8bff-1337d86cc9be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:53:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 161c6455-90ce-4c40-a33e-7f582989135d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:53:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b6d38a2c-a512-41f2-a7df-6a54058f8f8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:53:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:53:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 2acbda14-e4bc-49ac-81e2-ce28bc3878d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:53:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fb8244c4-f2a7-4ad8-a210-0f62c165a4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:53:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 7c693239-226b-42b1-928e-9a8b7a2a114c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:53:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance cb63619b-6d75-49d0-80ef-d98aa21b7d4a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:53:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance f3f2df31-d316-48a4-8d9e-c68c5349a739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:53:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 05:53:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 05:53:07 user nova-compute[75083]: DEBUG nova.compute.manager [req-d485743f-13c4-46f9-9bf9-535531b8b01e req-ed627ffa-07bb-4b70-9b37-0bcb1d6f76a4 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received event network-changed-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:07 user nova-compute[75083]: DEBUG nova.compute.manager [req-d485743f-13c4-46f9-9bf9-535531b8b01e req-ed627ffa-07bb-4b70-9b37-0bcb1d6f76a4 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Refreshing instance network info cache due to event network-changed-388c9969-42dc-4e34-8fb8-c2399687751d. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:53:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d485743f-13c4-46f9-9bf9-535531b8b01e req-ed627ffa-07bb-4b70-9b37-0bcb1d6f76a4 service nova] Acquiring lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:53:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d485743f-13c4-46f9-9bf9-535531b8b01e req-ed627ffa-07bb-4b70-9b37-0bcb1d6f76a4 service nova] Acquired lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:53:07 user nova-compute[75083]: DEBUG nova.network.neutron [req-d485743f-13c4-46f9-9bf9-535531b8b01e req-ed627ffa-07bb-4b70-9b37-0bcb1d6f76a4 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Refreshing network info cache for port 388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:53:07 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:53:07 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:53:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 05:53:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:07 user nova-compute[75083]: DEBUG nova.network.neutron [req-d485743f-13c4-46f9-9bf9-535531b8b01e req-ed627ffa-07bb-4b70-9b37-0bcb1d6f76a4 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Updated VIF entry in instance network info cache for port 388c9969-42dc-4e34-8fb8-c2399687751d. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:53:07 user nova-compute[75083]: DEBUG nova.network.neutron [req-d485743f-13c4-46f9-9bf9-535531b8b01e req-ed627ffa-07bb-4b70-9b37-0bcb1d6f76a4 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Updating instance_info_cache with network_info: [{"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:53:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d485743f-13c4-46f9-9bf9-535531b8b01e req-ed627ffa-07bb-4b70-9b37-0bcb1d6f76a4 service nova] Releasing lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:53:07 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:53:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:19 user nova-compute[75083]: INFO nova.compute.manager [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Terminating instance
Nov 29 05:53:19 user nova-compute[75083]: DEBUG nova.compute.manager [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:53:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:19 user nova-compute[75083]: DEBUG nova.compute.manager [req-c948f245-d6ce-4897-9aa4-d5d1b1b12f5d req-33c2bb43-8de6-40bc-8d40-7e0e5890edb6 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received event network-vif-unplugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c948f245-d6ce-4897-9aa4-d5d1b1b12f5d req-33c2bb43-8de6-40bc-8d40-7e0e5890edb6 service nova] Acquiring lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c948f245-d6ce-4897-9aa4-d5d1b1b12f5d req-33c2bb43-8de6-40bc-8d40-7e0e5890edb6 service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c948f245-d6ce-4897-9aa4-d5d1b1b12f5d req-33c2bb43-8de6-40bc-8d40-7e0e5890edb6 service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:19 user nova-compute[75083]: DEBUG nova.compute.manager [req-c948f245-d6ce-4897-9aa4-d5d1b1b12f5d req-33c2bb43-8de6-40bc-8d40-7e0e5890edb6 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] No waiting events found dispatching network-vif-unplugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:53:19 user nova-compute[75083]: DEBUG nova.compute.manager [req-c948f245-d6ce-4897-9aa4-d5d1b1b12f5d req-33c2bb43-8de6-40bc-8d40-7e0e5890edb6 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received event network-vif-unplugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:53:20 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Instance destroyed successfully.
Nov 29 05:53:20 user nova-compute[75083]: DEBUG nova.objects.instance [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lazy-loading 'resources' on Instance uuid ee1bba24-17d0-4fc3-8bff-1337d86cc9be {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:53:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-826292306',display_name='tempest-ServerStableDeviceRescueTest-server-826292306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-826292306',id=3,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4Ued3iPzzbMe5P8yCCDECsXfcv5JHNAjhap4DZX0mLVVlTdbfXR6zFoeLnVJJxMXZB04R5Xe0j2RaI5pk8Yj72peIfQZXhFvMw9aBrNBt/3KF1NAc6raVZ7kAtojg42A==',key_name='tempest-keypair-1498054763',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:50:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d625d0d60faf4a4f9073df250039f58b',ramdisk_id='',reservation_id='r-20ynrj0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1148285851',owner_user_name='tempest-ServerStableDeviceRescueTest-1148285851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28d78f6409074549a9353312300b041b',uuid=ee1bba24-17d0-4fc3-8bff-1337d86cc9be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "address": "fa:16:3e:76:b7:47", "network": {"id": "0e6492fc-5e8d-4df7-8fac-2da472312c4d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d625d0d60faf4a4f9073df250039f58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ddf4bb-5d", "ovs_interfaceid": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:53:20 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Converting VIF {"id": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "address": "fa:16:3e:76:b7:47", "network": {"id": "0e6492fc-5e8d-4df7-8fac-2da472312c4d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88170643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d625d0d60faf4a4f9073df250039f58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ddf4bb-5d", "ovs_interfaceid": "b4ddf4bb-5def-4760-8d1b-f020942dedf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:53:20 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:b7:47,bridge_name='br-int',has_traffic_filtering=True,id=b4ddf4bb-5def-4760-8d1b-f020942dedf8,network=Network(0e6492fc-5e8d-4df7-8fac-2da472312c4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ddf4bb-5d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:53:20 user nova-compute[75083]: DEBUG os_vif [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:b7:47,bridge_name='br-int',has_traffic_filtering=True,id=b4ddf4bb-5def-4760-8d1b-f020942dedf8,network=Network(0e6492fc-5e8d-4df7-8fac-2da472312c4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ddf4bb-5d') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:53:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4ddf4bb-5d, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:53:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:53:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40fb3e39-fde6-41c7-8417-e3e28fc48798) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:53:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:53:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:20 user nova-compute[75083]: INFO os_vif [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:b7:47,bridge_name='br-int',has_traffic_filtering=True,id=b4ddf4bb-5def-4760-8d1b-f020942dedf8,network=Network(0e6492fc-5e8d-4df7-8fac-2da472312c4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ddf4bb-5d')
Nov 29 05:53:20 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Deleting instance files /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be_del
Nov 29 05:53:20 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Deletion of /opt/stack/data/nova/instances/ee1bba24-17d0-4fc3-8bff-1337d86cc9be_del complete
Nov 29 05:53:20 user nova-compute[75083]: INFO nova.compute.manager [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 05:53:20 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 05:53:20 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 05:53:20 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 05:53:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:20 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:53:20 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Took 0.78 seconds to deallocate network for instance.
Nov 29 05:53:20 user nova-compute[75083]: DEBUG nova.compute.manager [req-0d31fa9c-cbf8-4b03-8faa-3ffe2c2416ad req-a0d5d67e-3e58-41ac-a505-91363aaa341d service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received event network-vif-deleted-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:21 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:53:21 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:53:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:21 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Deleted allocations for instance ee1bba24-17d0-4fc3-8bff-1337d86cc9be
Nov 29 05:53:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2299dd33-cfaf-47cf-85e7-8d7e5fc4be43 tempest-ServerStableDeviceRescueTest-1148285851 tempest-ServerStableDeviceRescueTest-1148285851-project-member] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.132s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:21 user nova-compute[75083]: DEBUG nova.compute.manager [req-94f28f51-aa0b-4317-9876-f8ba71d8ae41 req-be23d4b5-3cae-48e2-b9d2-8606236e7aa1 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received event network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-94f28f51-aa0b-4317-9876-f8ba71d8ae41 req-be23d4b5-3cae-48e2-b9d2-8606236e7aa1 service nova] Acquiring lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-94f28f51-aa0b-4317-9876-f8ba71d8ae41 req-be23d4b5-3cae-48e2-b9d2-8606236e7aa1 service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-94f28f51-aa0b-4317-9876-f8ba71d8ae41 req-be23d4b5-3cae-48e2-b9d2-8606236e7aa1 service nova] Lock "ee1bba24-17d0-4fc3-8bff-1337d86cc9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:21 user nova-compute[75083]: DEBUG nova.compute.manager [req-94f28f51-aa0b-4317-9876-f8ba71d8ae41 req-be23d4b5-3cae-48e2-b9d2-8606236e7aa1 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] No waiting events found dispatching network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:53:21 user nova-compute[75083]: WARNING nova.compute.manager [req-94f28f51-aa0b-4317-9876-f8ba71d8ae41 req-be23d4b5-3cae-48e2-b9d2-8606236e7aa1 service nova] [instance: ee1bba24-17d0-4fc3-8bff-1337d86cc9be] Received unexpected event network-vif-plugged-b4ddf4bb-5def-4760-8d1b-f020942dedf8 for instance with vm_state deleted and task_state None.
Nov 29 05:53:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-24e8f41b-43d8-49ca-affd-0210e07c700d req-6ab6bd66-e448-4d9f-981b-6bf70ac7609f service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Received event network-changed-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-24e8f41b-43d8-49ca-affd-0210e07c700d req-6ab6bd66-e448-4d9f-981b-6bf70ac7609f service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Refreshing instance network info cache due to event network-changed-5581c9a9-ec9e-49f5-b9bb-8e2112b54377. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:53:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-24e8f41b-43d8-49ca-affd-0210e07c700d req-6ab6bd66-e448-4d9f-981b-6bf70ac7609f service nova] Acquiring lock "refresh_cache-7c693239-226b-42b1-928e-9a8b7a2a114c" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:53:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-24e8f41b-43d8-49ca-affd-0210e07c700d req-6ab6bd66-e448-4d9f-981b-6bf70ac7609f service nova] Acquired lock "refresh_cache-7c693239-226b-42b1-928e-9a8b7a2a114c" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:53:23 user nova-compute[75083]: DEBUG nova.network.neutron [req-24e8f41b-43d8-49ca-affd-0210e07c700d req-6ab6bd66-e448-4d9f-981b-6bf70ac7609f service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Refreshing network info cache for port 5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:53:23 user nova-compute[75083]: DEBUG nova.network.neutron [req-24e8f41b-43d8-49ca-affd-0210e07c700d req-6ab6bd66-e448-4d9f-981b-6bf70ac7609f service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Updated VIF entry in instance network info cache for port 5581c9a9-ec9e-49f5-b9bb-8e2112b54377. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:53:23 user nova-compute[75083]: DEBUG nova.network.neutron [req-24e8f41b-43d8-49ca-affd-0210e07c700d req-6ab6bd66-e448-4d9f-981b-6bf70ac7609f service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Updating instance_info_cache with network_info: [{"id": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "address": "fa:16:3e:02:29:04", "network": {"id": "338c6d36-9867-4d30-b8b9-5209dd6ae7dc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1555128941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8356c76a38d4b798fbc756795fab89b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5581c9a9-ec", "ovs_interfaceid": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:53:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-24e8f41b-43d8-49ca-affd-0210e07c700d req-6ab6bd66-e448-4d9f-981b-6bf70ac7609f service nova] Releasing lock "refresh_cache-7c693239-226b-42b1-928e-9a8b7a2a114c" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:53:23 user nova-compute[75083]: INFO nova.compute.manager [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Rebuilding instance
Nov 29 05:53:23 user nova-compute[75083]: DEBUG nova.compute.manager [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:53:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:24 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Instance destroyed successfully.
Nov 29 05:53:24 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Instance destroyed successfully.
Nov 29 05:53:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1099529621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1923190517',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVqlBFSwsVSd5Vcbhdct55aXuVEeazXqKnt3H0YMw0ee5MXXhI16+ZwPyHVIMGfFxjyzswiZlnB6srSTk54bx0+gEyQjqkJlEeRzN4KuV8BBahtwESFhSg9w8kgSjIeaQ==',key_name='tempest-keypair-718905469',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:51:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c8356c76a38d4b798fbc756795fab89b',ramdisk_id='',reservation_id='r-zu96bv1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-226818069',owner_user_name='tempest-ServerActionsV293TestJSON-226818069-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:53:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49154159b8244161981fb442e2014067',uuid=7c693239-226b-42b1-928e-9a8b7a2a114c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "address": "fa:16:3e:02:29:04", "network": {"id": "338c6d36-9867-4d30-b8b9-5209dd6ae7dc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1555128941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8356c76a38d4b798fbc756795fab89b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5581c9a9-ec", "ovs_interfaceid": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Converting VIF {"id": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "address": "fa:16:3e:02:29:04", "network": {"id": "338c6d36-9867-4d30-b8b9-5209dd6ae7dc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1555128941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8356c76a38d4b798fbc756795fab89b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5581c9a9-ec", "ovs_interfaceid": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:29:04,bridge_name='br-int',has_traffic_filtering=True,id=5581c9a9-ec9e-49f5-b9bb-8e2112b54377,network=Network(338c6d36-9867-4d30-b8b9-5209dd6ae7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5581c9a9-ec') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_vif [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:29:04,bridge_name='br-int',has_traffic_filtering=True,id=5581c9a9-ec9e-49f5-b9bb-8e2112b54377,network=Network(338c6d36-9867-4d30-b8b9-5209dd6ae7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5581c9a9-ec') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5581c9a9-ec, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5285c664-76d5-4d3b-a340-d2339f022401) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:24 user nova-compute[75083]: INFO os_vif [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:29:04,bridge_name='br-int',has_traffic_filtering=True,id=5581c9a9-ec9e-49f5-b9bb-8e2112b54377,network=Network(338c6d36-9867-4d30-b8b9-5209dd6ae7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5581c9a9-ec')
Nov 29 05:53:24 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2acbda14-e4bc-49ac-81e2-ce28bc3878d4 is timed out.
Nov 29 05:53:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnuPAXgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:53:24 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:53:24 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Successfully detached device vdb from instance 2acbda14-e4bc-49ac-81e2-ce28bc3878d4 from the live domain config.
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WIsrBfmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:53:24 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a367bc7-13eb-4d65-9e39-51063a8d87e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:53:24 user nova-compute[75083]: No targets found.
Nov 29 05:53:24 user nova-compute[75083]: iSNS:
Nov 29 05:53:24 user nova-compute[75083]: No targets found.
Nov 29 05:53:24 user nova-compute[75083]: STATIC:
Nov 29 05:53:24 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256
Nov 29 05:53:24 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:53:24 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:53:24 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7
Nov 29 05:53:24 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:53:24 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:53:24 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5
Nov 29 05:53:24 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:53:24 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:53:24 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043
Nov 29 05:53:24 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:53:24 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:53:24 user nova-compute[75083]: FIRMWARE:
Nov 29 05:53:24 user nova-compute[75083]: No targets found.
Nov 29 05:53:24 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:53:24 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:53:24 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07db903-0024-4ca3-80fe-30ddad446dfb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e402d373-3220-4cba-8893-2cca2c519d6a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:53:24 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:53:24 user nova-compute[75083]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:53:24 user nova-compute[75083]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 (non-flash)
Nov 29 05:53:24 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:53:24 user nova-compute[75083]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:53:24 user nova-compute[75083]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:53:24 user nova-compute[75083]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 (non-flash)
Nov 29 05:53:24 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0d827c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043'): ({'sde'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Removing single pathed devices sde {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[048efa68-4206-4e9a-be2a-e52479c215d5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a0e5ca-9bd4-45ff-a84c-04bc137fdbcd]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Flushing IO for device /dev/sde {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[64865d13-ff12-47aa-9fad-1ffd51ecddf6]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[723bfe5d-80d8-4765-9d9f-1d4504fb1e03]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] SCSI volumes sde have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb93b992-0785-4849-ba6d-50b4363bda75]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[485805eb-acce-421d-8606-3f2fe4c5ee60]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043, portal: 172.16.0.220,3260]
Nov 29 05:53:24 user nova-compute[75083]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043, portal: 172.16.0.220,3260] successful.
Nov 29 05:53:24 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d715044-f939-4a07-be26-b92fea5ca115]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] <== disconnect_volume: return (337ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:53:24 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Deleting instance files /opt/stack/data/nova/instances/7c693239-226b-42b1-928e-9a8b7a2a114c_del
Nov 29 05:53:24 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Deletion of /opt/stack/data/nova/instances/7c693239-226b-42b1-928e-9a8b7a2a114c_del complete
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.337s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9d010d-2fc5-42b1-8470-4765f80df736]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:53:24 user nova-compute[75083]: No targets found.
Nov 29 05:53:24 user nova-compute[75083]: iSNS:
Nov 29 05:53:24 user nova-compute[75083]: No targets found.
Nov 29 05:53:24 user nova-compute[75083]: STATIC:
Nov 29 05:53:24 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256
Nov 29 05:53:24 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:53:24 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:53:24 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7
Nov 29 05:53:24 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:53:24 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:53:24 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5
Nov 29 05:53:24 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:53:24 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:53:24 user nova-compute[75083]: FIRMWARE:
Nov 29 05:53:24 user nova-compute[75083]: No targets found.
Nov 29 05:53:24 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:53:24 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:53:24 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[db268607-5440-4a08-b53b-1010c901a4dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3580a8-e654-468d-88c8-ce3750946fba]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:53:24 user nova-compute[75083]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:53:24 user nova-compute[75083]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 (non-flash)
Nov 29 05:53:24 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:53:24 user nova-compute[75083]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:53:24 user nova-compute[75083]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 (non-flash)
Nov 29 05:53:24 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0d85f15a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[31261f00-158d-4ce1-be98-3d56f41f3bba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0874243c-9221-4112-8bc4-52c5394817c3]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[729cb90a-b60f-4799-9048-267ab6f9853a]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:24 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 7c693239-226b-42b1-928e-9a8b7a2a114c could not be found.
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d6e0d9-74c4-4201-86ac-e9c3c7335c87]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnuPAXgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:53:24 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 05:53:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:53:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa932734-0c08-48e1-a7ed-e97d330b9fd0]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-09d2122c-ecfe-42a4-9428-2f647092d599 req-b0657ef9-0976-46ff-b93c-1d1aca02d9f4 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Received event network-vif-unplugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-09d2122c-ecfe-42a4-9428-2f647092d599 req-b0657ef9-0976-46ff-b93c-1d1aca02d9f4 service nova] Acquiring lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-09d2122c-ecfe-42a4-9428-2f647092d599 req-b0657ef9-0976-46ff-b93c-1d1aca02d9f4 service nova] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-09d2122c-ecfe-42a4-9428-2f647092d599 req-b0657ef9-0976-46ff-b93c-1d1aca02d9f4 service nova] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-09d2122c-ecfe-42a4-9428-2f647092d599 req-b0657ef9-0976-46ff-b93c-1d1aca02d9f4 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] No waiting events found dispatching network-vif-unplugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:53:25 user nova-compute[75083]: WARNING nova.compute.manager [req-09d2122c-ecfe-42a4-9428-2f647092d599 req-b0657ef9-0976-46ff-b93c-1d1aca02d9f4 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Received unexpected event network-vif-unplugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 for instance with vm_state active and task_state rebuilding.
Nov 29 05:53:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-09d2122c-ecfe-42a4-9428-2f647092d599 req-b0657ef9-0976-46ff-b93c-1d1aca02d9f4 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Received event network-vif-plugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-09d2122c-ecfe-42a4-9428-2f647092d599 req-b0657ef9-0976-46ff-b93c-1d1aca02d9f4 service nova] Acquiring lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-09d2122c-ecfe-42a4-9428-2f647092d599 req-b0657ef9-0976-46ff-b93c-1d1aca02d9f4 service nova] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-09d2122c-ecfe-42a4-9428-2f647092d599 req-b0657ef9-0976-46ff-b93c-1d1aca02d9f4 service nova] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-09d2122c-ecfe-42a4-9428-2f647092d599 req-b0657ef9-0976-46ff-b93c-1d1aca02d9f4 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] No waiting events found dispatching network-vif-plugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:53:25 user nova-compute[75083]: WARNING nova.compute.manager [req-09d2122c-ecfe-42a4-9428-2f647092d599 req-b0657ef9-0976-46ff-b93c-1d1aca02d9f4 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Received unexpected event network-vif-plugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 for instance with vm_state active and task_state rebuilding.
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a4dea3-87d3-49ff-8af8-faf88ae1f74c]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7, portal: 172.16.0.220,3260]
Nov 29 05:53:25 user nova-compute[75083]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7, portal: 172.16.0.220,3260] successful.
Nov 29 05:53:25 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79b101e-239c-4d81-92c6-a820c8efd9c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca55643-2e69-42a0-a3a3-c5a237a4c415]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] <== disconnect_volume: return (645ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.118s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d75128-fa1e-404d-9dac-67ef1408f93a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:53:25 user nova-compute[75083]: No targets found.
Nov 29 05:53:25 user nova-compute[75083]: iSNS:
Nov 29 05:53:25 user nova-compute[75083]: No targets found.
Nov 29 05:53:25 user nova-compute[75083]: STATIC:
Nov 29 05:53:25 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256
Nov 29 05:53:25 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:53:25 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:53:25 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5
Nov 29 05:53:25 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:53:25 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:53:25 user nova-compute[75083]: FIRMWARE:
Nov 29 05:53:25 user nova-compute[75083]: No targets found.
Nov 29 05:53:25 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:53:25 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:53:25 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c61e46-d8d4-4189-8158-91900c862feb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9c367e-629d-4716-9466-1f08775f20b5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:53:25 user nova-compute[75083]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:53:25 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:53:25 user nova-compute[75083]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:53:25 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b8325870>, {}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Disconnecting from: [] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] <== disconnect_volume: return (189ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG nova.objects.instance [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lazy-loading 'flavor' on Instance uuid 2acbda14-e4bc-49ac-81e2-ce28bc3878d4 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:53:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-96e29ccb-ac81-4c33-b6c4-807b0f281d65 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.039s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Preparing to wait for external event volume-reimaged-74a643c4-1330-47fc-9deb-fe33aa3bd043 {{(pid=75083) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 29 05:53:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Acquiring lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "2778daf0-f727-4185-a404-1793b75ac523" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "2778daf0-f727-4185-a404-1793b75ac523" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:37 user nova-compute[75083]: DEBUG nova.compute.manager [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:53:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:37 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:53:37 user nova-compute[75083]: INFO nova.compute.claims [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Claim successful on node user
Nov 29 05:53:37 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:53:37 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:53:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:37 user nova-compute[75083]: DEBUG nova.compute.manager [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG nova.network.neutron [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:53:38 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:53:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG nova.policy [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4e6b7adfb1b469ab5c6c3f26633272a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c63c54083f4a0eba38539e7c196d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:53:38 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Creating image(s)
Nov 29 05:53:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "/opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "/opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "/opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.167s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.206s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk 1073741824" returned: 0 in 0.060s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.205s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:38 user nova-compute[75083]: DEBUG nova.network.neutron [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Successfully created port: f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Cannot resize image /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Ensure instance console log exists: /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG nova.compute.manager [req-0ce02ff8-69cd-4ece-a117-42628afbb5fd req-d6f50ce9-eae9-4cf3-a00a-68fa23edaa4a service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received event network-changed-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG nova.compute.manager [req-0ce02ff8-69cd-4ece-a117-42628afbb5fd req-d6f50ce9-eae9-4cf3-a00a-68fa23edaa4a service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Refreshing instance network info cache due to event network-changed-df73cb37-8475-4c21-89c7-b02949297b63. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0ce02ff8-69cd-4ece-a117-42628afbb5fd req-d6f50ce9-eae9-4cf3-a00a-68fa23edaa4a service nova] Acquiring lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0ce02ff8-69cd-4ece-a117-42628afbb5fd req-d6f50ce9-eae9-4cf3-a00a-68fa23edaa4a service nova] Acquired lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG nova.network.neutron [req-0ce02ff8-69cd-4ece-a117-42628afbb5fd req-d6f50ce9-eae9-4cf3-a00a-68fa23edaa4a service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Refreshing network info cache for port df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG nova.network.neutron [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Successfully updated port: f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquired lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG nova.network.neutron [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG nova.compute.manager [req-b9060200-de0f-44d9-960d-cb40c80154cd req-724645b7-dc80-419a-af97-e46dbc57e710 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received event network-changed-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG nova.compute.manager [req-b9060200-de0f-44d9-960d-cb40c80154cd req-724645b7-dc80-419a-af97-e46dbc57e710 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Refreshing instance network info cache due to event network-changed-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b9060200-de0f-44d9-960d-cb40c80154cd req-724645b7-dc80-419a-af97-e46dbc57e710 service nova] Acquiring lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG nova.network.neutron [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG nova.network.neutron [req-0ce02ff8-69cd-4ece-a117-42628afbb5fd req-d6f50ce9-eae9-4cf3-a00a-68fa23edaa4a service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Updated VIF entry in instance network info cache for port df73cb37-8475-4c21-89c7-b02949297b63. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG nova.network.neutron [req-0ce02ff8-69cd-4ece-a117-42628afbb5fd req-d6f50ce9-eae9-4cf3-a00a-68fa23edaa4a service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Updating instance_info_cache with network_info: [{"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:53:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0ce02ff8-69cd-4ece-a117-42628afbb5fd req-d6f50ce9-eae9-4cf3-a00a-68fa23edaa4a service nova] Releasing lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.network.neutron [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Updating instance_info_cache with network_info: [{"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Releasing lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.compute.manager [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Instance network_info: |[{"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b9060200-de0f-44d9-960d-cb40c80154cd req-724645b7-dc80-419a-af97-e46dbc57e710 service nova] Acquired lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.network.neutron [req-b9060200-de0f-44d9-960d-cb40c80154cd req-724645b7-dc80-419a-af97-e46dbc57e710 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Refreshing network info cache for port f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Start _get_guest_xml network_info=[{"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:53:40 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:53:40 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-496298622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-496298622',id=19,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtQ1vuaaWUxtG/9G1YJRDY4MUN2av+CuZbcDT4uGJgXHg4z4ZIrmTihKhSMv3O5tWX5AEk0FPMj1glQqi3+hqk5VH/afqDYN9j0lutfv7odS3an+4n1UEM6ZjECj8n+og==',key_name='tempest-keypair-1008779938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1c63c54083f4a0eba38539e7c196d61',ramdisk_id='',reservation_id='r-c9eon0oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-961204558',owner_user_name='tempest-AttachVolumeShelveTestJSON-961204558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:53:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4e6b7adfb1b469ab5c6c3f26633272a',uuid=2778daf0-f727-4185-a404-1793b75ac523,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converting VIF {"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:89:b6,bridge_name='br-int',has_traffic_filtering=True,id=f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ddd3c7-1b') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.objects.instance [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'pci_devices' on Instance uuid 2778daf0-f727-4185-a404-1793b75ac523 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:53:40 user nova-compute[75083]:   <uuid>2778daf0-f727-4185-a404-1793b75ac523</uuid>
Nov 29 05:53:40 user nova-compute[75083]:   <name>instance-00000013</name>
Nov 29 05:53:40 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:53:40 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:53:40 user nova-compute[75083]:   <metadata>
Nov 29 05:53:40 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:53:40 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:53:40 user nova-compute[75083]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-496298622</nova:name>
Nov 29 05:53:40 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:53:40</nova:creationTime>
Nov 29 05:53:40 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:53:40 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:53:40 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:53:40 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:53:40 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:53:40 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:53:40 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:53:40 user nova-compute[75083]:       <nova:owner>
Nov 29 05:53:40 user nova-compute[75083]:         <nova:user uuid="e4e6b7adfb1b469ab5c6c3f26633272a">tempest-AttachVolumeShelveTestJSON-961204558-project-member</nova:user>
Nov 29 05:53:40 user nova-compute[75083]:         <nova:project uuid="d1c63c54083f4a0eba38539e7c196d61">tempest-AttachVolumeShelveTestJSON-961204558</nova:project>
Nov 29 05:53:40 user nova-compute[75083]:       </nova:owner>
Nov 29 05:53:40 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:53:40 user nova-compute[75083]:       <nova:ports>
Nov 29 05:53:40 user nova-compute[75083]:         <nova:port uuid="f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9">
Nov 29 05:53:40 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 05:53:40 user nova-compute[75083]:         </nova:port>
Nov 29 05:53:40 user nova-compute[75083]:       </nova:ports>
Nov 29 05:53:40 user nova-compute[75083]:     </nova:instance>
Nov 29 05:53:40 user nova-compute[75083]:   </metadata>
Nov 29 05:53:40 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:53:40 user nova-compute[75083]:     <system>
Nov 29 05:53:40 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:53:40 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:53:40 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:53:40 user nova-compute[75083]:       <entry name="serial">2778daf0-f727-4185-a404-1793b75ac523</entry>
Nov 29 05:53:40 user nova-compute[75083]:       <entry name="uuid">2778daf0-f727-4185-a404-1793b75ac523</entry>
Nov 29 05:53:40 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:53:40 user nova-compute[75083]:     </system>
Nov 29 05:53:40 user nova-compute[75083]:   </sysinfo>
Nov 29 05:53:40 user nova-compute[75083]:   <os>
Nov 29 05:53:40 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:53:40 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:53:40 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:53:40 user nova-compute[75083]:   </os>
Nov 29 05:53:40 user nova-compute[75083]:   <features>
Nov 29 05:53:40 user nova-compute[75083]:     <acpi/>
Nov 29 05:53:40 user nova-compute[75083]:     <apic/>
Nov 29 05:53:40 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:53:40 user nova-compute[75083]:   </features>
Nov 29 05:53:40 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:53:40 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:53:40 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:53:40 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:53:40 user nova-compute[75083]:   </clock>
Nov 29 05:53:40 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:53:40 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:53:40 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:53:40 user nova-compute[75083]:   </cpu>
Nov 29 05:53:40 user nova-compute[75083]:   <devices>
Nov 29 05:53:40 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:53:40 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:53:40 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk"/>
Nov 29 05:53:40 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:53:40 user nova-compute[75083]:     </disk>
Nov 29 05:53:40 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:53:40 user nova-compute[75083]:       <mac address="fa:16:3e:81:89:b6"/>
Nov 29 05:53:40 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:53:40 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:53:40 user nova-compute[75083]:       <target dev="tapf5ddd3c7-1b"/>
Nov 29 05:53:40 user nova-compute[75083]:     </interface>
Nov 29 05:53:40 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:53:40 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/console.log" append="off"/>
Nov 29 05:53:40 user nova-compute[75083]:     </serial>
Nov 29 05:53:40 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:53:40 user nova-compute[75083]:     <video>
Nov 29 05:53:40 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:53:40 user nova-compute[75083]:     </video>
Nov 29 05:53:40 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:53:40 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:53:40 user nova-compute[75083]:     </rng>
Nov 29 05:53:40 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:53:40 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:53:40 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:53:40 user nova-compute[75083]:     </memballoon>
Nov 29 05:53:40 user nova-compute[75083]:   </devices>
Nov 29 05:53:40 user nova-compute[75083]: </domain>
Nov 29 05:53:40 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-496298622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-496298622',id=19,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtQ1vuaaWUxtG/9G1YJRDY4MUN2av+CuZbcDT4uGJgXHg4z4ZIrmTihKhSMv3O5tWX5AEk0FPMj1glQqi3+hqk5VH/afqDYN9j0lutfv7odS3an+4n1UEM6ZjECj8n+og==',key_name='tempest-keypair-1008779938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1c63c54083f4a0eba38539e7c196d61',ramdisk_id='',reservation_id='r-c9eon0oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-961204558',owner_user_name='tempest-AttachVolumeShelveTestJSON-961204558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:53:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4e6b7adfb1b469ab5c6c3f26633272a',uuid=2778daf0-f727-4185-a404-1793b75ac523,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converting VIF {"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:89:b6,bridge_name='br-int',has_traffic_filtering=True,id=f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ddd3c7-1b') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG os_vif [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:89:b6,bridge_name='br-int',has_traffic_filtering=True,id=f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ddd3c7-1b') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b4447e5-e2cb-53ea-9319-d8156cdd318c', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5ddd3c7-1b, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5ddd3c7-1b, col_values=(('qos', UUID('c9d90010-4960-44db-915a-188b94748ef4')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5ddd3c7-1b, col_values=(('external_ids', {'iface-id': 'f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:89:b6', 'vm-uuid': '2778daf0-f727-4185-a404-1793b75ac523'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:40 user nova-compute[75083]: INFO os_vif [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:89:b6,bridge_name='br-int',has_traffic_filtering=True,id=f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ddd3c7-1b')
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] No VIF found with MAC fa:16:3e:81:89:b6, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.network.neutron [req-b9060200-de0f-44d9-960d-cb40c80154cd req-724645b7-dc80-419a-af97-e46dbc57e710 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Updated VIF entry in instance network info cache for port f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG nova.network.neutron [req-b9060200-de0f-44d9-960d-cb40c80154cd req-724645b7-dc80-419a-af97-e46dbc57e710 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Updating instance_info_cache with network_info: [{"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b9060200-de0f-44d9-960d-cb40c80154cd req-724645b7-dc80-419a-af97-e46dbc57e710 service nova] Releasing lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquiring lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:40 user nova-compute[75083]: INFO nova.compute.manager [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Shelve offloading
Nov 29 05:53:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:41 user nova-compute[75083]: DEBUG nova.compute.manager [req-3825bb4c-f95b-40d8-b2ba-80fde8e2dd90 req-3c447fcd-5af8-4063-97f6-1f1feadac530 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received event network-vif-unplugged-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3825bb4c-f95b-40d8-b2ba-80fde8e2dd90 req-3c447fcd-5af8-4063-97f6-1f1feadac530 service nova] Acquiring lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3825bb4c-f95b-40d8-b2ba-80fde8e2dd90 req-3c447fcd-5af8-4063-97f6-1f1feadac530 service nova] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3825bb4c-f95b-40d8-b2ba-80fde8e2dd90 req-3c447fcd-5af8-4063-97f6-1f1feadac530 service nova] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:41 user nova-compute[75083]: DEBUG nova.compute.manager [req-3825bb4c-f95b-40d8-b2ba-80fde8e2dd90 req-3c447fcd-5af8-4063-97f6-1f1feadac530 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] No waiting events found dispatching network-vif-unplugged-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:53:41 user nova-compute[75083]: WARNING nova.compute.manager [req-3825bb4c-f95b-40d8-b2ba-80fde8e2dd90 req-3c447fcd-5af8-4063-97f6-1f1feadac530 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received unexpected event network-vif-unplugged-df73cb37-8475-4c21-89c7-b02949297b63 for instance with vm_state active and task_state shelving.
Nov 29 05:53:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-0c663fae-c3db-472c-a24e-81b4d2047a04 req-de67d3be-9bab-43bd-9e05-ceb9370e1fd8 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received event network-vif-plugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0c663fae-c3db-472c-a24e-81b4d2047a04 req-de67d3be-9bab-43bd-9e05-ceb9370e1fd8 service nova] Acquiring lock "2778daf0-f727-4185-a404-1793b75ac523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0c663fae-c3db-472c-a24e-81b4d2047a04 req-de67d3be-9bab-43bd-9e05-ceb9370e1fd8 service nova] Lock "2778daf0-f727-4185-a404-1793b75ac523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0c663fae-c3db-472c-a24e-81b4d2047a04 req-de67d3be-9bab-43bd-9e05-ceb9370e1fd8 service nova] Lock "2778daf0-f727-4185-a404-1793b75ac523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-0c663fae-c3db-472c-a24e-81b4d2047a04 req-de67d3be-9bab-43bd-9e05-ceb9370e1fd8 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] No waiting events found dispatching network-vif-plugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:53:42 user nova-compute[75083]: WARNING nova.compute.manager [req-0c663fae-c3db-472c-a24e-81b4d2047a04 req-de67d3be-9bab-43bd-9e05-ceb9370e1fd8 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received unexpected event network-vif-plugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 for instance with vm_state building and task_state spawning.
Nov 29 05:53:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:42 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Instance destroyed successfully.
Nov 29 05:53:42 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:53:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquiring lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:53:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquired lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:53:42 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:53:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:42 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Updating instance_info_cache with network_info: [{"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:53:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Releasing lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d req-972ddfd2-c293-4c1c-8b21-63829616509d service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Received event volume-reimaged-74a643c4-1330-47fc-9deb-fe33aa3bd043 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d req-972ddfd2-c293-4c1c-8b21-63829616509d service nova] Acquiring lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d req-972ddfd2-c293-4c1c-8b21-63829616509d service nova] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d req-972ddfd2-c293-4c1c-8b21-63829616509d service nova] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d req-972ddfd2-c293-4c1c-8b21-63829616509d service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Processing event volume-reimaged-74a643c4-1330-47fc-9deb-fe33aa3bd043 {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG nova.compute.manager [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Instance event wait completed in 16 seconds for volume-reimaged {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:53:43 user nova-compute[75083]: INFO nova.virt.block_device [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Booting with volume 74a643c4-1330-47fc-9deb-fe33aa3bd043 at /dev/vda
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.utils [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce420bfb-3820-492c-8a38-419b9d73dfef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a3a23f-bf19-496d-a1e1-266e5c623013]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:43 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Instance destroyed successfully.
Nov 29 05:53:43 user nova-compute[75083]: DEBUG nova.objects.instance [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lazy-loading 'resources' on Instance uuid cb63619b-6d75-49d0-80ef-d98aa21b7d4a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-87fdb470-b2fb-4b66-b637-182090ad62fb req-9d274bfb-9946-4b1f-9fd0-0621d0f5f087 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received event network-changed-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-87fdb470-b2fb-4b66-b637-182090ad62fb req-9d274bfb-9946-4b1f-9fd0-0621d0f5f087 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Refreshing instance network info cache due to event network-changed-df73cb37-8475-4c21-89c7-b02949297b63. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-87fdb470-b2fb-4b66-b637-182090ad62fb req-9d274bfb-9946-4b1f-9fd0-0621d0f5f087 service nova] Acquiring lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-87fdb470-b2fb-4b66-b637-182090ad62fb req-9d274bfb-9946-4b1f-9fd0-0621d0f5f087 service nova] Acquired lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG nova.network.neutron [req-87fdb470-b2fb-4b66-b637-182090ad62fb req-9d274bfb-9946-4b1f-9fd0-0621d0f5f087 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Refreshing network info cache for port df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6a8a0d-53a3-466a-94fd-bd16f871c0cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[200bb2ff-1725-4fbc-9481-a18f60d462c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2116511993',display_name='tempest-TestShelveInstance-server-2116511993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2116511993',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3XRiOYiMyy1cMKrc1L5kmaEw25NqJKhIhaSi9XAjuBjymTSblD1gvpU4X9lRZjCdo4ELni/eCQVBbsZcwHCjK+TtBxYCIy7uoJiDP2ByGmZdSvxYSiXvrvCVbCnPZgcQ==',key_name='tempest-TestShelveInstance-728939459',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:52:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='385f39574be145b6b47e5a7dddf9415e',ramdisk_id='',reservation_id='r-oqenqftq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-925751842',owner_user_name='tempest-TestShelveInstance-925751842-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:52:03Z,user_data=None,user_id='d4fd22380d304dac9cc3db3ad3c971d9',uuid=cb63619b-6d75-49d0-80ef-d98aa21b7d4a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Converting VIF {"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:23:d3,bridge_name='br-int',has_traffic_filtering=True,id=df73cb37-8475-4c21-89c7-b02949297b63,network=Network(4c9f102f-b100-4ec2-95cb-4c66dafebf29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf73cb37-84') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_vif [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:23:d3,bridge_name='br-int',has_traffic_filtering=True,id=df73cb37-8475-4c21-89c7-b02949297b63,network=Network(4c9f102f-b100-4ec2-95cb-4c66dafebf29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf73cb37-84') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:53:43 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b2a720-4ca0-40d7-b12e-1d8cc66cc240]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.utils [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Updating existing volume attachment record: 3189ba2a-804d-463f-b71f-809c3bbb14c5 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf73cb37-84, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e481196-1192-424e-9d56-866db6f90de2) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:43 user nova-compute[75083]: INFO os_vif [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:23:d3,bridge_name='br-int',has_traffic_filtering=True,id=df73cb37-8475-4c21-89c7-b02949297b63,network=Network(4c9f102f-b100-4ec2-95cb-4c66dafebf29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf73cb37-84')
Nov 29 05:53:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHCjmAZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:53:43 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-d812d7e1-5462-432e-8670-d5446a4476ce req-5dd936f7-dcca-4a1c-b3e6-5d3111672a80 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received event network-vif-plugged-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d812d7e1-5462-432e-8670-d5446a4476ce req-5dd936f7-dcca-4a1c-b3e6-5d3111672a80 service nova] Acquiring lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d812d7e1-5462-432e-8670-d5446a4476ce req-5dd936f7-dcca-4a1c-b3e6-5d3111672a80 service nova] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d812d7e1-5462-432e-8670-d5446a4476ce req-5dd936f7-dcca-4a1c-b3e6-5d3111672a80 service nova] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-d812d7e1-5462-432e-8670-d5446a4476ce req-5dd936f7-dcca-4a1c-b3e6-5d3111672a80 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] No waiting events found dispatching network-vif-plugged-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:53:43 user nova-compute[75083]: WARNING nova.compute.manager [req-d812d7e1-5462-432e-8670-d5446a4476ce req-5dd936f7-dcca-4a1c-b3e6-5d3111672a80 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received unexpected event network-vif-plugged-df73cb37-8475-4c21-89c7-b02949297b63 for instance with vm_state active and task_state shelving.
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a3d5d9-957e-424e-899b-e0ac8914e217]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:53:43 user nova-compute[75083]: No targets found.
Nov 29 05:53:43 user nova-compute[75083]: iSNS:
Nov 29 05:53:43 user nova-compute[75083]: No targets found.
Nov 29 05:53:43 user nova-compute[75083]: STATIC:
Nov 29 05:53:43 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256
Nov 29 05:53:43 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:53:43 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:53:43 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5
Nov 29 05:53:43 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:53:43 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:53:43 user nova-compute[75083]: FIRMWARE:
Nov 29 05:53:43 user nova-compute[75083]: No targets found.
Nov 29 05:53:43 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:53:43 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:53:43 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0feb745-d2a6-4399-948a-c9b7e3bdc75b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3880bed1-231f-443f-b93b-9283bb53d6db]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:53:43 user nova-compute[75083]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:53:43 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:53:43 user nova-compute[75083]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:53:43 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b8559870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256'): ({'sdf'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Removing single pathed devices sdf {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc684988-3cbe-404e-87ae-f859bb11606e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d688132-23c0-417c-9342-d4eab95fbf8c]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Flushing IO for device /dev/sdf {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4804520-0aec-4f46-a64a-f903a670bf6c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2ddd47-a3d1-481d-9c3f-f2fdc7d747dd]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] SCSI volumes sdf have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b6e2b0-ec8b-47a2-8dc7-374984349205]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49f0de8-b1a4-41aa-855c-acd70fef5833]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256, portal: 172.16.0.220,3260]
Nov 29 05:53:43 user nova-compute[75083]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256, portal: 172.16.0.220,3260] successful.
Nov 29 05:53:43 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fbf954-66b0-4b45-984c-6ef1e6e2f512]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] <== disconnect_volume: return (330ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:53:43 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Deleting instance files /opt/stack/data/nova/instances/cb63619b-6d75-49d0-80ef-d98aa21b7d4a_del
Nov 29 05:53:43 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Deletion of /opt/stack/data/nova/instances/cb63619b-6d75-49d0-80ef-d98aa21b7d4a_del complete
Nov 29 05:53:43 user nova-compute[75083]: DEBUG nova.network.neutron [req-87fdb470-b2fb-4b66-b637-182090ad62fb req-9d274bfb-9946-4b1f-9fd0-0621d0f5f087 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Updated VIF entry in instance network info cache for port df73cb37-8475-4c21-89c7-b02949297b63. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG nova.network.neutron [req-87fdb470-b2fb-4b66-b637-182090ad62fb req-9d274bfb-9946-4b1f-9fd0-0621d0f5f087 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Updating instance_info_cache with network_info: [{"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": null, "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapdf73cb37-84", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:53:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-87fdb470-b2fb-4b66-b637-182090ad62fb req-9d274bfb-9946-4b1f-9fd0-0621d0f5f087 service nova] Releasing lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:53:44 user nova-compute[75083]: DEBUG nova.compute.manager [req-84e3fe72-e22b-41e1-914b-5e1335749769 req-dbe5a309-e7e5-46b3-a58b-c835d248757e service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received event network-vif-plugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-84e3fe72-e22b-41e1-914b-5e1335749769 req-dbe5a309-e7e5-46b3-a58b-c835d248757e service nova] Acquiring lock "2778daf0-f727-4185-a404-1793b75ac523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-84e3fe72-e22b-41e1-914b-5e1335749769 req-dbe5a309-e7e5-46b3-a58b-c835d248757e service nova] Lock "2778daf0-f727-4185-a404-1793b75ac523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-84e3fe72-e22b-41e1-914b-5e1335749769 req-dbe5a309-e7e5-46b3-a58b-c835d248757e service nova] Lock "2778daf0-f727-4185-a404-1793b75ac523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:44 user nova-compute[75083]: DEBUG nova.compute.manager [req-84e3fe72-e22b-41e1-914b-5e1335749769 req-dbe5a309-e7e5-46b3-a58b-c835d248757e service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] No waiting events found dispatching network-vif-plugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:53:44 user nova-compute[75083]: WARNING nova.compute.manager [req-84e3fe72-e22b-41e1-914b-5e1335749769 req-dbe5a309-e7e5-46b3-a58b-c835d248757e service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received unexpected event network-vif-plugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 for instance with vm_state building and task_state spawning.
Nov 29 05:53:44 user nova-compute[75083]: DEBUG nova.compute.manager [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:53:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:53:44 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Instance spawned successfully.
Nov 29 05:53:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:53:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:53:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:53:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:53:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:53:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:53:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:53:44 user nova-compute[75083]: INFO nova.compute.manager [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 29 05:53:44 user nova-compute[75083]: DEBUG nova.compute.manager [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:53:44 user nova-compute[75083]: INFO nova.compute.manager [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Took 6.94 seconds to build instance.
Nov 29 05:53:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-207bd3fc-b275-43a4-80d4-63cbd4d3119f tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "2778daf0-f727-4185-a404-1793b75ac523" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.047s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:45 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Deleted allocations for instance cb63619b-6d75-49d0-80ef-d98aa21b7d4a
Nov 29 05:53:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:45 user nova-compute[75083]: DEBUG nova.objects.instance [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lazy-loading 'numa_topology' on Instance uuid cb63619b-6d75-49d0-80ef-d98aa21b7d4a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:53:45 user nova-compute[75083]: DEBUG nova.objects.base [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Object Instance<cb63619b-6d75-49d0-80ef-d98aa21b7d4a> lazy-loaded attributes: resources,numa_topology {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:53:45 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:53:45 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:53:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f11a4985-2c2f-4114-8ada-95229b43beb4 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.760s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:53:51 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Creating image(s)
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Did not create local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Ensure instance console log exists: /opt/stack/data/nova/instances/7c693239-226b-42b1-928e-9a8b7a2a114c/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Start _get_guest_xml network_info=[{"id": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "address": "fa:16:3e:02:29:04", "network": {"id": "338c6d36-9867-4d30-b8b9-5209dd6ae7dc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1555128941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8356c76a38d4b798fbc756795fab89b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5581c9a9-ec", "ovs_interfaceid": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '3189ba2a-804d-463f-b71f-809c3bbb14c5', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnuPAXgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c693239-226b-42b1-928e-9a8b7a2a114c', 'attached_at': '', 'detached_at': '', 'volume_id': '74a643c4-1330-47fc-9deb-fe33aa3bd043', 'serial': '74a643c4-1330-47fc-9deb-fe33aa3bd043'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:53:51 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 05:53:51 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.objects.instance [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7c693239-226b-42b1-928e-9a8b7a2a114c {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnuPAXgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:53:51 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:53:51 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:53:51 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b33efe-72bc-47be-aa97-445a4190032a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:53:51 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf30f69-dc1f-4ee0-bfb1-4b49472f13e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043] added
Nov 29 05:53:51 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8fc132-4929-46a8-b0b2-d01309222ca5]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7903ef2b-f709-4ee3-b455-a7433128aa4c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BnuPAXgE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BnuPAXgE" returned: 0 in 0.030s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4eaec8c-cbd3-42e1-ac49-6198b8f1f155]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BnuPAXgE'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbbdfe9-ffc5-4acb-aaa5-b677b8aba7dc]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7da56c-e43e-47df-96fe-cfff77e0335e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:53:51 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:53:51 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13421fc-aba3-4293-a06b-7a93ffe63ebc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043, portal: 172.16.0.220,3260]
Nov 29 05:53:51 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043, portal: 172.16.0.220,3260] successful.
Nov 29 05:53:51 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f792dc5-51b8-4b2e-b16e-cdd4720166db]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c23a85-0ba2-4e5c-beb1-20db38dfa963]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:53:51 user nova-compute[75083]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:53:51 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:53:51 user nova-compute[75083]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:53:51 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[087ebe81-e4a6-4acd-a6a3-fe524e545d85]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:53:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnuPAXgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23161383539333162', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161383539333162', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T05:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1099529621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1923190517',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVqlBFSwsVSd5Vcbhdct55aXuVEeazXqKnt3H0YMw0ee5MXXhI16+ZwPyHVIMGfFxjyzswiZlnB6srSTk54bx0+gEyQjqkJlEeRzN4KuV8BBahtwESFhSg9w8kgSjIeaQ==',key_name='tempest-keypair-718905469',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:51:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c8356c76a38d4b798fbc756795fab89b',ramdisk_id='',reservation_id='r-zu96bv1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-226818069',owner_user_name='tempest-ServerActionsV293TestJSON-226818069-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49154159b8244161981fb442e2014067',uuid=7c693239-226b-42b1-928e-9a8b7a2a114c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "address": "fa:16:3e:02:29:04", "network": {"id": "338c6d36-9867-4d30-b8b9-5209dd6ae7dc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1555128941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8356c76a38d4b798fbc756795fab89b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5581c9a9-ec", "ovs_interfaceid": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Converting VIF {"id": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "address": "fa:16:3e:02:29:04", "network": {"id": "338c6d36-9867-4d30-b8b9-5209dd6ae7dc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1555128941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8356c76a38d4b798fbc756795fab89b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5581c9a9-ec", "ovs_interfaceid": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:29:04,bridge_name='br-int',has_traffic_filtering=True,id=5581c9a9-ec9e-49f5-b9bb-8e2112b54377,network=Network(338c6d36-9867-4d30-b8b9-5209dd6ae7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5581c9a9-ec') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:53:52 user nova-compute[75083]:   <uuid>7c693239-226b-42b1-928e-9a8b7a2a114c</uuid>
Nov 29 05:53:52 user nova-compute[75083]:   <name>instance-00000010</name>
Nov 29 05:53:52 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:53:52 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:53:52 user nova-compute[75083]:   <metadata>
Nov 29 05:53:52 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:53:52 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:53:52 user nova-compute[75083]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1099529621</nova:name>
Nov 29 05:53:52 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:53:51</nova:creationTime>
Nov 29 05:53:52 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:53:52 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:53:52 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:53:52 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:53:52 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:53:52 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:53:52 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:53:52 user nova-compute[75083]:       <nova:owner>
Nov 29 05:53:52 user nova-compute[75083]:         <nova:user uuid="49154159b8244161981fb442e2014067">tempest-ServerActionsV293TestJSON-226818069-project-member</nova:user>
Nov 29 05:53:52 user nova-compute[75083]:         <nova:project uuid="c8356c76a38d4b798fbc756795fab89b">tempest-ServerActionsV293TestJSON-226818069</nova:project>
Nov 29 05:53:52 user nova-compute[75083]:       </nova:owner>
Nov 29 05:53:52 user nova-compute[75083]:       <nova:ports>
Nov 29 05:53:52 user nova-compute[75083]:         <nova:port uuid="5581c9a9-ec9e-49f5-b9bb-8e2112b54377">
Nov 29 05:53:52 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 05:53:52 user nova-compute[75083]:         </nova:port>
Nov 29 05:53:52 user nova-compute[75083]:       </nova:ports>
Nov 29 05:53:52 user nova-compute[75083]:     </nova:instance>
Nov 29 05:53:52 user nova-compute[75083]:   </metadata>
Nov 29 05:53:52 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:53:52 user nova-compute[75083]:     <system>
Nov 29 05:53:52 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:53:52 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:53:52 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:53:52 user nova-compute[75083]:       <entry name="serial">7c693239-226b-42b1-928e-9a8b7a2a114c</entry>
Nov 29 05:53:52 user nova-compute[75083]:       <entry name="uuid">7c693239-226b-42b1-928e-9a8b7a2a114c</entry>
Nov 29 05:53:52 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:53:52 user nova-compute[75083]:     </system>
Nov 29 05:53:52 user nova-compute[75083]:   </sysinfo>
Nov 29 05:53:52 user nova-compute[75083]:   <os>
Nov 29 05:53:52 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:53:52 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:53:52 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:53:52 user nova-compute[75083]:   </os>
Nov 29 05:53:52 user nova-compute[75083]:   <features>
Nov 29 05:53:52 user nova-compute[75083]:     <acpi/>
Nov 29 05:53:52 user nova-compute[75083]:     <apic/>
Nov 29 05:53:52 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:53:52 user nova-compute[75083]:   </features>
Nov 29 05:53:52 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:53:52 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:53:52 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:53:52 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:53:52 user nova-compute[75083]:   </clock>
Nov 29 05:53:52 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:53:52 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:53:52 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:53:52 user nova-compute[75083]:   </cpu>
Nov 29 05:53:52 user nova-compute[75083]:   <devices>
Nov 29 05:53:52 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 05:53:52 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:53:52 user nova-compute[75083]:       <source dev="/dev/sdb"/>
Nov 29 05:53:52 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:53:52 user nova-compute[75083]:       <serial>74a643c4-1330-47fc-9deb-fe33aa3bd043</serial>
Nov 29 05:53:52 user nova-compute[75083]:     </disk>
Nov 29 05:53:52 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:53:52 user nova-compute[75083]:       <mac address="fa:16:3e:02:29:04"/>
Nov 29 05:53:52 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:53:52 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:53:52 user nova-compute[75083]:       <target dev="tap5581c9a9-ec"/>
Nov 29 05:53:52 user nova-compute[75083]:     </interface>
Nov 29 05:53:52 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:53:52 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/7c693239-226b-42b1-928e-9a8b7a2a114c/console.log" append="off"/>
Nov 29 05:53:52 user nova-compute[75083]:     </serial>
Nov 29 05:53:52 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:53:52 user nova-compute[75083]:     <video>
Nov 29 05:53:52 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:53:52 user nova-compute[75083]:     </video>
Nov 29 05:53:52 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:53:52 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:53:52 user nova-compute[75083]:     </rng>
Nov 29 05:53:52 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:53:52 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:53:52 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:53:52 user nova-compute[75083]:     </memballoon>
Nov 29 05:53:52 user nova-compute[75083]:   </devices>
Nov 29 05:53:52 user nova-compute[75083]: </domain>
Nov 29 05:53:52 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T05:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1099529621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1923190517',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVqlBFSwsVSd5Vcbhdct55aXuVEeazXqKnt3H0YMw0ee5MXXhI16+ZwPyHVIMGfFxjyzswiZlnB6srSTk54bx0+gEyQjqkJlEeRzN4KuV8BBahtwESFhSg9w8kgSjIeaQ==',key_name='tempest-keypair-718905469',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:51:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c8356c76a38d4b798fbc756795fab89b',ramdisk_id='',reservation_id='r-zu96bv1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-226818069',owner_user_name='tempest-ServerActionsV293TestJSON-226818069-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49154159b8244161981fb442e2014067',uuid=7c693239-226b-42b1-928e-9a8b7a2a114c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "address": "fa:16:3e:02:29:04", "network": {"id": "338c6d36-9867-4d30-b8b9-5209dd6ae7dc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1555128941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8356c76a38d4b798fbc756795fab89b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5581c9a9-ec", "ovs_interfaceid": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Converting VIF {"id": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "address": "fa:16:3e:02:29:04", "network": {"id": "338c6d36-9867-4d30-b8b9-5209dd6ae7dc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1555128941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8356c76a38d4b798fbc756795fab89b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5581c9a9-ec", "ovs_interfaceid": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:29:04,bridge_name='br-int',has_traffic_filtering=True,id=5581c9a9-ec9e-49f5-b9bb-8e2112b54377,network=Network(338c6d36-9867-4d30-b8b9-5209dd6ae7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5581c9a9-ec') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG os_vif [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:29:04,bridge_name='br-int',has_traffic_filtering=True,id=5581c9a9-ec9e-49f5-b9bb-8e2112b54377,network=Network(338c6d36-9867-4d30-b8b9-5209dd6ae7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5581c9a9-ec') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94b3f938-017d-5fc7-85ff-543b3f290008', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5581c9a9-ec, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5581c9a9-ec, col_values=(('qos', UUID('d84beca8-e2bb-4f89-b097-455d7d2d0b58')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5581c9a9-ec, col_values=(('external_ids', {'iface-id': '5581c9a9-ec9e-49f5-b9bb-8e2112b54377', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:29:04', 'vm-uuid': '7c693239-226b-42b1-928e-9a8b7a2a114c'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:52 user nova-compute[75083]: INFO os_vif [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:29:04,bridge_name='br-int',has_traffic_filtering=True,id=5581c9a9-ec9e-49f5-b9bb-8e2112b54377,network=Network(338c6d36-9867-4d30-b8b9-5209dd6ae7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5581c9a9-ec')
Nov 29 05:53:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:53:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] No VIF found with MAC fa:16:3e:02:29:04, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:53:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Acquiring lock "f3f2df31-d316-48a4-8d9e-c68c5349a739" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "f3f2df31-d316-48a4-8d9e-c68c5349a739" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Acquiring lock "f3f2df31-d316-48a4-8d9e-c68c5349a739-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "f3f2df31-d316-48a4-8d9e-c68c5349a739-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "f3f2df31-d316-48a4-8d9e-c68c5349a739-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:53 user nova-compute[75083]: INFO nova.compute.manager [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Terminating instance
Nov 29 05:53:53 user nova-compute[75083]: DEBUG nova.compute.manager [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:53:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:53 user nova-compute[75083]: DEBUG nova.compute.manager [req-766f9e3e-88ac-42c7-8d39-57268b72e4a4 req-826ddae4-744f-491d-ab3f-f5c14f4b8130 service nova] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Received event network-vif-unplugged-607671f2-8606-44a1-8100-8b1406c05b4d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-766f9e3e-88ac-42c7-8d39-57268b72e4a4 req-826ddae4-744f-491d-ab3f-f5c14f4b8130 service nova] Acquiring lock "f3f2df31-d316-48a4-8d9e-c68c5349a739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-766f9e3e-88ac-42c7-8d39-57268b72e4a4 req-826ddae4-744f-491d-ab3f-f5c14f4b8130 service nova] Lock "f3f2df31-d316-48a4-8d9e-c68c5349a739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-766f9e3e-88ac-42c7-8d39-57268b72e4a4 req-826ddae4-744f-491d-ab3f-f5c14f4b8130 service nova] Lock "f3f2df31-d316-48a4-8d9e-c68c5349a739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:53 user nova-compute[75083]: DEBUG nova.compute.manager [req-766f9e3e-88ac-42c7-8d39-57268b72e4a4 req-826ddae4-744f-491d-ab3f-f5c14f4b8130 service nova] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] No waiting events found dispatching network-vif-unplugged-607671f2-8606-44a1-8100-8b1406c05b4d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:53:53 user nova-compute[75083]: DEBUG nova.compute.manager [req-766f9e3e-88ac-42c7-8d39-57268b72e4a4 req-826ddae4-744f-491d-ab3f-f5c14f4b8130 service nova] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Received event network-vif-unplugged-607671f2-8606-44a1-8100-8b1406c05b4d for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:53:54 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Instance destroyed successfully.
Nov 29 05:53:54 user nova-compute[75083]: DEBUG nova.objects.instance [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lazy-loading 'resources' on Instance uuid f3f2df31-d316-48a4-8d9e-c68c5349a739 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:53:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-411703319',display_name='tempest-VolumesActionsTest-instance-411703319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-411703319',id=18,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:52:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e9994d0f11f4f3d9d5efd77db3dd8b6',ramdisk_id='',reservation_id='r-w6w3sidb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-357770937',owner_user_name='tempest-VolumesActionsTest-357770937-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:52:11Z,user_data=None,user_id='203e79e1d87b4a74bfc9c665b6cef19d',uuid=f3f2df31-d316-48a4-8d9e-c68c5349a739,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "607671f2-8606-44a1-8100-8b1406c05b4d", "address": "fa:16:3e:89:cf:a4", "network": {"id": "39ff6758-4cee-4758-b66f-7a071d9c68e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-274780460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e9994d0f11f4f3d9d5efd77db3dd8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607671f2-86", "ovs_interfaceid": "607671f2-8606-44a1-8100-8b1406c05b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:53:54 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Converting VIF {"id": "607671f2-8606-44a1-8100-8b1406c05b4d", "address": "fa:16:3e:89:cf:a4", "network": {"id": "39ff6758-4cee-4758-b66f-7a071d9c68e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-274780460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e9994d0f11f4f3d9d5efd77db3dd8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607671f2-86", "ovs_interfaceid": "607671f2-8606-44a1-8100-8b1406c05b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:53:54 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:cf:a4,bridge_name='br-int',has_traffic_filtering=True,id=607671f2-8606-44a1-8100-8b1406c05b4d,network=Network(39ff6758-4cee-4758-b66f-7a071d9c68e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607671f2-86') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:53:54 user nova-compute[75083]: DEBUG os_vif [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:cf:a4,bridge_name='br-int',has_traffic_filtering=True,id=607671f2-8606-44a1-8100-8b1406c05b4d,network=Network(39ff6758-4cee-4758-b66f-7a071d9c68e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607671f2-86') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:53:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap607671f2-86, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:53:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8954debf-096f-4da2-a0d8-b7fbb4cbc530) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:53:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:53:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:54 user nova-compute[75083]: INFO os_vif [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:cf:a4,bridge_name='br-int',has_traffic_filtering=True,id=607671f2-8606-44a1-8100-8b1406c05b4d,network=Network(39ff6758-4cee-4758-b66f-7a071d9c68e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607671f2-86')
Nov 29 05:53:54 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Deleting instance files /opt/stack/data/nova/instances/f3f2df31-d316-48a4-8d9e-c68c5349a739_del
Nov 29 05:53:54 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Deletion of /opt/stack/data/nova/instances/f3f2df31-d316-48a4-8d9e-c68c5349a739_del complete
Nov 29 05:53:54 user nova-compute[75083]: INFO nova.compute.manager [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Took 1.47 seconds to destroy the instance on the hypervisor.
Nov 29 05:53:54 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 05:53:54 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 05:53:54 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 05:53:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-2ad824e2-7de3-4dac-92c1-36163e9af105 req-f30899da-9c3c-44c7-962a-419d4254e660 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Received event network-vif-plugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2ad824e2-7de3-4dac-92c1-36163e9af105 req-f30899da-9c3c-44c7-962a-419d4254e660 service nova] Acquiring lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2ad824e2-7de3-4dac-92c1-36163e9af105 req-f30899da-9c3c-44c7-962a-419d4254e660 service nova] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2ad824e2-7de3-4dac-92c1-36163e9af105 req-f30899da-9c3c-44c7-962a-419d4254e660 service nova] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-2ad824e2-7de3-4dac-92c1-36163e9af105 req-f30899da-9c3c-44c7-962a-419d4254e660 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] No waiting events found dispatching network-vif-plugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:53:55 user nova-compute[75083]: WARNING nova.compute.manager [req-2ad824e2-7de3-4dac-92c1-36163e9af105 req-f30899da-9c3c-44c7-962a-419d4254e660 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Received unexpected event network-vif-plugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 05:53:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:55 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:53:55 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Took 0.74 seconds to deallocate network for instance.
Nov 29 05:53:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-e4e3522c-4df3-4425-b0ba-2220add59f3b req-276de5b3-70f1-4192-a94b-7ac8a01ffc63 service nova] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Received event network-vif-plugged-607671f2-8606-44a1-8100-8b1406c05b4d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e4e3522c-4df3-4425-b0ba-2220add59f3b req-276de5b3-70f1-4192-a94b-7ac8a01ffc63 service nova] Acquiring lock "f3f2df31-d316-48a4-8d9e-c68c5349a739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e4e3522c-4df3-4425-b0ba-2220add59f3b req-276de5b3-70f1-4192-a94b-7ac8a01ffc63 service nova] Lock "f3f2df31-d316-48a4-8d9e-c68c5349a739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e4e3522c-4df3-4425-b0ba-2220add59f3b req-276de5b3-70f1-4192-a94b-7ac8a01ffc63 service nova] Lock "f3f2df31-d316-48a4-8d9e-c68c5349a739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-e4e3522c-4df3-4425-b0ba-2220add59f3b req-276de5b3-70f1-4192-a94b-7ac8a01ffc63 service nova] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] No waiting events found dispatching network-vif-plugged-607671f2-8606-44a1-8100-8b1406c05b4d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:53:55 user nova-compute[75083]: WARNING nova.compute.manager [req-e4e3522c-4df3-4425-b0ba-2220add59f3b req-276de5b3-70f1-4192-a94b-7ac8a01ffc63 service nova] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Received unexpected event network-vif-plugged-607671f2-8606-44a1-8100-8b1406c05b4d for instance with vm_state deleted and task_state None.
Nov 29 05:53:55 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:53:55 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:53:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:56 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Deleted allocations for instance f3f2df31-d316-48a4-8d9e-c68c5349a739
Nov 29 05:53:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-84161747-dc49-4cbe-894c-abd958c55a44 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "f3f2df31-d316-48a4-8d9e-c68c5349a739" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.816s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:56 user nova-compute[75083]: DEBUG nova.compute.manager [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:53:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:53:56 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Instance spawned successfully.
Nov 29 05:53:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:53:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:53:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:53:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:53:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:53:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:53:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:53:57 user nova-compute[75083]: DEBUG nova.compute.manager [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:53:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-547cb2d9-7d90-443f-bbeb-135534f113bd req-88dc7ca3-6574-4272-815a-fa6e6e1aa6ab service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Received event network-vif-plugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-547cb2d9-7d90-443f-bbeb-135534f113bd req-88dc7ca3-6574-4272-815a-fa6e6e1aa6ab service nova] Acquiring lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-547cb2d9-7d90-443f-bbeb-135534f113bd req-88dc7ca3-6574-4272-815a-fa6e6e1aa6ab service nova] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-547cb2d9-7d90-443f-bbeb-135534f113bd req-88dc7ca3-6574-4272-815a-fa6e6e1aa6ab service nova] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-547cb2d9-7d90-443f-bbeb-135534f113bd req-88dc7ca3-6574-4272-815a-fa6e6e1aa6ab service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] No waiting events found dispatching network-vif-plugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:53:57 user nova-compute[75083]: WARNING nova.compute.manager [req-547cb2d9-7d90-443f-bbeb-135534f113bd req-88dc7ca3-6574-4272-815a-fa6e6e1aa6ab service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Received unexpected event network-vif-plugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 05:53:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-547cb2d9-7d90-443f-bbeb-135534f113bd req-88dc7ca3-6574-4272-815a-fa6e6e1aa6ab service nova] [instance: f3f2df31-d316-48a4-8d9e-c68c5349a739] Received event network-vif-deleted-607671f2-8606-44a1-8100-8b1406c05b4d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:57 user nova-compute[75083]: DEBUG nova.objects.instance [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75083) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 29 05:53:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2c0388d2-3dc3-4862-8cb0-b5ccf57d889d tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.092s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:57 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:53:58 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:53:58 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 05:53:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Acquiring lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Acquiring lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:58 user nova-compute[75083]: INFO nova.compute.manager [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Terminating instance
Nov 29 05:53:58 user nova-compute[75083]: DEBUG nova.compute.manager [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:53:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG nova.compute.manager [req-df11eb9f-fbb8-4f63-bbf9-fcab874af155 req-564e2de7-9948-4a14-bd40-0ef1ac0c1987 service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Received event network-vif-unplugged-85f6598a-8c09-4f42-9eef-143573c095f9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-df11eb9f-fbb8-4f63-bbf9-fcab874af155 req-564e2de7-9948-4a14-bd40-0ef1ac0c1987 service nova] Acquiring lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-df11eb9f-fbb8-4f63-bbf9-fcab874af155 req-564e2de7-9948-4a14-bd40-0ef1ac0c1987 service nova] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-df11eb9f-fbb8-4f63-bbf9-fcab874af155 req-564e2de7-9948-4a14-bd40-0ef1ac0c1987 service nova] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG nova.compute.manager [req-df11eb9f-fbb8-4f63-bbf9-fcab874af155 req-564e2de7-9948-4a14-bd40-0ef1ac0c1987 service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] No waiting events found dispatching network-vif-unplugged-85f6598a-8c09-4f42-9eef-143573c095f9 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG nova.compute.manager [req-df11eb9f-fbb8-4f63-bbf9-fcab874af155 req-564e2de7-9948-4a14-bd40-0ef1ac0c1987 service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Received event network-vif-unplugged-85f6598a-8c09-4f42-9eef-143573c095f9 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:53:59 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Instance destroyed successfully.
Nov 29 05:53:59 user nova-compute[75083]: DEBUG nova.objects.instance [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lazy-loading 'resources' on Instance uuid 2acbda14-e4bc-49ac-81e2-ce28bc3878d4 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:50:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1458212276',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1458212276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1458212',id=14,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESEkLHEoBdMzdSMb9XzikmlT5YXWY0X3x1v0kujqVArmmUir0E9dflLTURqNUt969HhmNERPMEYvmGUagoE1xhT0kZ8ZH+Lg6sor2h+dEnJln6ZPsmTXYVGeqtvl5mf5g==',key_name='tempest-keypair-1328848208',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:51:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5501672b5066489aa61e9a9e26e9d5e2',ramdisk_id='',reservation_id='r-b59kriej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1346150636',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:51:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b064ac59001b4360b9818f486491616b',uuid=2acbda14-e4bc-49ac-81e2-ce28bc3878d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85f6598a-8c09-4f42-9eef-143573c095f9", "address": "fa:16:3e:8d:52:51", "network": {"id": "6c528f9c-4754-47e2-91db-2d70336b8dd7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-743033576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5501672b5066489aa61e9a9e26e9d5e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6598a-8c", "ovs_interfaceid": "85f6598a-8c09-4f42-9eef-143573c095f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Converting VIF {"id": "85f6598a-8c09-4f42-9eef-143573c095f9", "address": "fa:16:3e:8d:52:51", "network": {"id": "6c528f9c-4754-47e2-91db-2d70336b8dd7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-743033576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5501672b5066489aa61e9a9e26e9d5e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6598a-8c", "ovs_interfaceid": "85f6598a-8c09-4f42-9eef-143573c095f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:52:51,bridge_name='br-int',has_traffic_filtering=True,id=85f6598a-8c09-4f42-9eef-143573c095f9,network=Network(6c528f9c-4754-47e2-91db-2d70336b8dd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f6598a-8c') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG os_vif [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:52:51,bridge_name='br-int',has_traffic_filtering=True,id=85f6598a-8c09-4f42-9eef-143573c095f9,network=Network(6c528f9c-4754-47e2-91db-2d70336b8dd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f6598a-8c') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85f6598a-8c, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43dc0d9f-4631-45c9-bab8-cb301b08eb55) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:53:59 user nova-compute[75083]: INFO os_vif [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:52:51,bridge_name='br-int',has_traffic_filtering=True,id=85f6598a-8c09-4f42-9eef-143573c095f9,network=Network(6c528f9c-4754-47e2-91db-2d70336b8dd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f6598a-8c')
Nov 29 05:53:59 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Deleting instance files /opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4_del
Nov 29 05:53:59 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Deletion of /opt/stack/data/nova/instances/2acbda14-e4bc-49ac-81e2-ce28bc3878d4_del complete
Nov 29 05:53:59 user nova-compute[75083]: INFO nova.compute.manager [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 29 05:53:59 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 05:53:59 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 05:54:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:54:00 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:54:00 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Took 1.13 seconds to deallocate network for instance.
Nov 29 05:54:00 user nova-compute[75083]: DEBUG nova.compute.manager [req-a2adf000-9594-4899-a602-9493d4484f93 req-e2ec1503-5030-4526-9d0e-f63d819f2e1f service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Received event network-vif-deleted-85f6598a-8c09-4f42-9eef-143573c095f9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:54:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:01 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:54:01 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:54:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:01 user nova-compute[75083]: DEBUG nova.compute.manager [req-f5eb95ab-1c63-4ed4-bdba-6b370499b9c8 req-632ad1fa-cb4e-499e-b73d-bc0b2a27b1bc service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Received event network-vif-plugged-85f6598a-8c09-4f42-9eef-143573c095f9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:54:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f5eb95ab-1c63-4ed4-bdba-6b370499b9c8 req-632ad1fa-cb4e-499e-b73d-bc0b2a27b1bc service nova] Acquiring lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f5eb95ab-1c63-4ed4-bdba-6b370499b9c8 req-632ad1fa-cb4e-499e-b73d-bc0b2a27b1bc service nova] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f5eb95ab-1c63-4ed4-bdba-6b370499b9c8 req-632ad1fa-cb4e-499e-b73d-bc0b2a27b1bc service nova] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:01 user nova-compute[75083]: DEBUG nova.compute.manager [req-f5eb95ab-1c63-4ed4-bdba-6b370499b9c8 req-632ad1fa-cb4e-499e-b73d-bc0b2a27b1bc service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] No waiting events found dispatching network-vif-plugged-85f6598a-8c09-4f42-9eef-143573c095f9 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:54:01 user nova-compute[75083]: WARNING nova.compute.manager [req-f5eb95ab-1c63-4ed4-bdba-6b370499b9c8 req-632ad1fa-cb4e-499e-b73d-bc0b2a27b1bc service nova] [instance: 2acbda14-e4bc-49ac-81e2-ce28bc3878d4] Received unexpected event network-vif-plugged-85f6598a-8c09-4f42-9eef-143573c095f9 for instance with vm_state deleted and task_state None.
Nov 29 05:54:01 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Deleted allocations for instance 2acbda14-e4bc-49ac-81e2-ce28bc3878d4
Nov 29 05:54:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cca2472e-d3f7-4856-87a0-e60c89e3651a tempest-TestServerVolumeAttachScenarioOldVersion-1346150636 tempest-TestServerVolumeAttachScenarioOldVersion-1346150636-project-member] Lock "2acbda14-e4bc-49ac-81e2-ce28bc3878d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.822s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:01 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:54:02 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:54:03 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:54:03 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:54:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:03 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 05:54:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:54:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:54:06 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:54:06 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:54:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=7948MB free_disk=25.421741485595703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 05:54:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance e6d49806-cecd-473a-b92f-9255868d35c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:54:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 161c6455-90ce-4c40-a33e-7f582989135d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:54:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b6d38a2c-a512-41f2-a7df-6a54058f8f8b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:54:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:54:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fb8244c4-f2a7-4ad8-a210-0f62c165a4dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:54:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 7c693239-226b-42b1-928e-9a8b7a2a114c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:54:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 2778daf0-f727-4185-a404-1793b75ac523 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:54:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 05:54:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 05:54:06 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:54:06 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:54:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 05:54:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.393s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:07 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:54:07 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 05:54:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:54:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:54:07 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 05:54:08 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Updating instance_info_cache with network_info: [{"id": "188d4866-21b0-4a1e-a17a-c0c82e849726", "address": "fa:16:3e:a8:14:4a", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d4866-21", "ovs_interfaceid": "188d4866-21b0-4a1e-a17a-c0c82e849726", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:54:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:54:08 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 05:54:08 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:54:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:19 user nova-compute[75083]: DEBUG nova.objects.instance [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'flavor' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:54:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:54:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquired lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:54:19 user nova-compute[75083]: DEBUG nova.network.neutron [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:54:19 user nova-compute[75083]: DEBUG nova.objects.instance [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'info_cache' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:54:19 user nova-compute[75083]: DEBUG nova.objects.base [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Object Instance<e6d49806-cecd-473a-b92f-9255868d35c7> lazy-loaded attributes: flavor,info_cache {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:54:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:19 user nova-compute[75083]: DEBUG nova.network.neutron [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Updating instance_info_cache with network_info: [{"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:54:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Releasing lock "refresh_cache-e6d49806-cecd-473a-b92f-9255868d35c7" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:54:19 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Instance destroyed successfully.
Nov 29 05:54:19 user nova-compute[75083]: DEBUG nova.objects.instance [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'resources' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:54:19 user nova-compute[75083]: DEBUG nova.objects.base [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Object Instance<e6d49806-cecd-473a-b92f-9255868d35c7> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:54:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1653680976',display_name='tempest-AttachVolumeTestJSON-server-1653680976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1653680976',id=1,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOJP1hrn9YscfxvgIeV/wzeq3iJtsHPsw4UYwsBDpY8QrDAnobm8WRbnfZio9s2zPze+QLzStURV3KhLmNcFlFIYVxh1xHzL9FnGoRwL1BjeWphRTOqz9jLnn2TEGffsg==',key_name='tempest-keypair-1515818350',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c4c1cb7a503b446f945f12b3b998035b',ramdisk_id='',reservation_id='r-50iyzeul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1539985865',owner_user_name='tempest-AttachVolumeTestJSON-1539985865-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:52:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f2d92aba5c4069b94b8a5cd8b72a46',uuid=e6d49806-cecd-473a-b92f-9255868d35c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:54:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converting VIF {"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:54:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:54:19 user nova-compute[75083]: DEBUG os_vif [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:54:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ec74c9e-a1, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=929e5894-8d4c-4d79-becb-7b18ff92a9de) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:54:20 user nova-compute[75083]: INFO os_vif [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1')
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Start _get_guest_xml network_info=[{"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.objects.instance [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'numa_topology' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.objects.base [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Object Instance<e6d49806-cecd-473a-b92f-9255868d35c7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:54:20 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:54:20 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.objects.instance [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.objects.base [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Object Instance<e6d49806-cecd-473a-b92f-9255868d35c7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1653680976',display_name='tempest-AttachVolumeTestJSON-server-1653680976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1653680976',id=1,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOJP1hrn9YscfxvgIeV/wzeq3iJtsHPsw4UYwsBDpY8QrDAnobm8WRbnfZio9s2zPze+QLzStURV3KhLmNcFlFIYVxh1xHzL9FnGoRwL1BjeWphRTOqz9jLnn2TEGffsg==',key_name='tempest-keypair-1515818350',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c4c1cb7a503b446f945f12b3b998035b',ramdisk_id='',reservation_id='r-50iyzeul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1539985865',owner_user_name='tempest-AttachVolumeTestJSON-1539985865-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:52:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f2d92aba5c4069b94b8a5cd8b72a46',uuid=e6d49806-cecd-473a-b92f-9255868d35c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converting VIF {"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.objects.instance [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'pci_devices' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.objects.base [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Object Instance<e6d49806-cecd-473a-b92f-9255868d35c7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:54:20 user nova-compute[75083]:   <uuid>e6d49806-cecd-473a-b92f-9255868d35c7</uuid>
Nov 29 05:54:20 user nova-compute[75083]:   <name>instance-00000001</name>
Nov 29 05:54:20 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:54:20 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:54:20 user nova-compute[75083]:   <metadata>
Nov 29 05:54:20 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:54:20 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:54:20 user nova-compute[75083]:       <nova:name>tempest-AttachVolumeTestJSON-server-1653680976</nova:name>
Nov 29 05:54:20 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:54:20</nova:creationTime>
Nov 29 05:54:20 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:54:20 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:54:20 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:54:20 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:54:20 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:54:20 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:54:20 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:54:20 user nova-compute[75083]:       <nova:owner>
Nov 29 05:54:20 user nova-compute[75083]:         <nova:user uuid="25f2d92aba5c4069b94b8a5cd8b72a46">tempest-AttachVolumeTestJSON-1539985865-project-member</nova:user>
Nov 29 05:54:20 user nova-compute[75083]:         <nova:project uuid="c4c1cb7a503b446f945f12b3b998035b">tempest-AttachVolumeTestJSON-1539985865</nova:project>
Nov 29 05:54:20 user nova-compute[75083]:       </nova:owner>
Nov 29 05:54:20 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:54:20 user nova-compute[75083]:       <nova:ports>
Nov 29 05:54:20 user nova-compute[75083]:         <nova:port uuid="1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0">
Nov 29 05:54:20 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 05:54:20 user nova-compute[75083]:         </nova:port>
Nov 29 05:54:20 user nova-compute[75083]:       </nova:ports>
Nov 29 05:54:20 user nova-compute[75083]:     </nova:instance>
Nov 29 05:54:20 user nova-compute[75083]:   </metadata>
Nov 29 05:54:20 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:54:20 user nova-compute[75083]:     <system>
Nov 29 05:54:20 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:54:20 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:54:20 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:54:20 user nova-compute[75083]:       <entry name="serial">e6d49806-cecd-473a-b92f-9255868d35c7</entry>
Nov 29 05:54:20 user nova-compute[75083]:       <entry name="uuid">e6d49806-cecd-473a-b92f-9255868d35c7</entry>
Nov 29 05:54:20 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:54:20 user nova-compute[75083]:     </system>
Nov 29 05:54:20 user nova-compute[75083]:   </sysinfo>
Nov 29 05:54:20 user nova-compute[75083]:   <os>
Nov 29 05:54:20 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:54:20 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:54:20 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:54:20 user nova-compute[75083]:   </os>
Nov 29 05:54:20 user nova-compute[75083]:   <features>
Nov 29 05:54:20 user nova-compute[75083]:     <acpi/>
Nov 29 05:54:20 user nova-compute[75083]:     <apic/>
Nov 29 05:54:20 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:54:20 user nova-compute[75083]:   </features>
Nov 29 05:54:20 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:54:20 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:54:20 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:54:20 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:54:20 user nova-compute[75083]:   </clock>
Nov 29 05:54:20 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:54:20 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:54:20 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:54:20 user nova-compute[75083]:   </cpu>
Nov 29 05:54:20 user nova-compute[75083]:   <devices>
Nov 29 05:54:20 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:54:20 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:54:20 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk"/>
Nov 29 05:54:20 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:54:20 user nova-compute[75083]:     </disk>
Nov 29 05:54:20 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:54:20 user nova-compute[75083]:       <mac address="fa:16:3e:7a:b6:78"/>
Nov 29 05:54:20 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:54:20 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:54:20 user nova-compute[75083]:       <target dev="tap1ec74c9e-a1"/>
Nov 29 05:54:20 user nova-compute[75083]:     </interface>
Nov 29 05:54:20 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:54:20 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/console.log" append="off"/>
Nov 29 05:54:20 user nova-compute[75083]:     </serial>
Nov 29 05:54:20 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:54:20 user nova-compute[75083]:     <video>
Nov 29 05:54:20 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:54:20 user nova-compute[75083]:     </video>
Nov 29 05:54:20 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:54:20 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:54:20 user nova-compute[75083]:     </rng>
Nov 29 05:54:20 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:54:20 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:54:20 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:54:20 user nova-compute[75083]:     </memballoon>
Nov 29 05:54:20 user nova-compute[75083]:   </devices>
Nov 29 05:54:20 user nova-compute[75083]: </domain>
Nov 29 05:54:20 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.objects.instance [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'trusted_certs' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.objects.base [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Object Instance<e6d49806-cecd-473a-b92f-9255868d35c7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Cannot resize image /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.objects.instance [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'migration_context' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.objects.base [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Object Instance<e6d49806-cecd-473a-b92f-9255868d35c7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1653680976',display_name='tempest-AttachVolumeTestJSON-server-1653680976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1653680976',id=1,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOJP1hrn9YscfxvgIeV/wzeq3iJtsHPsw4UYwsBDpY8QrDAnobm8WRbnfZio9s2zPze+QLzStURV3KhLmNcFlFIYVxh1xHzL9FnGoRwL1BjeWphRTOqz9jLnn2TEGffsg==',key_name='tempest-keypair-1515818350',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c4c1cb7a503b446f945f12b3b998035b',ramdisk_id='',reservation_id='r-50iyzeul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1539985865',owner_user_name='tempest-AttachVolumeTestJSON-1539985865-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:52:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f2d92aba5c4069b94b8a5cd8b72a46',uuid=e6d49806-cecd-473a-b92f-9255868d35c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converting VIF {"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG os_vif [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05a6127a-48f5-5d96-ae49-756bfea79ee2', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ec74c9e-a1, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ec74c9e-a1, col_values=(('qos', UUID('be5e6c51-e12a-4bec-b8cb-0f83fda33464')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ec74c9e-a1, col_values=(('external_ids', {'iface-id': '1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:b6:78', 'vm-uuid': 'e6d49806-cecd-473a-b92f-9255868d35c7'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:54:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:20 user nova-compute[75083]: INFO os_vif [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1')
Nov 29 05:54:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:22 user nova-compute[75083]: DEBUG nova.compute.manager [req-823d52b2-22de-4dd1-b167-eb1d7486a4fb req-1cfac9ea-154e-42d3-9e56-a3011d99fa83 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:54:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-823d52b2-22de-4dd1-b167-eb1d7486a4fb req-1cfac9ea-154e-42d3-9e56-a3011d99fa83 service nova] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-823d52b2-22de-4dd1-b167-eb1d7486a4fb req-1cfac9ea-154e-42d3-9e56-a3011d99fa83 service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-823d52b2-22de-4dd1-b167-eb1d7486a4fb req-1cfac9ea-154e-42d3-9e56-a3011d99fa83 service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:22 user nova-compute[75083]: DEBUG nova.compute.manager [req-823d52b2-22de-4dd1-b167-eb1d7486a4fb req-1cfac9ea-154e-42d3-9e56-a3011d99fa83 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] No waiting events found dispatching network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:54:22 user nova-compute[75083]: WARNING nova.compute.manager [req-823d52b2-22de-4dd1-b167-eb1d7486a4fb req-1cfac9ea-154e-42d3-9e56-a3011d99fa83 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received unexpected event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 for instance with vm_state stopped and task_state powering-on.
Nov 29 05:54:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:24 user nova-compute[75083]: DEBUG nova.compute.manager [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:54:24 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Instance rebooted successfully.
Nov 29 05:54:24 user nova-compute[75083]: DEBUG nova.compute.manager [None req-1b68a713-dfb0-45ca-9fd5-a54998cf2201 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:54:24 user nova-compute[75083]: DEBUG nova.compute.manager [req-9e67a246-cfa6-4f47-a179-a446d4297fb2 req-91415afd-d3c6-4d39-9e1a-6913f27799bb service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:54:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9e67a246-cfa6-4f47-a179-a446d4297fb2 req-91415afd-d3c6-4d39-9e1a-6913f27799bb service nova] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9e67a246-cfa6-4f47-a179-a446d4297fb2 req-91415afd-d3c6-4d39-9e1a-6913f27799bb service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9e67a246-cfa6-4f47-a179-a446d4297fb2 req-91415afd-d3c6-4d39-9e1a-6913f27799bb service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:24 user nova-compute[75083]: DEBUG nova.compute.manager [req-9e67a246-cfa6-4f47-a179-a446d4297fb2 req-91415afd-d3c6-4d39-9e1a-6913f27799bb service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] No waiting events found dispatching network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:54:24 user nova-compute[75083]: WARNING nova.compute.manager [req-9e67a246-cfa6-4f47-a179-a446d4297fb2 req-91415afd-d3c6-4d39-9e1a-6913f27799bb service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received unexpected event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 for instance with vm_state active and task_state None.
Nov 29 05:54:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "4435ed78-e35f-4859-8a4f-9920815d968a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "4435ed78-e35f-4859-8a4f-9920815d968a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:54:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:54:26 user nova-compute[75083]: INFO nova.compute.claims [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Claim successful on node user
Nov 29 05:54:26 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:54:26 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:54:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG nova.compute.manager [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG nova.network.neutron [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:54:27 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:54:27 user nova-compute[75083]: DEBUG nova.compute.manager [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG nova.policy [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb74d3aef4664ff8bdec4110c6867056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7833259e5df546ba86139af68fcb7906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "a34d9d98-be73-4d52-85f0-83e48f60bc12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG nova.compute.manager [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG nova.compute.manager [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:54:27 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Creating image(s)
Nov 29 05:54:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "/opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "/opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "/opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.020s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:54:27 user nova-compute[75083]: INFO nova.compute.claims [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Claim successful on node user
Nov 29 05:54:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.186s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.183s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk 1073741824" returned: 0 in 0.048s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG nova.network.neutron [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Successfully created port: 1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG nova.compute.manager [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG nova.compute.manager [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG nova.network.neutron [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:54:27 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:54:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.219s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:27 user nova-compute[75083]: DEBUG nova.compute.manager [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG nova.policy [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb74d3aef4664ff8bdec4110c6867056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7833259e5df546ba86139af68fcb7906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:54:28 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Creating image(s)
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "/opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "/opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "/opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Cannot resize image /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Ensure instance console log exists: /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.178s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk 1073741824" returned: 0 in 0.049s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Cannot resize image /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Ensure instance console log exists: /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:29 user nova-compute[75083]: DEBUG nova.network.neutron [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Successfully updated port: 1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:54:29 user nova-compute[75083]: DEBUG nova.network.neutron [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Successfully created port: b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:54:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:54:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquired lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:54:29 user nova-compute[75083]: DEBUG nova.network.neutron [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:54:29 user nova-compute[75083]: DEBUG nova.compute.manager [req-86c76f02-1b8f-4fff-93aa-45e2e2c46472 req-f5427208-c322-48f3-a54b-0138fe4ffc1f service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received event network-changed-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:54:29 user nova-compute[75083]: DEBUG nova.compute.manager [req-86c76f02-1b8f-4fff-93aa-45e2e2c46472 req-f5427208-c322-48f3-a54b-0138fe4ffc1f service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Refreshing instance network info cache due to event network-changed-1f259ece-bce2-4aab-925b-26e4f9619fbf. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:54:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-86c76f02-1b8f-4fff-93aa-45e2e2c46472 req-f5427208-c322-48f3-a54b-0138fe4ffc1f service nova] Acquiring lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:54:29 user nova-compute[75083]: DEBUG nova.network.neutron [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.network.neutron [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Updating instance_info_cache with network_info: [{"id": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "address": "fa:16:3e:8d:3b:2a", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f259ece-bc", "ovs_interfaceid": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Releasing lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.compute.manager [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Instance network_info: |[{"id": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "address": "fa:16:3e:8d:3b:2a", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f259ece-bc", "ovs_interfaceid": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-86c76f02-1b8f-4fff-93aa-45e2e2c46472 req-f5427208-c322-48f3-a54b-0138fe4ffc1f service nova] Acquired lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.network.neutron [req-86c76f02-1b8f-4fff-93aa-45e2e2c46472 req-f5427208-c322-48f3-a54b-0138fe4ffc1f service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Refreshing network info cache for port 1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Start _get_guest_xml network_info=[{"id": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "address": "fa:16:3e:8d:3b:2a", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f259ece-bc", "ovs_interfaceid": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:54:30 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:54:30 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:54:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-131916452',display_name='tempest-ServerRescueNegativeTestJSON-server-131916452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-131916452',id=20,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7833259e5df546ba86139af68fcb7906',ramdisk_id='',reservation_id='r-yjx8q1as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1120078925',owner_user_name='tempest-ServerRescueNegativeTestJSON-1120078925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:54:27Z,user_data=None,user_id='eb74d3aef4664ff8bdec4110c6867056',uuid=4435ed78-e35f-4859-8a4f-9920815d968a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "address": "fa:16:3e:8d:3b:2a", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f259ece-bc", "ovs_interfaceid": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converting VIF {"id": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "address": "fa:16:3e:8d:3b:2a", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f259ece-bc", "ovs_interfaceid": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:3b:2a,bridge_name='br-int',has_traffic_filtering=True,id=1f259ece-bce2-4aab-925b-26e4f9619fbf,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f259ece-bc') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.objects.instance [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'pci_devices' on Instance uuid 4435ed78-e35f-4859-8a4f-9920815d968a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:54:30 user nova-compute[75083]:   <uuid>4435ed78-e35f-4859-8a4f-9920815d968a</uuid>
Nov 29 05:54:30 user nova-compute[75083]:   <name>instance-00000014</name>
Nov 29 05:54:30 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:54:30 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:54:30 user nova-compute[75083]:   <metadata>
Nov 29 05:54:30 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:54:30 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:54:30 user nova-compute[75083]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-131916452</nova:name>
Nov 29 05:54:30 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:54:30</nova:creationTime>
Nov 29 05:54:30 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:54:30 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:54:30 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:54:30 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:54:30 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:54:30 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:54:30 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:54:30 user nova-compute[75083]:       <nova:owner>
Nov 29 05:54:30 user nova-compute[75083]:         <nova:user uuid="eb74d3aef4664ff8bdec4110c6867056">tempest-ServerRescueNegativeTestJSON-1120078925-project-member</nova:user>
Nov 29 05:54:30 user nova-compute[75083]:         <nova:project uuid="7833259e5df546ba86139af68fcb7906">tempest-ServerRescueNegativeTestJSON-1120078925</nova:project>
Nov 29 05:54:30 user nova-compute[75083]:       </nova:owner>
Nov 29 05:54:30 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:54:30 user nova-compute[75083]:       <nova:ports>
Nov 29 05:54:30 user nova-compute[75083]:         <nova:port uuid="1f259ece-bce2-4aab-925b-26e4f9619fbf">
Nov 29 05:54:30 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 05:54:30 user nova-compute[75083]:         </nova:port>
Nov 29 05:54:30 user nova-compute[75083]:       </nova:ports>
Nov 29 05:54:30 user nova-compute[75083]:     </nova:instance>
Nov 29 05:54:30 user nova-compute[75083]:   </metadata>
Nov 29 05:54:30 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:54:30 user nova-compute[75083]:     <system>
Nov 29 05:54:30 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:54:30 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:54:30 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:54:30 user nova-compute[75083]:       <entry name="serial">4435ed78-e35f-4859-8a4f-9920815d968a</entry>
Nov 29 05:54:30 user nova-compute[75083]:       <entry name="uuid">4435ed78-e35f-4859-8a4f-9920815d968a</entry>
Nov 29 05:54:30 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:54:30 user nova-compute[75083]:     </system>
Nov 29 05:54:30 user nova-compute[75083]:   </sysinfo>
Nov 29 05:54:30 user nova-compute[75083]:   <os>
Nov 29 05:54:30 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:54:30 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:54:30 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:54:30 user nova-compute[75083]:   </os>
Nov 29 05:54:30 user nova-compute[75083]:   <features>
Nov 29 05:54:30 user nova-compute[75083]:     <acpi/>
Nov 29 05:54:30 user nova-compute[75083]:     <apic/>
Nov 29 05:54:30 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:54:30 user nova-compute[75083]:   </features>
Nov 29 05:54:30 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:54:30 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:54:30 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:54:30 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:54:30 user nova-compute[75083]:   </clock>
Nov 29 05:54:30 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:54:30 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:54:30 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:54:30 user nova-compute[75083]:   </cpu>
Nov 29 05:54:30 user nova-compute[75083]:   <devices>
Nov 29 05:54:30 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:54:30 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:54:30 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk"/>
Nov 29 05:54:30 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:54:30 user nova-compute[75083]:     </disk>
Nov 29 05:54:30 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:54:30 user nova-compute[75083]:       <mac address="fa:16:3e:8d:3b:2a"/>
Nov 29 05:54:30 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:54:30 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:54:30 user nova-compute[75083]:       <target dev="tap1f259ece-bc"/>
Nov 29 05:54:30 user nova-compute[75083]:     </interface>
Nov 29 05:54:30 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:54:30 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/console.log" append="off"/>
Nov 29 05:54:30 user nova-compute[75083]:     </serial>
Nov 29 05:54:30 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:54:30 user nova-compute[75083]:     <video>
Nov 29 05:54:30 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:54:30 user nova-compute[75083]:     </video>
Nov 29 05:54:30 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:54:30 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:54:30 user nova-compute[75083]:     </rng>
Nov 29 05:54:30 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:54:30 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:54:30 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:54:30 user nova-compute[75083]:     </memballoon>
Nov 29 05:54:30 user nova-compute[75083]:   </devices>
Nov 29 05:54:30 user nova-compute[75083]: </domain>
Nov 29 05:54:30 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:54:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-131916452',display_name='tempest-ServerRescueNegativeTestJSON-server-131916452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-131916452',id=20,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7833259e5df546ba86139af68fcb7906',ramdisk_id='',reservation_id='r-yjx8q1as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1120078925',owner_user_name='tempest-ServerRescueNegativeTestJSON-1120078925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:54:27Z,user_data=None,user_id='eb74d3aef4664ff8bdec4110c6867056',uuid=4435ed78-e35f-4859-8a4f-9920815d968a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "address": "fa:16:3e:8d:3b:2a", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f259ece-bc", "ovs_interfaceid": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converting VIF {"id": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "address": "fa:16:3e:8d:3b:2a", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f259ece-bc", "ovs_interfaceid": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:3b:2a,bridge_name='br-int',has_traffic_filtering=True,id=1f259ece-bce2-4aab-925b-26e4f9619fbf,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f259ece-bc') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG os_vif [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:3b:2a,bridge_name='br-int',has_traffic_filtering=True,id=1f259ece-bce2-4aab-925b-26e4f9619fbf,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f259ece-bc') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea8658f4-5391-5553-a028-52fedc3070e0', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f259ece-bc, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f259ece-bc, col_values=(('qos', UUID('99eb69b8-af32-4f2e-bcf1-b0509c0ad205')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f259ece-bc, col_values=(('external_ids', {'iface-id': '1f259ece-bce2-4aab-925b-26e4f9619fbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:3b:2a', 'vm-uuid': '4435ed78-e35f-4859-8a4f-9920815d968a'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:30 user nova-compute[75083]: INFO os_vif [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:3b:2a,bridge_name='br-int',has_traffic_filtering=True,id=1f259ece-bce2-4aab-925b-26e4f9619fbf,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f259ece-bc')
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] No VIF found with MAC fa:16:3e:8d:3b:2a, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.network.neutron [req-86c76f02-1b8f-4fff-93aa-45e2e2c46472 req-f5427208-c322-48f3-a54b-0138fe4ffc1f service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Updated VIF entry in instance network info cache for port 1f259ece-bce2-4aab-925b-26e4f9619fbf. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.network.neutron [req-86c76f02-1b8f-4fff-93aa-45e2e2c46472 req-f5427208-c322-48f3-a54b-0138fe4ffc1f service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Updating instance_info_cache with network_info: [{"id": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "address": "fa:16:3e:8d:3b:2a", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f259ece-bc", "ovs_interfaceid": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-86c76f02-1b8f-4fff-93aa-45e2e2c46472 req-f5427208-c322-48f3-a54b-0138fe4ffc1f service nova] Releasing lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.network.neutron [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Successfully updated port: b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "refresh_cache-a34d9d98-be73-4d52-85f0-83e48f60bc12" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquired lock "refresh_cache-a34d9d98-be73-4d52-85f0-83e48f60bc12" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.network.neutron [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:54:30 user nova-compute[75083]: DEBUG nova.network.neutron [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.network.neutron [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Updating instance_info_cache with network_info: [{"id": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "address": "fa:16:3e:eb:95:6e", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31b37f5-06", "ovs_interfaceid": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Releasing lock "refresh_cache-a34d9d98-be73-4d52-85f0-83e48f60bc12" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.compute.manager [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Instance network_info: |[{"id": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "address": "fa:16:3e:eb:95:6e", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31b37f5-06", "ovs_interfaceid": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Start _get_guest_xml network_info=[{"id": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "address": "fa:16:3e:eb:95:6e", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31b37f5-06", "ovs_interfaceid": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:54:31 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:54:31 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-682698187',display_name='tempest-ServerRescueNegativeTestJSON-server-682698187',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-682698187',id=21,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7833259e5df546ba86139af68fcb7906',ramdisk_id='',reservation_id='r-et4t7qoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1120078925',owner_user_name='tempest-ServerRescueNegativeTestJSON-1120078925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:54:28Z,user_data=None,user_id='eb74d3aef4664ff8bdec4110c6867056',uuid=a34d9d98-be73-4d52-85f0-83e48f60bc12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "address": "fa:16:3e:eb:95:6e", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31b37f5-06", "ovs_interfaceid": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converting VIF {"id": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "address": "fa:16:3e:eb:95:6e", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31b37f5-06", "ovs_interfaceid": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:95:6e,bridge_name='br-int',has_traffic_filtering=True,id=b31b37f5-06db-44ee-a798-37e3a7ea9ab5,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31b37f5-06') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.objects.instance [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'pci_devices' on Instance uuid a34d9d98-be73-4d52-85f0-83e48f60bc12 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:54:31 user nova-compute[75083]:   <uuid>a34d9d98-be73-4d52-85f0-83e48f60bc12</uuid>
Nov 29 05:54:31 user nova-compute[75083]:   <name>instance-00000015</name>
Nov 29 05:54:31 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:54:31 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:54:31 user nova-compute[75083]:   <metadata>
Nov 29 05:54:31 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:54:31 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:54:31 user nova-compute[75083]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-682698187</nova:name>
Nov 29 05:54:31 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:54:31</nova:creationTime>
Nov 29 05:54:31 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:54:31 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:54:31 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:54:31 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:54:31 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:54:31 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:54:31 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:54:31 user nova-compute[75083]:       <nova:owner>
Nov 29 05:54:31 user nova-compute[75083]:         <nova:user uuid="eb74d3aef4664ff8bdec4110c6867056">tempest-ServerRescueNegativeTestJSON-1120078925-project-member</nova:user>
Nov 29 05:54:31 user nova-compute[75083]:         <nova:project uuid="7833259e5df546ba86139af68fcb7906">tempest-ServerRescueNegativeTestJSON-1120078925</nova:project>
Nov 29 05:54:31 user nova-compute[75083]:       </nova:owner>
Nov 29 05:54:31 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:54:31 user nova-compute[75083]:       <nova:ports>
Nov 29 05:54:31 user nova-compute[75083]:         <nova:port uuid="b31b37f5-06db-44ee-a798-37e3a7ea9ab5">
Nov 29 05:54:31 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 05:54:31 user nova-compute[75083]:         </nova:port>
Nov 29 05:54:31 user nova-compute[75083]:       </nova:ports>
Nov 29 05:54:31 user nova-compute[75083]:     </nova:instance>
Nov 29 05:54:31 user nova-compute[75083]:   </metadata>
Nov 29 05:54:31 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:54:31 user nova-compute[75083]:     <system>
Nov 29 05:54:31 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:54:31 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:54:31 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:54:31 user nova-compute[75083]:       <entry name="serial">a34d9d98-be73-4d52-85f0-83e48f60bc12</entry>
Nov 29 05:54:31 user nova-compute[75083]:       <entry name="uuid">a34d9d98-be73-4d52-85f0-83e48f60bc12</entry>
Nov 29 05:54:31 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:54:31 user nova-compute[75083]:     </system>
Nov 29 05:54:31 user nova-compute[75083]:   </sysinfo>
Nov 29 05:54:31 user nova-compute[75083]:   <os>
Nov 29 05:54:31 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:54:31 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:54:31 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:54:31 user nova-compute[75083]:   </os>
Nov 29 05:54:31 user nova-compute[75083]:   <features>
Nov 29 05:54:31 user nova-compute[75083]:     <acpi/>
Nov 29 05:54:31 user nova-compute[75083]:     <apic/>
Nov 29 05:54:31 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:54:31 user nova-compute[75083]:   </features>
Nov 29 05:54:31 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:54:31 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:54:31 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:54:31 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:54:31 user nova-compute[75083]:   </clock>
Nov 29 05:54:31 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:54:31 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:54:31 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:54:31 user nova-compute[75083]:   </cpu>
Nov 29 05:54:31 user nova-compute[75083]:   <devices>
Nov 29 05:54:31 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:54:31 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:54:31 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk"/>
Nov 29 05:54:31 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:54:31 user nova-compute[75083]:     </disk>
Nov 29 05:54:31 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:54:31 user nova-compute[75083]:       <mac address="fa:16:3e:eb:95:6e"/>
Nov 29 05:54:31 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:54:31 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:54:31 user nova-compute[75083]:       <target dev="tapb31b37f5-06"/>
Nov 29 05:54:31 user nova-compute[75083]:     </interface>
Nov 29 05:54:31 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:54:31 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/console.log" append="off"/>
Nov 29 05:54:31 user nova-compute[75083]:     </serial>
Nov 29 05:54:31 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:54:31 user nova-compute[75083]:     <video>
Nov 29 05:54:31 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:54:31 user nova-compute[75083]:     </video>
Nov 29 05:54:31 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:54:31 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:54:31 user nova-compute[75083]:     </rng>
Nov 29 05:54:31 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:54:31 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:54:31 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:54:31 user nova-compute[75083]:     </memballoon>
Nov 29 05:54:31 user nova-compute[75083]:   </devices>
Nov 29 05:54:31 user nova-compute[75083]: </domain>
Nov 29 05:54:31 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-682698187',display_name='tempest-ServerRescueNegativeTestJSON-server-682698187',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-682698187',id=21,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7833259e5df546ba86139af68fcb7906',ramdisk_id='',reservation_id='r-et4t7qoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1120078925',owner_user_name='tempest-ServerRescueNegativeTestJSON-1120078925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:54:28Z,user_data=None,user_id='eb74d3aef4664ff8bdec4110c6867056',uuid=a34d9d98-be73-4d52-85f0-83e48f60bc12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "address": "fa:16:3e:eb:95:6e", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31b37f5-06", "ovs_interfaceid": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converting VIF {"id": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "address": "fa:16:3e:eb:95:6e", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31b37f5-06", "ovs_interfaceid": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:95:6e,bridge_name='br-int',has_traffic_filtering=True,id=b31b37f5-06db-44ee-a798-37e3a7ea9ab5,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31b37f5-06') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG os_vif [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:95:6e,bridge_name='br-int',has_traffic_filtering=True,id=b31b37f5-06db-44ee-a798-37e3a7ea9ab5,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31b37f5-06') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56855d94-a331-5565-8427-63275c138dab', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb31b37f5-06, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb31b37f5-06, col_values=(('qos', UUID('e30b6fda-25eb-4667-8418-7e9a6953135c')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb31b37f5-06, col_values=(('external_ids', {'iface-id': 'b31b37f5-06db-44ee-a798-37e3a7ea9ab5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:95:6e', 'vm-uuid': 'a34d9d98-be73-4d52-85f0-83e48f60bc12'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:31 user nova-compute[75083]: INFO os_vif [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:95:6e,bridge_name='br-int',has_traffic_filtering=True,id=b31b37f5-06db-44ee-a798-37e3a7ea9ab5,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31b37f5-06')
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] No VIF found with MAC fa:16:3e:eb:95:6e, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-f406e957-d049-4d6f-978c-40151c8c4e1e req-006ef565-536e-4f43-bb3b-1161d360501d service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Received event network-changed-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-f406e957-d049-4d6f-978c-40151c8c4e1e req-006ef565-536e-4f43-bb3b-1161d360501d service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Refreshing instance network info cache due to event network-changed-b31b37f5-06db-44ee-a798-37e3a7ea9ab5. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f406e957-d049-4d6f-978c-40151c8c4e1e req-006ef565-536e-4f43-bb3b-1161d360501d service nova] Acquiring lock "refresh_cache-a34d9d98-be73-4d52-85f0-83e48f60bc12" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f406e957-d049-4d6f-978c-40151c8c4e1e req-006ef565-536e-4f43-bb3b-1161d360501d service nova] Acquired lock "refresh_cache-a34d9d98-be73-4d52-85f0-83e48f60bc12" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.network.neutron [req-f406e957-d049-4d6f-978c-40151c8c4e1e req-006ef565-536e-4f43-bb3b-1161d360501d service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Refreshing network info cache for port b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-28b4f730-8478-4dcd-af21-ac09bc5aeb11 req-418f8bfc-17d9-4cb3-a64f-4eb2a8ec9731 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received event network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-28b4f730-8478-4dcd-af21-ac09bc5aeb11 req-418f8bfc-17d9-4cb3-a64f-4eb2a8ec9731 service nova] Acquiring lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-28b4f730-8478-4dcd-af21-ac09bc5aeb11 req-418f8bfc-17d9-4cb3-a64f-4eb2a8ec9731 service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-28b4f730-8478-4dcd-af21-ac09bc5aeb11 req-418f8bfc-17d9-4cb3-a64f-4eb2a8ec9731 service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.013s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-28b4f730-8478-4dcd-af21-ac09bc5aeb11 req-418f8bfc-17d9-4cb3-a64f-4eb2a8ec9731 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] No waiting events found dispatching network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:54:31 user nova-compute[75083]: WARNING nova.compute.manager [req-28b4f730-8478-4dcd-af21-ac09bc5aeb11 req-418f8bfc-17d9-4cb3-a64f-4eb2a8ec9731 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received unexpected event network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf for instance with vm_state building and task_state spawning.
Nov 29 05:54:32 user nova-compute[75083]: DEBUG nova.network.neutron [req-f406e957-d049-4d6f-978c-40151c8c4e1e req-006ef565-536e-4f43-bb3b-1161d360501d service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Updated VIF entry in instance network info cache for port b31b37f5-06db-44ee-a798-37e3a7ea9ab5. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:54:32 user nova-compute[75083]: DEBUG nova.network.neutron [req-f406e957-d049-4d6f-978c-40151c8c4e1e req-006ef565-536e-4f43-bb3b-1161d360501d service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Updating instance_info_cache with network_info: [{"id": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "address": "fa:16:3e:eb:95:6e", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31b37f5-06", "ovs_interfaceid": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:54:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f406e957-d049-4d6f-978c-40151c8c4e1e req-006ef565-536e-4f43-bb3b-1161d360501d service nova] Releasing lock "refresh_cache-a34d9d98-be73-4d52-85f0-83e48f60bc12" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:54:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:34 user nova-compute[75083]: DEBUG nova.compute.manager [req-fdadb25d-0228-405b-a1be-eec066924d63 req-c8c20d30-f69c-4e97-9bca-a413e79b9cb0 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received event network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:54:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fdadb25d-0228-405b-a1be-eec066924d63 req-c8c20d30-f69c-4e97-9bca-a413e79b9cb0 service nova] Acquiring lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fdadb25d-0228-405b-a1be-eec066924d63 req-c8c20d30-f69c-4e97-9bca-a413e79b9cb0 service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fdadb25d-0228-405b-a1be-eec066924d63 req-c8c20d30-f69c-4e97-9bca-a413e79b9cb0 service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:34 user nova-compute[75083]: DEBUG nova.compute.manager [req-fdadb25d-0228-405b-a1be-eec066924d63 req-c8c20d30-f69c-4e97-9bca-a413e79b9cb0 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] No waiting events found dispatching network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:54:34 user nova-compute[75083]: WARNING nova.compute.manager [req-fdadb25d-0228-405b-a1be-eec066924d63 req-c8c20d30-f69c-4e97-9bca-a413e79b9cb0 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received unexpected event network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf for instance with vm_state building and task_state spawning.
Nov 29 05:54:34 user nova-compute[75083]: DEBUG nova.compute.manager [req-fdadb25d-0228-405b-a1be-eec066924d63 req-c8c20d30-f69c-4e97-9bca-a413e79b9cb0 service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Received event network-vif-plugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:54:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fdadb25d-0228-405b-a1be-eec066924d63 req-c8c20d30-f69c-4e97-9bca-a413e79b9cb0 service nova] Acquiring lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fdadb25d-0228-405b-a1be-eec066924d63 req-c8c20d30-f69c-4e97-9bca-a413e79b9cb0 service nova] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fdadb25d-0228-405b-a1be-eec066924d63 req-c8c20d30-f69c-4e97-9bca-a413e79b9cb0 service nova] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:34 user nova-compute[75083]: DEBUG nova.compute.manager [req-fdadb25d-0228-405b-a1be-eec066924d63 req-c8c20d30-f69c-4e97-9bca-a413e79b9cb0 service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] No waiting events found dispatching network-vif-plugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:54:34 user nova-compute[75083]: WARNING nova.compute.manager [req-fdadb25d-0228-405b-a1be-eec066924d63 req-c8c20d30-f69c-4e97-9bca-a413e79b9cb0 service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Received unexpected event network-vif-plugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 for instance with vm_state building and task_state spawning.
Nov 29 05:54:34 user nova-compute[75083]: DEBUG nova.compute.manager [req-fdadb25d-0228-405b-a1be-eec066924d63 req-c8c20d30-f69c-4e97-9bca-a413e79b9cb0 service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Received event network-vif-plugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:54:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fdadb25d-0228-405b-a1be-eec066924d63 req-c8c20d30-f69c-4e97-9bca-a413e79b9cb0 service nova] Acquiring lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fdadb25d-0228-405b-a1be-eec066924d63 req-c8c20d30-f69c-4e97-9bca-a413e79b9cb0 service nova] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fdadb25d-0228-405b-a1be-eec066924d63 req-c8c20d30-f69c-4e97-9bca-a413e79b9cb0 service nova] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:34 user nova-compute[75083]: DEBUG nova.compute.manager [req-fdadb25d-0228-405b-a1be-eec066924d63 req-c8c20d30-f69c-4e97-9bca-a413e79b9cb0 service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] No waiting events found dispatching network-vif-plugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:54:34 user nova-compute[75083]: WARNING nova.compute.manager [req-fdadb25d-0228-405b-a1be-eec066924d63 req-c8c20d30-f69c-4e97-9bca-a413e79b9cb0 service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Received unexpected event network-vif-plugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 for instance with vm_state building and task_state spawning.
Nov 29 05:54:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:54:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:54:35 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Instance spawned successfully.
Nov 29 05:54:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:54:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:54:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:54:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:54:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:54:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:54:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:54:35 user nova-compute[75083]: INFO nova.compute.manager [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Took 8.14 seconds to spawn the instance on the hypervisor.
Nov 29 05:54:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:54:35 user nova-compute[75083]: INFO nova.compute.manager [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Took 8.94 seconds to build instance.
Nov 29 05:54:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-60e28bb0-5ac9-4550-96ed-28541548922e tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "4435ed78-e35f-4859-8a4f-9920815d968a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.064s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:54:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:54:35 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Instance spawned successfully.
Nov 29 05:54:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:54:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:54:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:54:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:54:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:54:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:54:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:54:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:35 user nova-compute[75083]: INFO nova.compute.manager [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Took 7.78 seconds to spawn the instance on the hypervisor.
Nov 29 05:54:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:54:35 user nova-compute[75083]: INFO nova.compute.manager [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Took 8.76 seconds to build instance.
Nov 29 05:54:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c1bc54ed-d100-4cb0-b633-e8380a71bd3a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.868s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Acquiring lock "63e7d632-d185-4cac-97c9-eafddd90c259" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "63e7d632-d185-4cac-97c9-eafddd90c259" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:44 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:54:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:54:44 user nova-compute[75083]: INFO nova.compute.claims [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Claim successful on node user
Nov 29 05:54:45 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:54:45 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:54:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:54:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:54:45 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:54:45 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:54:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:54:45 user nova-compute[75083]: DEBUG nova.policy [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '203e79e1d87b4a74bfc9c665b6cef19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9994d0f11f4f3d9d5efd77db3dd8b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:54:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:54:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:54:45 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Creating image(s)
Nov 29 05:54:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Acquiring lock "/opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "/opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "/opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259/disk 1073741824" returned: 0 in 0.065s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:46 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Successfully created port: 80382d2b-73e7-43fc-9220-778fb3bf9e76 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:54:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.214s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:46 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:54:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:54:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:54:46 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Cannot resize image /opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:54:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:54:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Ensure instance console log exists: /opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:54:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:46 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Successfully updated port: 80382d2b-73e7-43fc-9220-778fb3bf9e76 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Acquiring lock "refresh_cache-63e7d632-d185-4cac-97c9-eafddd90c259" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Acquired lock "refresh_cache-63e7d632-d185-4cac-97c9-eafddd90c259" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.compute.manager [req-5b636958-61f8-409e-a9e8-ca0ee3e9cf7c req-d1fefe89-bbb5-47fe-b919-7f8f6a35f72a service nova] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Received event network-changed-80382d2b-73e7-43fc-9220-778fb3bf9e76 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.compute.manager [req-5b636958-61f8-409e-a9e8-ca0ee3e9cf7c req-d1fefe89-bbb5-47fe-b919-7f8f6a35f72a service nova] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Refreshing instance network info cache due to event network-changed-80382d2b-73e7-43fc-9220-778fb3bf9e76. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5b636958-61f8-409e-a9e8-ca0ee3e9cf7c req-d1fefe89-bbb5-47fe-b919-7f8f6a35f72a service nova] Acquiring lock "refresh_cache-63e7d632-d185-4cac-97c9-eafddd90c259" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Updating instance_info_cache with network_info: [{"id": "80382d2b-73e7-43fc-9220-778fb3bf9e76", "address": "fa:16:3e:80:7b:de", "network": {"id": "39ff6758-4cee-4758-b66f-7a071d9c68e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-274780460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e9994d0f11f4f3d9d5efd77db3dd8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80382d2b-73", "ovs_interfaceid": "80382d2b-73e7-43fc-9220-778fb3bf9e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Releasing lock "refresh_cache-63e7d632-d185-4cac-97c9-eafddd90c259" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Instance network_info: |[{"id": "80382d2b-73e7-43fc-9220-778fb3bf9e76", "address": "fa:16:3e:80:7b:de", "network": {"id": "39ff6758-4cee-4758-b66f-7a071d9c68e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-274780460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e9994d0f11f4f3d9d5efd77db3dd8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80382d2b-73", "ovs_interfaceid": "80382d2b-73e7-43fc-9220-778fb3bf9e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5b636958-61f8-409e-a9e8-ca0ee3e9cf7c req-d1fefe89-bbb5-47fe-b919-7f8f6a35f72a service nova] Acquired lock "refresh_cache-63e7d632-d185-4cac-97c9-eafddd90c259" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.network.neutron [req-5b636958-61f8-409e-a9e8-ca0ee3e9cf7c req-d1fefe89-bbb5-47fe-b919-7f8f6a35f72a service nova] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Refreshing network info cache for port 80382d2b-73e7-43fc-9220-778fb3bf9e76 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Start _get_guest_xml network_info=[{"id": "80382d2b-73e7-43fc-9220-778fb3bf9e76", "address": "fa:16:3e:80:7b:de", "network": {"id": "39ff6758-4cee-4758-b66f-7a071d9c68e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-274780460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e9994d0f11f4f3d9d5efd77db3dd8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80382d2b-73", "ovs_interfaceid": "80382d2b-73e7-43fc-9220-778fb3bf9e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:54:47 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:54:47 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:54:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1218597620',display_name='tempest-VolumesActionsTest-instance-1218597620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1218597620',id=22,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e9994d0f11f4f3d9d5efd77db3dd8b6',ramdisk_id='',reservation_id='r-jd5vw407',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-357770937',owner_user_name='tempest-VolumesActionsTest-357770937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:54:46Z,user_data=None,user_id='203e79e1d87b4a74bfc9c665b6cef19d',uuid=63e7d632-d185-4cac-97c9-eafddd90c259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80382d2b-73e7-43fc-9220-778fb3bf9e76", "address": "fa:16:3e:80:7b:de", "network": {"id": "39ff6758-4cee-4758-b66f-7a071d9c68e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-274780460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e9994d0f11f4f3d9d5efd77db3dd8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80382d2b-73", "ovs_interfaceid": "80382d2b-73e7-43fc-9220-778fb3bf9e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Converting VIF {"id": "80382d2b-73e7-43fc-9220-778fb3bf9e76", "address": "fa:16:3e:80:7b:de", "network": {"id": "39ff6758-4cee-4758-b66f-7a071d9c68e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-274780460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e9994d0f11f4f3d9d5efd77db3dd8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80382d2b-73", "ovs_interfaceid": "80382d2b-73e7-43fc-9220-778fb3bf9e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:7b:de,bridge_name='br-int',has_traffic_filtering=True,id=80382d2b-73e7-43fc-9220-778fb3bf9e76,network=Network(39ff6758-4cee-4758-b66f-7a071d9c68e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80382d2b-73') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.objects.instance [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lazy-loading 'pci_devices' on Instance uuid 63e7d632-d185-4cac-97c9-eafddd90c259 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:54:47 user nova-compute[75083]:   <uuid>63e7d632-d185-4cac-97c9-eafddd90c259</uuid>
Nov 29 05:54:47 user nova-compute[75083]:   <name>instance-00000016</name>
Nov 29 05:54:47 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:54:47 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:54:47 user nova-compute[75083]:   <metadata>
Nov 29 05:54:47 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:54:47 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:54:47 user nova-compute[75083]:       <nova:name>tempest-VolumesActionsTest-instance-1218597620</nova:name>
Nov 29 05:54:47 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:54:47</nova:creationTime>
Nov 29 05:54:47 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:54:47 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:54:47 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:54:47 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:54:47 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:54:47 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:54:47 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:54:47 user nova-compute[75083]:       <nova:owner>
Nov 29 05:54:47 user nova-compute[75083]:         <nova:user uuid="203e79e1d87b4a74bfc9c665b6cef19d">tempest-VolumesActionsTest-357770937-project-member</nova:user>
Nov 29 05:54:47 user nova-compute[75083]:         <nova:project uuid="8e9994d0f11f4f3d9d5efd77db3dd8b6">tempest-VolumesActionsTest-357770937</nova:project>
Nov 29 05:54:47 user nova-compute[75083]:       </nova:owner>
Nov 29 05:54:47 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:54:47 user nova-compute[75083]:       <nova:ports>
Nov 29 05:54:47 user nova-compute[75083]:         <nova:port uuid="80382d2b-73e7-43fc-9220-778fb3bf9e76">
Nov 29 05:54:47 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 05:54:47 user nova-compute[75083]:         </nova:port>
Nov 29 05:54:47 user nova-compute[75083]:       </nova:ports>
Nov 29 05:54:47 user nova-compute[75083]:     </nova:instance>
Nov 29 05:54:47 user nova-compute[75083]:   </metadata>
Nov 29 05:54:47 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:54:47 user nova-compute[75083]:     <system>
Nov 29 05:54:47 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:54:47 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:54:47 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:54:47 user nova-compute[75083]:       <entry name="serial">63e7d632-d185-4cac-97c9-eafddd90c259</entry>
Nov 29 05:54:47 user nova-compute[75083]:       <entry name="uuid">63e7d632-d185-4cac-97c9-eafddd90c259</entry>
Nov 29 05:54:47 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:54:47 user nova-compute[75083]:     </system>
Nov 29 05:54:47 user nova-compute[75083]:   </sysinfo>
Nov 29 05:54:47 user nova-compute[75083]:   <os>
Nov 29 05:54:47 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:54:47 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:54:47 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:54:47 user nova-compute[75083]:   </os>
Nov 29 05:54:47 user nova-compute[75083]:   <features>
Nov 29 05:54:47 user nova-compute[75083]:     <acpi/>
Nov 29 05:54:47 user nova-compute[75083]:     <apic/>
Nov 29 05:54:47 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:54:47 user nova-compute[75083]:   </features>
Nov 29 05:54:47 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:54:47 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:54:47 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:54:47 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:54:47 user nova-compute[75083]:   </clock>
Nov 29 05:54:47 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:54:47 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:54:47 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:54:47 user nova-compute[75083]:   </cpu>
Nov 29 05:54:47 user nova-compute[75083]:   <devices>
Nov 29 05:54:47 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:54:47 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:54:47 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259/disk"/>
Nov 29 05:54:47 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:54:47 user nova-compute[75083]:     </disk>
Nov 29 05:54:47 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:54:47 user nova-compute[75083]:       <mac address="fa:16:3e:80:7b:de"/>
Nov 29 05:54:47 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:54:47 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:54:47 user nova-compute[75083]:       <target dev="tap80382d2b-73"/>
Nov 29 05:54:47 user nova-compute[75083]:     </interface>
Nov 29 05:54:47 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:54:47 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259/console.log" append="off"/>
Nov 29 05:54:47 user nova-compute[75083]:     </serial>
Nov 29 05:54:47 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:54:47 user nova-compute[75083]:     <video>
Nov 29 05:54:47 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:54:47 user nova-compute[75083]:     </video>
Nov 29 05:54:47 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:54:47 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:54:47 user nova-compute[75083]:     </rng>
Nov 29 05:54:47 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:54:47 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:54:47 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:54:47 user nova-compute[75083]:     </memballoon>
Nov 29 05:54:47 user nova-compute[75083]:   </devices>
Nov 29 05:54:47 user nova-compute[75083]: </domain>
Nov 29 05:54:47 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:54:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1218597620',display_name='tempest-VolumesActionsTest-instance-1218597620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1218597620',id=22,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e9994d0f11f4f3d9d5efd77db3dd8b6',ramdisk_id='',reservation_id='r-jd5vw407',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-357770937',owner_user_name='tempest-VolumesActionsTest-357770937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:54:46Z,user_data=None,user_id='203e79e1d87b4a74bfc9c665b6cef19d',uuid=63e7d632-d185-4cac-97c9-eafddd90c259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80382d2b-73e7-43fc-9220-778fb3bf9e76", "address": "fa:16:3e:80:7b:de", "network": {"id": "39ff6758-4cee-4758-b66f-7a071d9c68e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-274780460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e9994d0f11f4f3d9d5efd77db3dd8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80382d2b-73", "ovs_interfaceid": "80382d2b-73e7-43fc-9220-778fb3bf9e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Converting VIF {"id": "80382d2b-73e7-43fc-9220-778fb3bf9e76", "address": "fa:16:3e:80:7b:de", "network": {"id": "39ff6758-4cee-4758-b66f-7a071d9c68e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-274780460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e9994d0f11f4f3d9d5efd77db3dd8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80382d2b-73", "ovs_interfaceid": "80382d2b-73e7-43fc-9220-778fb3bf9e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:7b:de,bridge_name='br-int',has_traffic_filtering=True,id=80382d2b-73e7-43fc-9220-778fb3bf9e76,network=Network(39ff6758-4cee-4758-b66f-7a071d9c68e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80382d2b-73') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG os_vif [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:7b:de,bridge_name='br-int',has_traffic_filtering=True,id=80382d2b-73e7-43fc-9220-778fb3bf9e76,network=Network(39ff6758-4cee-4758-b66f-7a071d9c68e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80382d2b-73') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61614346-a7e2-5276-b5bd-067190aead43', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80382d2b-73, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80382d2b-73, col_values=(('qos', UUID('751fde7c-8b3b-4470-82b2-ec7d50a254be')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80382d2b-73, col_values=(('external_ids', {'iface-id': '80382d2b-73e7-43fc-9220-778fb3bf9e76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:7b:de', 'vm-uuid': '63e7d632-d185-4cac-97c9-eafddd90c259'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:47 user nova-compute[75083]: INFO os_vif [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:7b:de,bridge_name='br-int',has_traffic_filtering=True,id=80382d2b-73e7-43fc-9220-778fb3bf9e76,network=Network(39ff6758-4cee-4758-b66f-7a071d9c68e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80382d2b-73')
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] No VIF found with MAC fa:16:3e:80:7b:de, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.network.neutron [req-5b636958-61f8-409e-a9e8-ca0ee3e9cf7c req-d1fefe89-bbb5-47fe-b919-7f8f6a35f72a service nova] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Updated VIF entry in instance network info cache for port 80382d2b-73e7-43fc-9220-778fb3bf9e76. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG nova.network.neutron [req-5b636958-61f8-409e-a9e8-ca0ee3e9cf7c req-d1fefe89-bbb5-47fe-b919-7f8f6a35f72a service nova] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Updating instance_info_cache with network_info: [{"id": "80382d2b-73e7-43fc-9220-778fb3bf9e76", "address": "fa:16:3e:80:7b:de", "network": {"id": "39ff6758-4cee-4758-b66f-7a071d9c68e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-274780460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e9994d0f11f4f3d9d5efd77db3dd8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80382d2b-73", "ovs_interfaceid": "80382d2b-73e7-43fc-9220-778fb3bf9e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:54:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5b636958-61f8-409e-a9e8-ca0ee3e9cf7c req-d1fefe89-bbb5-47fe-b919-7f8f6a35f72a service nova] Releasing lock "refresh_cache-63e7d632-d185-4cac-97c9-eafddd90c259" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:54:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:49 user nova-compute[75083]: DEBUG nova.compute.manager [req-45d0fb6d-d8bc-4dba-a38d-530af85a4817 req-171543a6-a07e-4957-9993-e1f2761969ea service nova] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Received event network-vif-plugged-80382d2b-73e7-43fc-9220-778fb3bf9e76 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:54:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-45d0fb6d-d8bc-4dba-a38d-530af85a4817 req-171543a6-a07e-4957-9993-e1f2761969ea service nova] Acquiring lock "63e7d632-d185-4cac-97c9-eafddd90c259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-45d0fb6d-d8bc-4dba-a38d-530af85a4817 req-171543a6-a07e-4957-9993-e1f2761969ea service nova] Lock "63e7d632-d185-4cac-97c9-eafddd90c259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-45d0fb6d-d8bc-4dba-a38d-530af85a4817 req-171543a6-a07e-4957-9993-e1f2761969ea service nova] Lock "63e7d632-d185-4cac-97c9-eafddd90c259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:49 user nova-compute[75083]: DEBUG nova.compute.manager [req-45d0fb6d-d8bc-4dba-a38d-530af85a4817 req-171543a6-a07e-4957-9993-e1f2761969ea service nova] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] No waiting events found dispatching network-vif-plugged-80382d2b-73e7-43fc-9220-778fb3bf9e76 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:54:49 user nova-compute[75083]: WARNING nova.compute.manager [req-45d0fb6d-d8bc-4dba-a38d-530af85a4817 req-171543a6-a07e-4957-9993-e1f2761969ea service nova] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Received unexpected event network-vif-plugged-80382d2b-73e7-43fc-9220-778fb3bf9e76 for instance with vm_state building and task_state spawning.
Nov 29 05:54:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:51 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:54:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:54:51 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Instance spawned successfully.
Nov 29 05:54:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:54:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:54:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:54:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:54:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:54:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:54:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:54:51 user nova-compute[75083]: DEBUG nova.compute.manager [req-722b1900-ab93-42fd-8260-d8fda2e2bc4c req-1b0aaf2c-769c-4c9d-8e38-2dcba4642e8b service nova] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Received event network-vif-plugged-80382d2b-73e7-43fc-9220-778fb3bf9e76 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:54:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-722b1900-ab93-42fd-8260-d8fda2e2bc4c req-1b0aaf2c-769c-4c9d-8e38-2dcba4642e8b service nova] Acquiring lock "63e7d632-d185-4cac-97c9-eafddd90c259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-722b1900-ab93-42fd-8260-d8fda2e2bc4c req-1b0aaf2c-769c-4c9d-8e38-2dcba4642e8b service nova] Lock "63e7d632-d185-4cac-97c9-eafddd90c259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-722b1900-ab93-42fd-8260-d8fda2e2bc4c req-1b0aaf2c-769c-4c9d-8e38-2dcba4642e8b service nova] Lock "63e7d632-d185-4cac-97c9-eafddd90c259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:51 user nova-compute[75083]: DEBUG nova.compute.manager [req-722b1900-ab93-42fd-8260-d8fda2e2bc4c req-1b0aaf2c-769c-4c9d-8e38-2dcba4642e8b service nova] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] No waiting events found dispatching network-vif-plugged-80382d2b-73e7-43fc-9220-778fb3bf9e76 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:54:51 user nova-compute[75083]: WARNING nova.compute.manager [req-722b1900-ab93-42fd-8260-d8fda2e2bc4c req-1b0aaf2c-769c-4c9d-8e38-2dcba4642e8b service nova] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Received unexpected event network-vif-plugged-80382d2b-73e7-43fc-9220-778fb3bf9e76 for instance with vm_state building and task_state spawning.
Nov 29 05:54:51 user nova-compute[75083]: INFO nova.compute.manager [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 29 05:54:51 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:54:51 user nova-compute[75083]: INFO nova.compute.manager [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Took 6.42 seconds to build instance.
Nov 29 05:54:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f3d09dcb-7d59-4a81-bc8a-24e393eba1e4 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "63e7d632-d185-4cac-97c9-eafddd90c259" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.521s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:54:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:54:57 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:54:58 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:54:58 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 05:54:59 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:54:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:54:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:54:59 user nova-compute[75083]: INFO nova.compute.manager [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Detaching volume d3f4708c-c8b0-495e-9eb4-5c01a957ebd5
Nov 29 05:54:59 user nova-compute[75083]: INFO nova.virt.block_device [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Attempting to driver detach volume d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 from mountpoint /dev/vdb
Nov 29 05:54:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Attempting to detach device vdb from instance b6d38a2c-a512-41f2-a7df-6a54058f8f8b from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 05:54:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:54:59 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:54:59 user nova-compute[75083]:   <source dev="/dev/sdd"/>
Nov 29 05:54:59 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:54:59 user nova-compute[75083]:   <serial>d3f4708c-c8b0-495e-9eb4-5c01a957ebd5</serial>
Nov 29 05:54:59 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 05:54:59 user nova-compute[75083]: </disk>
Nov 29 05:54:59 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:54:59 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Successfully detached device vdb from instance b6d38a2c-a512-41f2-a7df-6a54058f8f8b from the persistent domain config.
Nov 29 05:54:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b6d38a2c-a512-41f2-a7df-6a54058f8f8b from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 05:54:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:54:59 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:54:59 user nova-compute[75083]:   <source dev="/dev/sdd"/>
Nov 29 05:54:59 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:54:59 user nova-compute[75083]:   <serial>d3f4708c-c8b0-495e-9eb4-5c01a957ebd5</serial>
Nov 29 05:54:59 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 05:54:59 user nova-compute[75083]: </disk>
Nov 29 05:54:59 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:55:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b6d38a2c-a512-41f2-a7df-6a54058f8f8b {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 05:55:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:55:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG nova.objects.instance [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lazy-loading 'flavor' on Instance uuid fb8244c4-f2a7-4ad8-a210-0f62c165a4dc {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.006s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:01 user nova-compute[75083]: INFO nova.compute.manager [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Attaching volume ed1112c6-7998-4bf8-b679-c13dddd615a1 to /dev/vdb
Nov 29 05:55:01 user nova-compute[75083]: DEBUG os_brick.utils [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38ee816-fb46-43f5-b565-8eae5d0c08d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b293b1-de06-47d9-a17c-6727c3ebcce0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c168fc-b267-45fc-9b8e-b2a8e017cc53]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7735b335-09fe-4b21-96b0-4e83163fd9b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:55:01 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:55:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6600849-c300-4dca-a982-ad72721ce8b6]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG os_brick.utils [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:55:01 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Updating existing volume attachment record: d169e779-c509-4c0a-910f-4f4cdff8f5aa {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:55:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:03 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:55:03 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:55:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:03 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 05:55:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:55:07 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:07 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:55:07 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:55:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=7481MB free_disk=25.350200653076172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 05:55:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance e6d49806-cecd-473a-b92f-9255868d35c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:55:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 161c6455-90ce-4c40-a33e-7f582989135d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:55:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b6d38a2c-a512-41f2-a7df-6a54058f8f8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:55:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:55:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fb8244c4-f2a7-4ad8-a210-0f62c165a4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:55:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 7c693239-226b-42b1-928e-9a8b7a2a114c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:55:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 2778daf0-f727-4185-a404-1793b75ac523 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:55:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4435ed78-e35f-4859-8a4f-9920815d968a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:55:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a34d9d98-be73-4d52-85f0-83e48f60bc12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:55:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 63e7d632-d185-4cac-97c9-eafddd90c259 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:55:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 05:55:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 05:55:08 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:55:08 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:55:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 05:55:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.516s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-b6d38a2c-a512-41f2-a7df-6a54058f8f8b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-b6d38a2c-a512-41f2-a7df-6a54058f8f8b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNxDFkJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:55:09 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:55:09 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:55:09 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d38b428-31aa-452b-81f9-7de75c9a22e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:55:09 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd72391-690c-457b-8d6d-660b258e985d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1] added
Nov 29 05:55:09 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[366052fc-5fae-454a-8009-da88aac278a9]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b057d7d-5b0d-47d4-ad44-90c860fa9b24]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNxDFkJH {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNxDFkJH" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4acbaee-7cbb-4cfe-a660-c0597fdc6cb5]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rNxDFkJH'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[663c68c3-25af-426c-83c7-9904990b39d0]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[476441df-e3c1-4c47-abe8-ceef827261ac]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:55:09 user nova-compute[75083]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:55:09 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:55:09 user nova-compute[75083]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:55:09 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1182374-813c-4525-8579-8cf799beccaa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260]
Nov 29 05:55:09 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260] successful.
Nov 29 05:55:09 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d00160-a66e-4f41-9685-182bd7076d48]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ee62e0-6351-498b-8558-150bea49de09]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:55:09 user nova-compute[75083]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:55:09 user nova-compute[75083]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:55:09 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:55:09 user nova-compute[75083]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:55:09 user nova-compute[75083]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:55:09 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf60bfe6-f252-4142-a010-e9d048208d08]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:55:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNxDFkJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:55:10 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Updating instance_info_cache with network_info: [{"id": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "address": "fa:16:3e:f6:1e:5c", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf04f87a-6d", "ovs_interfaceid": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:55:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-b6d38a2c-a512-41f2-a7df-6a54058f8f8b" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:55:10 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 05:55:10 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:55:10 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:55:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:55:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23863643362326566', 'path': '/dev/sdc'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:55:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863643362326566', 'path': '/dev/sdc'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:55:10 user nova-compute[75083]: DEBUG nova.objects.instance [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lazy-loading 'flavor' on Instance uuid fb8244c4-f2a7-4ad8-a210-0f62c165a4dc {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:55:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 05:55:10 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:55:10 user nova-compute[75083]:   <source dev="/dev/sdc"/>
Nov 29 05:55:10 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:55:10 user nova-compute[75083]:   <serial>ed1112c6-7998-4bf8-b679-c13dddd615a1</serial>
Nov 29 05:55:10 user nova-compute[75083]: </disk>
Nov 29 05:55:10 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 05:55:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:55:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:55:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] No VIF found with MAC fa:16:3e:8c:af:fc, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:55:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c3ca2b7d-1b9a-45ce-ad4b-69638c0496ca tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.614s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Stashing vm_state: active {{(pid=75083) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 05:55:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:13 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:55:13 user nova-compute[75083]: INFO nova.compute.claims [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Claim successful on node user
Nov 29 05:55:13 user nova-compute[75083]: INFO nova.compute.resource_tracker [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Updating resource usage from migration cf5b552d-fb41-4bc3-9033-f6622a9b82a4
Nov 29 05:55:13 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:55:13 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:55:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.517s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:13 user nova-compute[75083]: INFO nova.compute.manager [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Migrating
Nov 29 05:55:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:55:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:55:13 user nova-compute[75083]: INFO nova.compute.rpcapi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 29 05:55:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:55:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:55:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquired lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:55:13 user nova-compute[75083]: DEBUG nova.network.neutron [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG nova.network.neutron [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Updating instance_info_cache with network_info: [{"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Releasing lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Starting migrate_disk_and_power_off {{(pid=75083) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG nova.compute.manager [req-4ccbb135-576d-42c7-a677-f348528441fa req-59aa5d5c-8437-4c8b-ba3d-f635abfacf84 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received event network-vif-unplugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4ccbb135-576d-42c7-a677-f348528441fa req-59aa5d5c-8437-4c8b-ba3d-f635abfacf84 service nova] Acquiring lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4ccbb135-576d-42c7-a677-f348528441fa req-59aa5d5c-8437-4c8b-ba3d-f635abfacf84 service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4ccbb135-576d-42c7-a677-f348528441fa req-59aa5d5c-8437-4c8b-ba3d-f635abfacf84 service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG nova.compute.manager [req-4ccbb135-576d-42c7-a677-f348528441fa req-59aa5d5c-8437-4c8b-ba3d-f635abfacf84 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] No waiting events found dispatching network-vif-unplugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:55:14 user nova-compute[75083]: WARNING nova.compute.manager [req-4ccbb135-576d-42c7-a677-f348528441fa req-59aa5d5c-8437-4c8b-ba3d-f635abfacf84 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received unexpected event network-vif-unplugged-388c9969-42dc-4e34-8fb8-c2399687751d for instance with vm_state active and task_state resize_migrating.
Nov 29 05:55:14 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Instance destroyed successfully.
Nov 29 05:55:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:51:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1765064185',display_name='tempest-ServerActionsTestOtherB-server-1765064185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1765064185',id=15,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKfQt22BKdk3qqBMkdZDrlzUPc5OzBSJvBUhpD5lx0G7UqWh0HRdHS4+8i15ioAIjPFv14fiTBp00VBH9cOAzOvFWtO61YBHreoMNXT+V9qZ3bdKSP6OX3ggUHyDT/bOg==',key_name='tempest-keypair-1198752933',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:51:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='41fbbebd414945beb2130f46013125d8',ramdisk_id='',reservation_id='r-349fa5rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1953829293',owner_user_name='tempest-ServerActionsTestOtherB-1953829293-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:55:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7f8a0e94feb47bb875ab4d7f1f2a2a1',uuid=fb8244c4-f2a7-4ad8-a210-0f62c165a4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-940601225-network", "vif_mac": "fa:16:3e:8c:af:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Converting VIF {"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-940601225-network", "vif_mac": "fa:16:3e:8c:af:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG os_vif [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap388c9969-42, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2fd56f51-d04f-4db6-80fb-234d17840c54) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:14 user nova-compute[75083]: INFO os_vif [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42')
Nov 29 05:55:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNxDFkJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:55:14 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:55:14 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:55:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e57a90-e8e5-4294-a161-f1635ffec524]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:55:15 user nova-compute[75083]: No targets found.
Nov 29 05:55:15 user nova-compute[75083]: iSNS:
Nov 29 05:55:15 user nova-compute[75083]: No targets found.
Nov 29 05:55:15 user nova-compute[75083]: STATIC:
Nov 29 05:55:15 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5
Nov 29 05:55:15 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:55:15 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:55:15 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1
Nov 29 05:55:15 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:55:15 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:55:15 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043
Nov 29 05:55:15 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:55:15 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:55:15 user nova-compute[75083]: FIRMWARE:
Nov 29 05:55:15 user nova-compute[75083]: No targets found.
Nov 29 05:55:15 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:55:15 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:55:15 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cebd590-a28d-4dbc-ae55-7df43dc1cbe5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc43ecc-0a9d-4910-a753-cb73b70068fc]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:55:15 user nova-compute[75083]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:55:15 user nova-compute[75083]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:55:15 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:55:15 user nova-compute[75083]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:55:15 user nova-compute[75083]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:55:15 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0d86b2440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1'): ({'sdc'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Removing single pathed devices sdc {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3a1854-e69c-4082-8b00-e73605899ff7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e4bcdd-fed7-4c5e-8a0e-155312f0457e]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Flushing IO for device /dev/sdc {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[737ae7dc-fac1-413e-b764-29563a3f9f2c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d19e851-3744-4f4e-bc01-2e1721968f01]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9402a69-264a-44d5-971e-c49b468e7fca]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Acquiring lock "7c693239-226b-42b1-928e-9a8b7a2a114c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Acquiring lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:15 user nova-compute[75083]: INFO nova.compute.manager [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Terminating instance
Nov 29 05:55:15 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fbabb1-1428-4815-bb8f-56fdfd9421b2]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260]
Nov 29 05:55:15 user nova-compute[75083]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260] successful.
Nov 29 05:55:15 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[44575a94-4ec2-44d4-979b-f99af6b66d3b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] <== disconnect_volume: return (323ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc_resize/disk /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:15 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Instance destroyed successfully.
Nov 29 05:55:15 user nova-compute[75083]: DEBUG nova.objects.instance [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lazy-loading 'resources' on Instance uuid 7c693239-226b-42b1-928e-9a8b7a2a114c {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T05:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1099529621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1923190517',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVqlBFSwsVSd5Vcbhdct55aXuVEeazXqKnt3H0YMw0ee5MXXhI16+ZwPyHVIMGfFxjyzswiZlnB6srSTk54bx0+gEyQjqkJlEeRzN4KuV8BBahtwESFhSg9w8kgSjIeaQ==',key_name='tempest-keypair-718905469',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8356c76a38d4b798fbc756795fab89b',ramdisk_id='',reservation_id='r-zu96bv1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-226818069',owner_user_name='tempest-ServerActionsV293TestJSON-226818069-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:53:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49154159b8244161981fb442e2014067',uuid=7c693239-226b-42b1-928e-9a8b7a2a114c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "address": "fa:16:3e:02:29:04", "network": {"id": "338c6d36-9867-4d30-b8b9-5209dd6ae7dc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1555128941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8356c76a38d4b798fbc756795fab89b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5581c9a9-ec", "ovs_interfaceid": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Converting VIF {"id": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "address": "fa:16:3e:02:29:04", "network": {"id": "338c6d36-9867-4d30-b8b9-5209dd6ae7dc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1555128941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8356c76a38d4b798fbc756795fab89b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5581c9a9-ec", "ovs_interfaceid": "5581c9a9-ec9e-49f5-b9bb-8e2112b54377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:29:04,bridge_name='br-int',has_traffic_filtering=True,id=5581c9a9-ec9e-49f5-b9bb-8e2112b54377,network=Network(338c6d36-9867-4d30-b8b9-5209dd6ae7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5581c9a9-ec') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_vif [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:29:04,bridge_name='br-int',has_traffic_filtering=True,id=5581c9a9-ec9e-49f5-b9bb-8e2112b54377,network=Network(338c6d36-9867-4d30-b8b9-5209dd6ae7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5581c9a9-ec') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5581c9a9-ec, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d84beca8-e2bb-4f89-b097-455d7d2d0b58) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:16 user nova-compute[75083]: INFO os_vif [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:29:04,bridge_name='br-int',has_traffic_filtering=True,id=5581c9a9-ec9e-49f5-b9bb-8e2112b54377,network=Network(338c6d36-9867-4d30-b8b9-5209dd6ae7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5581c9a9-ec')
Nov 29 05:55:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnuPAXgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:55:16 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CMD "cp -r /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc_resize/disk /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk" returned: 0 in 0.352s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc_resize/disk.info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk.info {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e86252-1cd2-4839-a0a9-7e433610e1f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:55:16 user nova-compute[75083]: No targets found.
Nov 29 05:55:16 user nova-compute[75083]: iSNS:
Nov 29 05:55:16 user nova-compute[75083]: No targets found.
Nov 29 05:55:16 user nova-compute[75083]: STATIC:
Nov 29 05:55:16 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5
Nov 29 05:55:16 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:55:16 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:55:16 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043
Nov 29 05:55:16 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:55:16 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:55:16 user nova-compute[75083]: FIRMWARE:
Nov 29 05:55:16 user nova-compute[75083]: No targets found.
Nov 29 05:55:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:55:16 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:55:16 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CMD "cp -r /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc_resize/disk.info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk.info" returned: 0 in 0.046s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[badd50ef-3834-4b57-b31a-96c0a3870944]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be8756b-8099-40c7-8f3e-641e369f4fe9]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:55:16 user nova-compute[75083]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:55:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:55:16 user nova-compute[75083]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 (non-flash)
Nov 29 05:55:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b83e71c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3829d9d-1ad8-4991-bc33-65d4f5ed2828]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8063db5-91cc-4613-bf9b-fa0c0bb7431b]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e06c2a-8498-4b27-8528-59d0f09653dc]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ac64eb-b731-4655-a42a-dd0194420533]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2006e2d2-90eb-470d-830d-1e61b7d8937e]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[341ea1a6-b192-415d-958f-9b48a88ce7f4]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043, portal: 172.16.0.220,3260]
Nov 29 05:55:16 user nova-compute[75083]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043, portal: 172.16.0.220,3260] successful.
Nov 29 05:55:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74a643c4-1330-47fc-9deb-fe33aa3bd043 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[be33474e-00b3-42d0-8990-731d307e6a50]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] <== disconnect_volume: return (360ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:55:16 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Deleting instance files /opt/stack/data/nova/instances/7c693239-226b-42b1-928e-9a8b7a2a114c_del
Nov 29 05:55:16 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Deletion of /opt/stack/data/nova/instances/7c693239-226b-42b1-928e-9a8b7a2a114c_del complete
Nov 29 05:55:16 user nova-compute[75083]: INFO nova.compute.manager [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG nova.compute.manager [req-69458c8d-2aa2-4ca8-814f-070fb845adaa req-14c9649b-f143-4b64-ad92-962f3ceba187 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received event network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-69458c8d-2aa2-4ca8-814f-070fb845adaa req-14c9649b-f143-4b64-ad92-962f3ceba187 service nova] Acquiring lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-69458c8d-2aa2-4ca8-814f-070fb845adaa req-14c9649b-f143-4b64-ad92-962f3ceba187 service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-69458c8d-2aa2-4ca8-814f-070fb845adaa req-14c9649b-f143-4b64-ad92-962f3ceba187 service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG nova.compute.manager [req-69458c8d-2aa2-4ca8-814f-070fb845adaa req-14c9649b-f143-4b64-ad92-962f3ceba187 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] No waiting events found dispatching network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:55:16 user nova-compute[75083]: WARNING nova.compute.manager [req-69458c8d-2aa2-4ca8-814f-070fb845adaa req-14c9649b-f143-4b64-ad92-962f3ceba187 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received unexpected event network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d for instance with vm_state active and task_state resize_migrating.
Nov 29 05:55:16 user nova-compute[75083]: DEBUG nova.compute.manager [req-69458c8d-2aa2-4ca8-814f-070fb845adaa req-14c9649b-f143-4b64-ad92-962f3ceba187 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Received event network-vif-unplugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-69458c8d-2aa2-4ca8-814f-070fb845adaa req-14c9649b-f143-4b64-ad92-962f3ceba187 service nova] Acquiring lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-69458c8d-2aa2-4ca8-814f-070fb845adaa req-14c9649b-f143-4b64-ad92-962f3ceba187 service nova] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-69458c8d-2aa2-4ca8-814f-070fb845adaa req-14c9649b-f143-4b64-ad92-962f3ceba187 service nova] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG nova.compute.manager [req-69458c8d-2aa2-4ca8-814f-070fb845adaa req-14c9649b-f143-4b64-ad92-962f3ceba187 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] No waiting events found dispatching network-vif-unplugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG nova.compute.manager [req-69458c8d-2aa2-4ca8-814f-070fb845adaa req-14c9649b-f143-4b64-ad92-962f3ceba187 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Received event network-vif-unplugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG nova.compute.manager [req-69458c8d-2aa2-4ca8-814f-070fb845adaa req-14c9649b-f143-4b64-ad92-962f3ceba187 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Received event network-vif-plugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-69458c8d-2aa2-4ca8-814f-070fb845adaa req-14c9649b-f143-4b64-ad92-962f3ceba187 service nova] Acquiring lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-69458c8d-2aa2-4ca8-814f-070fb845adaa req-14c9649b-f143-4b64-ad92-962f3ceba187 service nova] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-69458c8d-2aa2-4ca8-814f-070fb845adaa req-14c9649b-f143-4b64-ad92-962f3ceba187 service nova] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:16 user nova-compute[75083]: DEBUG nova.compute.manager [req-69458c8d-2aa2-4ca8-814f-070fb845adaa req-14c9649b-f143-4b64-ad92-962f3ceba187 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] No waiting events found dispatching network-vif-plugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:55:16 user nova-compute[75083]: WARNING nova.compute.manager [req-69458c8d-2aa2-4ca8-814f-070fb845adaa req-14c9649b-f143-4b64-ad92-962f3ceba187 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Received unexpected event network-vif-plugged-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 for instance with vm_state active and task_state deleting.
Nov 29 05:55:17 user nova-compute[75083]: DEBUG nova.network.neutron [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Port 388c9969-42dc-4e34-8fb8-c2399687751d binding to destination host user is already ACTIVE {{(pid=75083) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 05:55:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:17 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:55:17 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Took 1.09 seconds to deallocate network for instance.
Nov 29 05:55:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:55:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquired lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:55:17 user nova-compute[75083]: DEBUG nova.network.neutron [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG nova.network.neutron [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Updating instance_info_cache with network_info: [{"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Releasing lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG os_brick.utils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c27aaa-ab32-4c9a-ac87-210a9cad2aa6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dc0e92-20b1-455b-9505-6a9db309e092]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38ffd92-7456-4f91-94dc-c05b28045400]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ff9031-8830-4d7b-b98b-054efd5fc69e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:55:18 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:55:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a965b9-73d8-4dd3-b411-63098ad73e25]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG os_brick.utils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:55:18 user nova-compute[75083]: INFO nova.compute.manager [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Took 0.82 seconds to detach 1 volumes for instance.
Nov 29 05:55:18 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Deleting volume: 74a643c4-1330-47fc-9deb-fe33aa3bd043 {{(pid=75083) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-e2b35a39-3951-44b9-9038-b7c7e67feb9e req-ba0ee103-53ac-4db5-b21f-d7f02526ef48 service nova] [instance: 7c693239-226b-42b1-928e-9a8b7a2a114c] Received event network-vif-deleted-5581c9a9-ec9e-49f5-b9bb-8e2112b54377 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:55:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:18 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Deleted allocations for instance 7c693239-226b-42b1-928e-9a8b7a2a114c
Nov 29 05:55:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ddc98013-2ca1-4809-b6f2-3313c6cfc8ca tempest-ServerActionsV293TestJSON-226818069 tempest-ServerActionsV293TestJSON-226818069-project-member] Lock "7c693239-226b-42b1-928e-9a8b7a2a114c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.823s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:20 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b6d38a2c-a512-41f2-a7df-6a54058f8f8b is timed out.
Nov 29 05:55:20 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Successfully detached device vdb from instance b6d38a2c-a512-41f2-a7df-6a54058f8f8b from the live domain config.
Nov 29 05:55:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MafARzSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:55:20 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:55:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0968a3bc-80ce-4ede-af0b-476162af97f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:55:20 user nova-compute[75083]: No targets found.
Nov 29 05:55:20 user nova-compute[75083]: iSNS:
Nov 29 05:55:20 user nova-compute[75083]: No targets found.
Nov 29 05:55:20 user nova-compute[75083]: STATIC:
Nov 29 05:55:20 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5
Nov 29 05:55:20 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:55:20 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:55:20 user nova-compute[75083]: FIRMWARE:
Nov 29 05:55:20 user nova-compute[75083]: No targets found.
Nov 29 05:55:20 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:55:20 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:55:20 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdc5359-2fb8-4da3-939d-bb004ae6dd77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d370acce-3181-4bbd-8267-5da4bc2be8be]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:55:20 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 (non-flash)
Nov 29 05:55:20 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b83e5f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5'): ({'sdd'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Removing single pathed devices sdd {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbace290-fe21-48ea-a399-ca70e0cad35a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5b597d-3bd4-427d-b4c1-1d91d28d28dc]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Flushing IO for device /dev/sdd {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9590341b-c7e4-41e4-85b2-06e16bf1199e]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e78a35-0a96-4022-8ea4-304a46dc8a6d]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] SCSI volumes sdd have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecea48b8-c0b6-4647-b9a7-7eecda2c82e1]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe78254-6ed6-4f80-8cee-4b5f33fbc576]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5, portal: 172.16.0.220,3260]
Nov 29 05:55:20 user nova-compute[75083]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5, portal: 172.16.0.220,3260] successful.
Nov 29 05:55:20 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f4708c-c8b0-495e-9eb4-5c01a957ebd5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8584f363-376f-48d0-bb79-4f011fd73b77]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] <== disconnect_volume: return (298ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:55:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:21 user nova-compute[75083]: DEBUG nova.objects.instance [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lazy-loading 'flavor' on Instance uuid b6d38a2c-a512-41f2-a7df-6a54058f8f8b {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:55:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-20926b0f-1487-4863-a286-2966e5254932 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.690s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:25 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Starting finish_migration {{(pid=75083) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 05:55:25 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Instance directory exists: not creating {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 05:55:25 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Creating image(s)
Nov 29 05:55:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.167s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:25 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk. size=21474836480 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:55:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk 21474836480 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk 21474836480" returned: 0 in 0.046s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Did not create local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Ensure instance console log exists: /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Start _get_guest_xml network_info=[{"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-940601225-network", "vif_mac": "fa:16:3e:8c:af:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '828901ab-772a-4106-b595-240323b6a1c8', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNxDFkJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'fb8244c4-f2a7-4ad8-a210-0f62c165a4dc', 'attached_at': '2023-11-29T05:55:26.000000', 'detached_at': '', 'volume_id': 'ed1112c6-7998-4bf8-b679-c13dddd615a1', 'serial': 'ed1112c6-7998-4bf8-b679-c13dddd615a1'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:55:26 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:55:26 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:55:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNxDFkJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:55:26 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:55:26 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:55:26 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[63538450-595f-4ee1-a3e4-0230484682b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:55:26 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0c141c-a685-491a-9c15-809fd053cefc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1] added
Nov 29 05:55:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b1e4d8-c25c-43dd-9c00-d79ad51cb0d1]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34787b7-761e-4935-aa67-7d400db8df52]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNxDFkJH {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNxDFkJH" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e7f686-eb07-4a53-813a-b79149a03358]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rNxDFkJH'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[01468161-c33e-4a36-88d9-4982c847d39f]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8af21e1-8569-48a1-8911-598d0a43c0d3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 05:55:26 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 05:55:26 user nova-compute[75083]:  {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:55:26 user nova-compute[75083]: WARNING os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 05:55:26 user nova-compute[75083]: 
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5233c5-0573-438e-a2ec-d756fdf5c361]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260]
Nov 29 05:55:26 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260] successful.
Nov 29 05:55:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4d1937-e517-442b-8594-512df82c9d77]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c13b309-6f1b-44a0-9fe6-9d365934f12d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:55:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:55:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc6e19f-6336-4dc7-894c-60f08d22f062]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:55:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNxDFkJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '23863643362326566', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863643362326566', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:51:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1765064185',display_name='tempest-ServerActionsTestOtherB-server-1765064185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1765064185',id=15,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKfQt22BKdk3qqBMkdZDrlzUPc5OzBSJvBUhpD5lx0G7UqWh0HRdHS4+8i15ioAIjPFv14fiTBp00VBH9cOAzOvFWtO61YBHreoMNXT+V9qZ3bdKSP6OX3ggUHyDT/bOg==',key_name='tempest-keypair-1198752933',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:51:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='41fbbebd414945beb2130f46013125d8',ramdisk_id='',reservation_id='r-349fa5rg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1953829293',owner_user_name='tempest-ServerActionsTestOtherB-1953829293-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:55:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7f8a0e94feb47bb875ab4d7f1f2a2a1',uuid=fb8244c4-f2a7-4ad8-a210-0f62c165a4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-940601225-network", "vif_mac": "fa:16:3e:8c:af:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Converting VIF {"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-940601225-network", "vif_mac": "fa:16:3e:8c:af:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:55:27 user nova-compute[75083]:   <uuid>fb8244c4-f2a7-4ad8-a210-0f62c165a4dc</uuid>
Nov 29 05:55:27 user nova-compute[75083]:   <name>instance-0000000f</name>
Nov 29 05:55:27 user nova-compute[75083]:   <memory>2097152</memory>
Nov 29 05:55:27 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:55:27 user nova-compute[75083]:   <metadata>
Nov 29 05:55:27 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:55:27 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:55:27 user nova-compute[75083]:       <nova:name>tempest-ServerActionsTestOtherB-server-1765064185</nova:name>
Nov 29 05:55:27 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:55:26</nova:creationTime>
Nov 29 05:55:27 user nova-compute[75083]:       <nova:flavor name="m1.small">
Nov 29 05:55:27 user nova-compute[75083]:         <nova:memory>2048</nova:memory>
Nov 29 05:55:27 user nova-compute[75083]:         <nova:disk>20</nova:disk>
Nov 29 05:55:27 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:55:27 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:55:27 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:55:27 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:55:27 user nova-compute[75083]:       <nova:owner>
Nov 29 05:55:27 user nova-compute[75083]:         <nova:user uuid="d7f8a0e94feb47bb875ab4d7f1f2a2a1">tempest-ServerActionsTestOtherB-1953829293-project-member</nova:user>
Nov 29 05:55:27 user nova-compute[75083]:         <nova:project uuid="41fbbebd414945beb2130f46013125d8">tempest-ServerActionsTestOtherB-1953829293</nova:project>
Nov 29 05:55:27 user nova-compute[75083]:       </nova:owner>
Nov 29 05:55:27 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:55:27 user nova-compute[75083]:       <nova:ports>
Nov 29 05:55:27 user nova-compute[75083]:         <nova:port uuid="388c9969-42dc-4e34-8fb8-c2399687751d">
Nov 29 05:55:27 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 05:55:27 user nova-compute[75083]:         </nova:port>
Nov 29 05:55:27 user nova-compute[75083]:       </nova:ports>
Nov 29 05:55:27 user nova-compute[75083]:     </nova:instance>
Nov 29 05:55:27 user nova-compute[75083]:   </metadata>
Nov 29 05:55:27 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:55:27 user nova-compute[75083]:     <system>
Nov 29 05:55:27 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:55:27 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:55:27 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:55:27 user nova-compute[75083]:       <entry name="serial">fb8244c4-f2a7-4ad8-a210-0f62c165a4dc</entry>
Nov 29 05:55:27 user nova-compute[75083]:       <entry name="uuid">fb8244c4-f2a7-4ad8-a210-0f62c165a4dc</entry>
Nov 29 05:55:27 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:55:27 user nova-compute[75083]:     </system>
Nov 29 05:55:27 user nova-compute[75083]:   </sysinfo>
Nov 29 05:55:27 user nova-compute[75083]:   <os>
Nov 29 05:55:27 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:55:27 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:55:27 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:55:27 user nova-compute[75083]:   </os>
Nov 29 05:55:27 user nova-compute[75083]:   <features>
Nov 29 05:55:27 user nova-compute[75083]:     <acpi/>
Nov 29 05:55:27 user nova-compute[75083]:     <apic/>
Nov 29 05:55:27 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:55:27 user nova-compute[75083]:   </features>
Nov 29 05:55:27 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:55:27 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:55:27 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:55:27 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:55:27 user nova-compute[75083]:   </clock>
Nov 29 05:55:27 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:55:27 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:55:27 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:55:27 user nova-compute[75083]:   </cpu>
Nov 29 05:55:27 user nova-compute[75083]:   <devices>
Nov 29 05:55:27 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:55:27 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:55:27 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk"/>
Nov 29 05:55:27 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:55:27 user nova-compute[75083]:     </disk>
Nov 29 05:55:27 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 05:55:27 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:55:27 user nova-compute[75083]:       <source dev="/dev/sdb"/>
Nov 29 05:55:27 user nova-compute[75083]:       <target dev="vdb" bus="virtio"/>
Nov 29 05:55:27 user nova-compute[75083]:       <serial>ed1112c6-7998-4bf8-b679-c13dddd615a1</serial>
Nov 29 05:55:27 user nova-compute[75083]:     </disk>
Nov 29 05:55:27 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:55:27 user nova-compute[75083]:       <mac address="fa:16:3e:8c:af:fc"/>
Nov 29 05:55:27 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:55:27 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:55:27 user nova-compute[75083]:       <target dev="tap388c9969-42"/>
Nov 29 05:55:27 user nova-compute[75083]:     </interface>
Nov 29 05:55:27 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:55:27 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/console.log" append="off"/>
Nov 29 05:55:27 user nova-compute[75083]:     </serial>
Nov 29 05:55:27 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:55:27 user nova-compute[75083]:     <video>
Nov 29 05:55:27 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:55:27 user nova-compute[75083]:     </video>
Nov 29 05:55:27 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:55:27 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:55:27 user nova-compute[75083]:     </rng>
Nov 29 05:55:27 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:55:27 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:55:27 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:55:27 user nova-compute[75083]:     </memballoon>
Nov 29 05:55:27 user nova-compute[75083]:   </devices>
Nov 29 05:55:27 user nova-compute[75083]: </domain>
Nov 29 05:55:27 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:51:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1765064185',display_name='tempest-ServerActionsTestOtherB-server-1765064185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1765064185',id=15,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKfQt22BKdk3qqBMkdZDrlzUPc5OzBSJvBUhpD5lx0G7UqWh0HRdHS4+8i15ioAIjPFv14fiTBp00VBH9cOAzOvFWtO61YBHreoMNXT+V9qZ3bdKSP6OX3ggUHyDT/bOg==',key_name='tempest-keypair-1198752933',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:51:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='41fbbebd414945beb2130f46013125d8',ramdisk_id='',reservation_id='r-349fa5rg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1953829293',owner_user_name='tempest-ServerActionsTestOtherB-1953829293-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:55:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7f8a0e94feb47bb875ab4d7f1f2a2a1',uuid=fb8244c4-f2a7-4ad8-a210-0f62c165a4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-940601225-network", "vif_mac": "fa:16:3e:8c:af:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Converting VIF {"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-940601225-network", "vif_mac": "fa:16:3e:8c:af:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG os_vif [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ac88727-4ed1-5098-9195-9904c3eebfcc', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap388c9969-42, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap388c9969-42, col_values=(('qos', UUID('05b19e1e-a0c0-49a1-a3fd-04b4f182213c')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap388c9969-42, col_values=(('external_ids', {'iface-id': '388c9969-42dc-4e34-8fb8-c2399687751d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:af:fc', 'vm-uuid': 'fb8244c4-f2a7-4ad8-a210-0f62c165a4dc'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:27 user nova-compute[75083]: INFO os_vif [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42')
Nov 29 05:55:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:55:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] No VIF found with MAC fa:16:3e:8c:af:fc, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:55:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-b4b64f98-bca4-425c-a449-292233563a9c req-27c38573-6428-4b96-80cb-935c1a8f2003 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received event network-changed-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:55:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-b4b64f98-bca4-425c-a449-292233563a9c req-27c38573-6428-4b96-80cb-935c1a8f2003 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Refreshing instance network info cache due to event network-changed-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:55:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b4b64f98-bca4-425c-a449-292233563a9c req-27c38573-6428-4b96-80cb-935c1a8f2003 service nova] Acquiring lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:55:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b4b64f98-bca4-425c-a449-292233563a9c req-27c38573-6428-4b96-80cb-935c1a8f2003 service nova] Acquired lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:55:28 user nova-compute[75083]: DEBUG nova.network.neutron [req-b4b64f98-bca4-425c-a449-292233563a9c req-27c38573-6428-4b96-80cb-935c1a8f2003 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Refreshing network info cache for port f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:55:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:28 user nova-compute[75083]: DEBUG nova.network.neutron [req-b4b64f98-bca4-425c-a449-292233563a9c req-27c38573-6428-4b96-80cb-935c1a8f2003 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Updated VIF entry in instance network info cache for port f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:55:28 user nova-compute[75083]: DEBUG nova.network.neutron [req-b4b64f98-bca4-425c-a449-292233563a9c req-27c38573-6428-4b96-80cb-935c1a8f2003 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Updating instance_info_cache with network_info: [{"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:55:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b4b64f98-bca4-425c-a449-292233563a9c req-27c38573-6428-4b96-80cb-935c1a8f2003 service nova] Releasing lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:55:29 user nova-compute[75083]: DEBUG nova.compute.manager [req-fb25b31b-f531-4eb7-a804-e13cbd0d3374 req-91dda376-c3df-4097-8180-35c9fd831130 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received event network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:55:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fb25b31b-f531-4eb7-a804-e13cbd0d3374 req-91dda376-c3df-4097-8180-35c9fd831130 service nova] Acquiring lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fb25b31b-f531-4eb7-a804-e13cbd0d3374 req-91dda376-c3df-4097-8180-35c9fd831130 service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fb25b31b-f531-4eb7-a804-e13cbd0d3374 req-91dda376-c3df-4097-8180-35c9fd831130 service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:29 user nova-compute[75083]: DEBUG nova.compute.manager [req-fb25b31b-f531-4eb7-a804-e13cbd0d3374 req-91dda376-c3df-4097-8180-35c9fd831130 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] No waiting events found dispatching network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:55:29 user nova-compute[75083]: WARNING nova.compute.manager [req-fb25b31b-f531-4eb7-a804-e13cbd0d3374 req-91dda376-c3df-4097-8180-35c9fd831130 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received unexpected event network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d for instance with vm_state active and task_state resize_finish.
Nov 29 05:55:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:30 user nova-compute[75083]: DEBUG nova.compute.manager [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:55:30 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Instance running successfully.
Nov 29 05:55:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Failed to set time: agent not configured {{(pid=75083) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 05:55:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b3581dbe-5c11-4c02-a891-affc1e3b47e4 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] finish_migration finished successfully. {{(pid=75083) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 05:55:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-077db1d2-3904-4a60-9e5f-0e360cdeec1f req-e4a7fd90-8bec-4282-bace-b86d2c8ed026 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received event network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:55:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-077db1d2-3904-4a60-9e5f-0e360cdeec1f req-e4a7fd90-8bec-4282-bace-b86d2c8ed026 service nova] Acquiring lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-077db1d2-3904-4a60-9e5f-0e360cdeec1f req-e4a7fd90-8bec-4282-bace-b86d2c8ed026 service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-077db1d2-3904-4a60-9e5f-0e360cdeec1f req-e4a7fd90-8bec-4282-bace-b86d2c8ed026 service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-077db1d2-3904-4a60-9e5f-0e360cdeec1f req-e4a7fd90-8bec-4282-bace-b86d2c8ed026 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] No waiting events found dispatching network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:55:31 user nova-compute[75083]: WARNING nova.compute.manager [req-077db1d2-3904-4a60-9e5f-0e360cdeec1f req-e4a7fd90-8bec-4282-bace-b86d2c8ed026 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received unexpected event network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d for instance with vm_state resized and task_state None.
Nov 29 05:55:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "2778daf0-f727-4185-a404-1793b75ac523" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "2778daf0-f727-4185-a404-1793b75ac523" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:32 user nova-compute[75083]: INFO nova.compute.manager [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Shelving
Nov 29 05:55:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquiring lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:32 user nova-compute[75083]: INFO nova.compute.manager [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Unshelving
Nov 29 05:55:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:32 user nova-compute[75083]: INFO nova.virt.block_device [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Booting with volume 637c2fd0-db61-4184-8eee-be13661c3256 at /dev/vda
Nov 29 05:55:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:32 user nova-compute[75083]: DEBUG os_brick.utils [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:55:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a0a699-9559-48c1-aff3-cefefd7c7af7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[740f1c2e-e336-4dad-84d1-aba927b00b2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[198ba5ce-1ddc-4214-9fb5-4bcd263d32e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a9efc3-4f84-4d93-802f-fbfc15f68237]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:55:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:55:33 user nova-compute[75083]: DEBUG nova.compute.manager [req-b9153c9a-2d9d-4785-a0d5-dbb468552e7f req-b940929a-2165-4994-8d58-b95f876e716f service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received event network-vif-unplugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:55:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b9153c9a-2d9d-4785-a0d5-dbb468552e7f req-b940929a-2165-4994-8d58-b95f876e716f service nova] Acquiring lock "2778daf0-f727-4185-a404-1793b75ac523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b9153c9a-2d9d-4785-a0d5-dbb468552e7f req-b940929a-2165-4994-8d58-b95f876e716f service nova] Lock "2778daf0-f727-4185-a404-1793b75ac523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b9153c9a-2d9d-4785-a0d5-dbb468552e7f req-b940929a-2165-4994-8d58-b95f876e716f service nova] Lock "2778daf0-f727-4185-a404-1793b75ac523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:33 user nova-compute[75083]: DEBUG nova.compute.manager [req-b9153c9a-2d9d-4785-a0d5-dbb468552e7f req-b940929a-2165-4994-8d58-b95f876e716f service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] No waiting events found dispatching network-vif-unplugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:55:33 user nova-compute[75083]: WARNING nova.compute.manager [req-b9153c9a-2d9d-4785-a0d5-dbb468552e7f req-b940929a-2165-4994-8d58-b95f876e716f service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received unexpected event network-vif-unplugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 for instance with vm_state active and task_state shelving.
Nov 29 05:55:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:55:33 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:55:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[481efe62-72ff-4132-88a2-d948cef1922c]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:55:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:55:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:55:33 user nova-compute[75083]: DEBUG os_brick.utils [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:55:33 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Updating existing volume attachment record: 166dd8d6-193f-40da-9e09-1ca3281b2da1 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:55:33 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Instance destroyed successfully.
Nov 29 05:55:33 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Beginning cold snapshot process
Nov 29 05:55:33 user nova-compute[75083]: DEBUG nova.privsep.utils [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75083) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 05:55:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk /opt/stack/data/nova/instances/snapshots/tmpoy6kqmi5/ba93ed8ad8884c65ba1e69c2bf6389cc {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk /opt/stack/data/nova/instances/snapshots/tmpoy6kqmi5/ba93ed8ad8884c65ba1e69c2bf6389cc" returned: 0 in 1.115s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:34 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Snapshot extracted, beginning image upload
Nov 29 05:55:35 user nova-compute[75083]: DEBUG nova.compute.manager [req-b22b801e-6001-492b-ad96-0c6a4614c3be req-dfc5859b-e9a5-405d-954b-9098f8baf9b9 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received event network-vif-plugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:55:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b22b801e-6001-492b-ad96-0c6a4614c3be req-dfc5859b-e9a5-405d-954b-9098f8baf9b9 service nova] Acquiring lock "2778daf0-f727-4185-a404-1793b75ac523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b22b801e-6001-492b-ad96-0c6a4614c3be req-dfc5859b-e9a5-405d-954b-9098f8baf9b9 service nova] Lock "2778daf0-f727-4185-a404-1793b75ac523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b22b801e-6001-492b-ad96-0c6a4614c3be req-dfc5859b-e9a5-405d-954b-9098f8baf9b9 service nova] Lock "2778daf0-f727-4185-a404-1793b75ac523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:35 user nova-compute[75083]: DEBUG nova.compute.manager [req-b22b801e-6001-492b-ad96-0c6a4614c3be req-dfc5859b-e9a5-405d-954b-9098f8baf9b9 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] No waiting events found dispatching network-vif-plugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:55:35 user nova-compute[75083]: WARNING nova.compute.manager [req-b22b801e-6001-492b-ad96-0c6a4614c3be req-dfc5859b-e9a5-405d-954b-9098f8baf9b9 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received unexpected event network-vif-plugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 05:55:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:37 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Snapshot image upload complete
Nov 29 05:55:37 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:55:37 user nova-compute[75083]: INFO nova.compute.manager [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Shelve offloading
Nov 29 05:55:37 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Instance destroyed successfully.
Nov 29 05:55:37 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:55:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:55:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquired lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:55:37 user nova-compute[75083]: DEBUG nova.network.neutron [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG nova.network.neutron [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Updating instance_info_cache with network_info: [{"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Releasing lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:55:38 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Instance destroyed successfully.
Nov 29 05:55:38 user nova-compute[75083]: DEBUG nova.objects.instance [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'resources' on Instance uuid 2778daf0-f727-4185-a404-1793b75ac523 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-496298622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-496298622',id=19,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtQ1vuaaWUxtG/9G1YJRDY4MUN2av+CuZbcDT4uGJgXHg4z4ZIrmTihKhSMv3O5tWX5AEk0FPMj1glQqi3+hqk5VH/afqDYN9j0lutfv7odS3an+4n1UEM6ZjECj8n+og==',key_name='tempest-keypair-1008779938',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:53:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d1c63c54083f4a0eba38539e7c196d61',ramdisk_id='',reservation_id='r-c9eon0oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-961204558',owner_user_name='tempest-AttachVolumeShelveTestJSON-961204558-project-member',shelved_at='2023-11-29T05:55:37.579413',shelved_host='user',shelved_image_id='08824c7e-6bed-4f4b-9c9c-2ad712c7b5e8'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:55:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4e6b7adfb1b469ab5c6c3f26633272a',uuid=2778daf0-f727-4185-a404-1793b75ac523,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converting VIF {"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:89:b6,bridge_name='br-int',has_traffic_filtering=True,id=f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ddd3c7-1b') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG os_vif [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:89:b6,bridge_name='br-int',has_traffic_filtering=True,id=f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ddd3c7-1b') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5ddd3c7-1b, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9d90010-4960-44db-915a-188b94748ef4) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-aa5324ff-1358-4218-a9c4-cb5f94dc139a req-31b92d05-ad61-4952-8758-4bdc10902264 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received event network-changed-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-aa5324ff-1358-4218-a9c4-cb5f94dc139a req-31b92d05-ad61-4952-8758-4bdc10902264 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Refreshing instance network info cache due to event network-changed-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-aa5324ff-1358-4218-a9c4-cb5f94dc139a req-31b92d05-ad61-4952-8758-4bdc10902264 service nova] Acquiring lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-aa5324ff-1358-4218-a9c4-cb5f94dc139a req-31b92d05-ad61-4952-8758-4bdc10902264 service nova] Acquired lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG nova.network.neutron [req-aa5324ff-1358-4218-a9c4-cb5f94dc139a req-31b92d05-ad61-4952-8758-4bdc10902264 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Refreshing network info cache for port f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:55:38 user nova-compute[75083]: INFO os_vif [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:89:b6,bridge_name='br-int',has_traffic_filtering=True,id=f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ddd3c7-1b')
Nov 29 05:55:38 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Deleting instance files /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523_del
Nov 29 05:55:38 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Deletion of /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523_del complete
Nov 29 05:55:38 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Deleted allocations for instance 2778daf0-f727-4185-a404-1793b75ac523
Nov 29 05:55:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG nova.objects.instance [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'numa_topology' on Instance uuid 2778daf0-f727-4185-a404-1793b75ac523 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:55:38 user nova-compute[75083]: DEBUG nova.objects.base [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Object Instance<2778daf0-f727-4185-a404-1793b75ac523> lazy-loaded attributes: resources,numa_topology {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:55:39 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:55:39 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:55:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.554s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d429ff86-7617-4265-aece-f73980d1b690 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "2778daf0-f727-4185-a404-1793b75ac523" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.965s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:39 user nova-compute[75083]: DEBUG nova.network.neutron [req-aa5324ff-1358-4218-a9c4-cb5f94dc139a req-31b92d05-ad61-4952-8758-4bdc10902264 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Updated VIF entry in instance network info cache for port f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:55:39 user nova-compute[75083]: DEBUG nova.network.neutron [req-aa5324ff-1358-4218-a9c4-cb5f94dc139a req-31b92d05-ad61-4952-8758-4bdc10902264 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Updating instance_info_cache with network_info: [{"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:55:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-aa5324ff-1358-4218-a9c4-cb5f94dc139a req-31b92d05-ad61-4952-8758-4bdc10902264 service nova] Releasing lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:55:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquiring lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:40 user nova-compute[75083]: DEBUG nova.compute.manager [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:55:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:40 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:55:40 user nova-compute[75083]: INFO nova.compute.claims [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Claim successful on node user
Nov 29 05:55:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG nova.compute.manager [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.238s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG nova.objects.instance [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lazy-loading 'pci_requests' on Instance uuid cb63619b-6d75-49d0-80ef-d98aa21b7d4a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG nova.objects.instance [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lazy-loading 'numa_topology' on Instance uuid cb63619b-6d75-49d0-80ef-d98aa21b7d4a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:55:41 user nova-compute[75083]: INFO nova.compute.claims [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Claim successful on node user
Nov 29 05:55:41 user nova-compute[75083]: DEBUG nova.compute.manager [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG nova.network.neutron [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:55:41 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:55:41 user nova-compute[75083]: DEBUG nova.compute.manager [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG nova.policy [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2615574010e4604b526176f69ccfff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1012483943a489a862040d3a9fddfb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG nova.compute.manager [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:55:41 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Creating image(s)
Nov 29 05:55:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquiring lock "/opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "/opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "/opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.187s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.170s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed/disk 1073741824" returned: 0 in 0.046s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:41 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:41 user nova-compute[75083]: INFO nova.network.neutron [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Updating port df73cb37-8475-4c21-89c7-b02949297b63 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 05:55:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:42 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:55:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:42 user nova-compute[75083]: DEBUG nova.network.neutron [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Successfully created port: f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:55:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:42 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Cannot resize image /opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:55:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:55:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Ensure instance console log exists: /opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:55:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.004s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquiring lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:55:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquired lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:55:43 user nova-compute[75083]: DEBUG nova.network.neutron [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:55:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-5c37aa5a-b637-49e2-b754-a77d873ed832 req-88f5394c-81fa-4f00-bc4d-749889507723 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received event network-changed-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:55:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-5c37aa5a-b637-49e2-b754-a77d873ed832 req-88f5394c-81fa-4f00-bc4d-749889507723 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Refreshing instance network info cache due to event network-changed-df73cb37-8475-4c21-89c7-b02949297b63. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:55:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5c37aa5a-b637-49e2-b754-a77d873ed832 req-88f5394c-81fa-4f00-bc4d-749889507723 service nova] Acquiring lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:55:43 user nova-compute[75083]: DEBUG nova.network.neutron [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Successfully updated port: f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:55:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquiring lock "refresh_cache-d206e7ab-eb5b-4026-a1ea-4b34837b0fed" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:55:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquired lock "refresh_cache-d206e7ab-eb5b-4026-a1ea-4b34837b0fed" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:55:43 user nova-compute[75083]: DEBUG nova.network.neutron [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.network.neutron [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.network.neutron [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Updating instance_info_cache with network_info: [{"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Releasing lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:55:44 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Creating image(s)
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Did not create local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Ensure instance console log exists: /opt/stack/data/nova/instances/cb63619b-6d75-49d0-80ef-d98aa21b7d4a/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Start _get_guest_xml network_info=[{"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '166dd8d6-193f-40da-9e09-1ca3281b2da1', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHCjmAZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cb63619b-6d75-49d0-80ef-d98aa21b7d4a', 'attached_at': '', 'detached_at': '', 'volume_id': '637c2fd0-db61-4184-8eee-be13661c3256', 'serial': '637c2fd0-db61-4184-8eee-be13661c3256'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5c37aa5a-b637-49e2-b754-a77d873ed832 req-88f5394c-81fa-4f00-bc4d-749889507723 service nova] Acquired lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.network.neutron [req-5c37aa5a-b637-49e2-b754-a77d873ed832 req-88f5394c-81fa-4f00-bc4d-749889507723 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Refreshing network info cache for port df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:55:44 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:55:44 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.objects.instance [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lazy-loading 'vcpu_model' on Instance uuid cb63619b-6d75-49d0-80ef-d98aa21b7d4a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.network.neutron [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Updating instance_info_cache with network_info: [{"id": "f83928cd-3df5-4752-bcab-077bad5fd8b8", "address": "fa:16:3e:ff:c3:de", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83928cd-3d", "ovs_interfaceid": "f83928cd-3df5-4752-bcab-077bad5fd8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.objects.base [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Object Instance<cb63619b-6d75-49d0-80ef-d98aa21b7d4a> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHCjmAZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:55:44 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:55:44 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:55:44 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Releasing lock "refresh_cache-d206e7ab-eb5b-4026-a1ea-4b34837b0fed" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.compute.manager [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Instance network_info: |[{"id": "f83928cd-3df5-4752-bcab-077bad5fd8b8", "address": "fa:16:3e:ff:c3:de", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83928cd-3d", "ovs_interfaceid": "f83928cd-3df5-4752-bcab-077bad5fd8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Start _get_guest_xml network_info=[{"id": "f83928cd-3df5-4752-bcab-077bad5fd8b8", "address": "fa:16:3e:ff:c3:de", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83928cd-3d", "ovs_interfaceid": "f83928cd-3df5-4752-bcab-077bad5fd8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:55:44 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:55:44 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfe2df0-1c86-463c-b9a3-cbb7dcb7a600]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:55:44 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-834786237',display_name='tempest-VolumesAdminNegativeTest-server-834786237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-834786237',id=23,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1012483943a489a862040d3a9fddfb6',ramdisk_id='',reservation_id='r-zyqaybdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-971732472',owner_user_name='tempest-VolumesAdminNegativeTest-971732472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:55:41Z,user_data=None,user_id='a2615574010e4604b526176f69ccfff0',uuid=d206e7ab-eb5b-4026-a1ea-4b34837b0fed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f83928cd-3df5-4752-bcab-077bad5fd8b8", "address": "fa:16:3e:ff:c3:de", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83928cd-3d", "ovs_interfaceid": "f83928cd-3df5-4752-bcab-077bad5fd8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Converting VIF {"id": "f83928cd-3df5-4752-bcab-077bad5fd8b8", "address": "fa:16:3e:ff:c3:de", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83928cd-3d", "ovs_interfaceid": "f83928cd-3df5-4752-bcab-077bad5fd8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:c3:de,bridge_name='br-int',has_traffic_filtering=True,id=f83928cd-3df5-4752-bcab-077bad5fd8b8,network=Network(c6a6ca21-a775-4c8e-9075-4dc10bc6cf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83928cd-3d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.objects.instance [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lazy-loading 'pci_devices' on Instance uuid d206e7ab-eb5b-4026-a1ea-4b34837b0fed {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fc3deb-5e29-42a1-bb71-e87df773cc88]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256] added
Nov 29 05:55:44 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:55:44 user nova-compute[75083]:   <uuid>d206e7ab-eb5b-4026-a1ea-4b34837b0fed</uuid>
Nov 29 05:55:44 user nova-compute[75083]:   <name>instance-00000017</name>
Nov 29 05:55:44 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:55:44 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:55:44 user nova-compute[75083]:   <metadata>
Nov 29 05:55:44 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:55:44 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:55:44 user nova-compute[75083]:       <nova:name>tempest-VolumesAdminNegativeTest-server-834786237</nova:name>
Nov 29 05:55:44 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:55:44</nova:creationTime>
Nov 29 05:55:44 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:55:44 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:55:44 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:55:44 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:55:44 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:55:44 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:55:44 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:55:44 user nova-compute[75083]:       <nova:owner>
Nov 29 05:55:44 user nova-compute[75083]:         <nova:user uuid="a2615574010e4604b526176f69ccfff0">tempest-VolumesAdminNegativeTest-971732472-project-member</nova:user>
Nov 29 05:55:44 user nova-compute[75083]:         <nova:project uuid="c1012483943a489a862040d3a9fddfb6">tempest-VolumesAdminNegativeTest-971732472</nova:project>
Nov 29 05:55:44 user nova-compute[75083]:       </nova:owner>
Nov 29 05:55:44 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:55:44 user nova-compute[75083]:       <nova:ports>
Nov 29 05:55:44 user nova-compute[75083]:         <nova:port uuid="f83928cd-3df5-4752-bcab-077bad5fd8b8">
Nov 29 05:55:44 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 05:55:44 user nova-compute[75083]:         </nova:port>
Nov 29 05:55:44 user nova-compute[75083]:       </nova:ports>
Nov 29 05:55:44 user nova-compute[75083]:     </nova:instance>
Nov 29 05:55:44 user nova-compute[75083]:   </metadata>
Nov 29 05:55:44 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:55:44 user nova-compute[75083]:     <system>
Nov 29 05:55:44 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:55:44 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:55:44 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:55:44 user nova-compute[75083]:       <entry name="serial">d206e7ab-eb5b-4026-a1ea-4b34837b0fed</entry>
Nov 29 05:55:44 user nova-compute[75083]:       <entry name="uuid">d206e7ab-eb5b-4026-a1ea-4b34837b0fed</entry>
Nov 29 05:55:44 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:55:44 user nova-compute[75083]:     </system>
Nov 29 05:55:44 user nova-compute[75083]:   </sysinfo>
Nov 29 05:55:44 user nova-compute[75083]:   <os>
Nov 29 05:55:44 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:55:44 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:55:44 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:55:44 user nova-compute[75083]:   </os>
Nov 29 05:55:44 user nova-compute[75083]:   <features>
Nov 29 05:55:44 user nova-compute[75083]:     <acpi/>
Nov 29 05:55:44 user nova-compute[75083]:     <apic/>
Nov 29 05:55:44 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:55:44 user nova-compute[75083]:   </features>
Nov 29 05:55:44 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:55:44 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:55:44 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:55:44 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:55:44 user nova-compute[75083]:   </clock>
Nov 29 05:55:44 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:55:44 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:55:44 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:55:44 user nova-compute[75083]:   </cpu>
Nov 29 05:55:44 user nova-compute[75083]:   <devices>
Nov 29 05:55:44 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:55:44 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:55:44 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed/disk"/>
Nov 29 05:55:44 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:55:44 user nova-compute[75083]:     </disk>
Nov 29 05:55:44 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:55:44 user nova-compute[75083]:       <mac address="fa:16:3e:ff:c3:de"/>
Nov 29 05:55:44 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:55:44 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:55:44 user nova-compute[75083]:       <target dev="tapf83928cd-3d"/>
Nov 29 05:55:44 user nova-compute[75083]:     </interface>
Nov 29 05:55:44 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:55:44 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed/console.log" append="off"/>
Nov 29 05:55:44 user nova-compute[75083]:     </serial>
Nov 29 05:55:44 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:55:44 user nova-compute[75083]:     <video>
Nov 29 05:55:44 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:55:44 user nova-compute[75083]:     </video>
Nov 29 05:55:44 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:55:44 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:55:44 user nova-compute[75083]:     </rng>
Nov 29 05:55:44 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:55:44 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:55:44 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:55:44 user nova-compute[75083]:     </memballoon>
Nov 29 05:55:44 user nova-compute[75083]:   </devices>
Nov 29 05:55:44 user nova-compute[75083]: </domain>
Nov 29 05:55:44 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-834786237',display_name='tempest-VolumesAdminNegativeTest-server-834786237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-834786237',id=23,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1012483943a489a862040d3a9fddfb6',ramdisk_id='',reservation_id='r-zyqaybdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-971732472',owner_user_name='tempest-VolumesAdminNegativeTest-971732472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:55:41Z,user_data=None,user_id='a2615574010e4604b526176f69ccfff0',uuid=d206e7ab-eb5b-4026-a1ea-4b34837b0fed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f83928cd-3df5-4752-bcab-077bad5fd8b8", "address": "fa:16:3e:ff:c3:de", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83928cd-3d", "ovs_interfaceid": "f83928cd-3df5-4752-bcab-077bad5fd8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Converting VIF {"id": "f83928cd-3df5-4752-bcab-077bad5fd8b8", "address": "fa:16:3e:ff:c3:de", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83928cd-3d", "ovs_interfaceid": "f83928cd-3df5-4752-bcab-077bad5fd8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:c3:de,bridge_name='br-int',has_traffic_filtering=True,id=f83928cd-3df5-4752-bcab-077bad5fd8b8,network=Network(c6a6ca21-a775-4c8e-9075-4dc10bc6cf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83928cd-3d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_vif [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:c3:de,bridge_name='br-int',has_traffic_filtering=True,id=f83928cd-3df5-4752-bcab-077bad5fd8b8,network=Network(c6a6ca21-a775-4c8e-9075-4dc10bc6cf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83928cd-3d') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0114dc96-67a8-5ced-94e0-53bc8ea448f6', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf83928cd-3d, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf83928cd-3d, col_values=(('qos', UUID('4f243822-5b35-4392-8853-7982b0374039')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf83928cd-3d, col_values=(('external_ids', {'iface-id': 'f83928cd-3df5-4752-bcab-077bad5fd8b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:c3:de', 'vm-uuid': 'd206e7ab-eb5b-4026-a1ea-4b34837b0fed'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[17333976-f3ca-4393-9d98-0223ab3468a7]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:44 user nova-compute[75083]: INFO os_vif [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:c3:de,bridge_name='br-int',has_traffic_filtering=True,id=f83928cd-3df5-4752-bcab-077bad5fd8b8,network=Network(c6a6ca21-a775-4c8e-9075-4dc10bc6cf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83928cd-3d')
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fac91ce-6eb3-4667-86a4-a691e5d91c58]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RHCjmAZK {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RHCjmAZK" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[83153e12-4b13-4006-a4bc-b127e687611e]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RHCjmAZK'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] No VIF found with MAC fa:16:3e:ff:c3:de, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64b606e-7164-4b4c-8e1b-af81c59960b3]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac01b39-4a3b-4ef8-981c-14a06b385137]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:55:44 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:55:44 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf639776-06e0-4ca2-a633-7a2352ea6694]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256, portal: 172.16.0.220,3260]
Nov 29 05:55:44 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256, portal: 172.16.0.220,3260] successful.
Nov 29 05:55:44 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00b3822-53bb-4c91-8bc6-ab8157f9e3a1]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[33309399-841c-4766-9790-408818ea10be]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:55:44 user nova-compute[75083]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:55:44 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:55:44 user nova-compute[75083]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:55:44 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e16bdf-51ef-4535-abe5-184cb5009a58]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.network.neutron [req-5c37aa5a-b637-49e2-b754-a77d873ed832 req-88f5394c-81fa-4f00-bc4d-749889507723 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Updated VIF entry in instance network info cache for port df73cb37-8475-4c21-89c7-b02949297b63. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG nova.network.neutron [req-5c37aa5a-b637-49e2-b754-a77d873ed832 req-88f5394c-81fa-4f00-bc4d-749889507723 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Updating instance_info_cache with network_info: [{"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:55:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5c37aa5a-b637-49e2-b754-a77d873ed832 req-88f5394c-81fa-4f00-bc4d-749889507723 service nova] Releasing lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-dca11463-8140-4dec-8824-a9845af87cda req-3d8cf0bf-21aa-43e8-8bc0-e85f4834a399 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Received event network-changed-f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-dca11463-8140-4dec-8824-a9845af87cda req-3d8cf0bf-21aa-43e8-8bc0-e85f4834a399 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Refreshing instance network info cache due to event network-changed-f83928cd-3df5-4752-bcab-077bad5fd8b8. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-dca11463-8140-4dec-8824-a9845af87cda req-3d8cf0bf-21aa-43e8-8bc0-e85f4834a399 service nova] Acquiring lock "refresh_cache-d206e7ab-eb5b-4026-a1ea-4b34837b0fed" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-dca11463-8140-4dec-8824-a9845af87cda req-3d8cf0bf-21aa-43e8-8bc0-e85f4834a399 service nova] Acquired lock "refresh_cache-d206e7ab-eb5b-4026-a1ea-4b34837b0fed" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG nova.network.neutron [req-dca11463-8140-4dec-8824-a9845af87cda req-3d8cf0bf-21aa-43e8-8bc0-e85f4834a399 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Refreshing network info cache for port f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHCjmAZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23462323163323363', 'path': '/dev/sdc'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462323163323363', 'path': '/dev/sdc'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T05:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2116511993',display_name='tempest-TestShelveInstance-server-2116511993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2116511993',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-728939459',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:52:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='385f39574be145b6b47e5a7dddf9415e',ramdisk_id='',reservation_id='r-oqenqftq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-925751842',owner_user_name='tempest-TestShelveInstance-925751842-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:55:33Z,user_data=None,user_id='d4fd22380d304dac9cc3db3ad3c971d9',uuid=cb63619b-6d75-49d0-80ef-d98aa21b7d4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Converting VIF {"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:23:d3,bridge_name='br-int',has_traffic_filtering=True,id=df73cb37-8475-4c21-89c7-b02949297b63,network=Network(4c9f102f-b100-4ec2-95cb-4c66dafebf29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf73cb37-84') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG nova.objects.instance [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lazy-loading 'pci_devices' on Instance uuid cb63619b-6d75-49d0-80ef-d98aa21b7d4a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG nova.objects.base [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Object Instance<cb63619b-6d75-49d0-80ef-d98aa21b7d4a> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:55:45 user nova-compute[75083]:   <uuid>cb63619b-6d75-49d0-80ef-d98aa21b7d4a</uuid>
Nov 29 05:55:45 user nova-compute[75083]:   <name>instance-00000011</name>
Nov 29 05:55:45 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:55:45 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:55:45 user nova-compute[75083]:   <metadata>
Nov 29 05:55:45 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:55:45 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:55:45 user nova-compute[75083]:       <nova:name>tempest-TestShelveInstance-server-2116511993</nova:name>
Nov 29 05:55:45 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:55:44</nova:creationTime>
Nov 29 05:55:45 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:55:45 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:55:45 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:55:45 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:55:45 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:55:45 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:55:45 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:55:45 user nova-compute[75083]:       <nova:owner>
Nov 29 05:55:45 user nova-compute[75083]:         <nova:user uuid="d4fd22380d304dac9cc3db3ad3c971d9">tempest-TestShelveInstance-925751842-project-member</nova:user>
Nov 29 05:55:45 user nova-compute[75083]:         <nova:project uuid="385f39574be145b6b47e5a7dddf9415e">tempest-TestShelveInstance-925751842</nova:project>
Nov 29 05:55:45 user nova-compute[75083]:       </nova:owner>
Nov 29 05:55:45 user nova-compute[75083]:       <nova:ports>
Nov 29 05:55:45 user nova-compute[75083]:         <nova:port uuid="df73cb37-8475-4c21-89c7-b02949297b63">
Nov 29 05:55:45 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 05:55:45 user nova-compute[75083]:         </nova:port>
Nov 29 05:55:45 user nova-compute[75083]:       </nova:ports>
Nov 29 05:55:45 user nova-compute[75083]:     </nova:instance>
Nov 29 05:55:45 user nova-compute[75083]:   </metadata>
Nov 29 05:55:45 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:55:45 user nova-compute[75083]:     <system>
Nov 29 05:55:45 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:55:45 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:55:45 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:55:45 user nova-compute[75083]:       <entry name="serial">cb63619b-6d75-49d0-80ef-d98aa21b7d4a</entry>
Nov 29 05:55:45 user nova-compute[75083]:       <entry name="uuid">cb63619b-6d75-49d0-80ef-d98aa21b7d4a</entry>
Nov 29 05:55:45 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:55:45 user nova-compute[75083]:     </system>
Nov 29 05:55:45 user nova-compute[75083]:   </sysinfo>
Nov 29 05:55:45 user nova-compute[75083]:   <os>
Nov 29 05:55:45 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:55:45 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:55:45 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:55:45 user nova-compute[75083]:   </os>
Nov 29 05:55:45 user nova-compute[75083]:   <features>
Nov 29 05:55:45 user nova-compute[75083]:     <acpi/>
Nov 29 05:55:45 user nova-compute[75083]:     <apic/>
Nov 29 05:55:45 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:55:45 user nova-compute[75083]:   </features>
Nov 29 05:55:45 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:55:45 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:55:45 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:55:45 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:55:45 user nova-compute[75083]:   </clock>
Nov 29 05:55:45 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:55:45 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:55:45 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:55:45 user nova-compute[75083]:   </cpu>
Nov 29 05:55:45 user nova-compute[75083]:   <devices>
Nov 29 05:55:45 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 05:55:45 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:55:45 user nova-compute[75083]:       <source dev="/dev/sdc"/>
Nov 29 05:55:45 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:55:45 user nova-compute[75083]:       <serial>637c2fd0-db61-4184-8eee-be13661c3256</serial>
Nov 29 05:55:45 user nova-compute[75083]:     </disk>
Nov 29 05:55:45 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:55:45 user nova-compute[75083]:       <mac address="fa:16:3e:58:23:d3"/>
Nov 29 05:55:45 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:55:45 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:55:45 user nova-compute[75083]:       <target dev="tapdf73cb37-84"/>
Nov 29 05:55:45 user nova-compute[75083]:     </interface>
Nov 29 05:55:45 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:55:45 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/cb63619b-6d75-49d0-80ef-d98aa21b7d4a/console.log" append="off"/>
Nov 29 05:55:45 user nova-compute[75083]:     </serial>
Nov 29 05:55:45 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:55:45 user nova-compute[75083]:     <video>
Nov 29 05:55:45 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:55:45 user nova-compute[75083]:     </video>
Nov 29 05:55:45 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:55:45 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:55:45 user nova-compute[75083]:     </rng>
Nov 29 05:55:45 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:55:45 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:55:45 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:55:45 user nova-compute[75083]:     </memballoon>
Nov 29 05:55:45 user nova-compute[75083]:   </devices>
Nov 29 05:55:45 user nova-compute[75083]: </domain>
Nov 29 05:55:45 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T05:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2116511993',display_name='tempest-TestShelveInstance-server-2116511993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2116511993',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-728939459',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:52:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='385f39574be145b6b47e5a7dddf9415e',ramdisk_id='',reservation_id='r-oqenqftq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-925751842',owner_user_name='tempest-TestShelveInstance-925751842-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:55:33Z,user_data=None,user_id='d4fd22380d304dac9cc3db3ad3c971d9',uuid=cb63619b-6d75-49d0-80ef-d98aa21b7d4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Converting VIF {"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:23:d3,bridge_name='br-int',has_traffic_filtering=True,id=df73cb37-8475-4c21-89c7-b02949297b63,network=Network(4c9f102f-b100-4ec2-95cb-4c66dafebf29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf73cb37-84') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG os_vif [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:23:d3,bridge_name='br-int',has_traffic_filtering=True,id=df73cb37-8475-4c21-89c7-b02949297b63,network=Network(4c9f102f-b100-4ec2-95cb-4c66dafebf29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf73cb37-84') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c44e3a13-0b39-5911-b497-3985626fe852', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf73cb37-84, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf73cb37-84, col_values=(('qos', UUID('7f61222e-0e52-4ab2-a254-4db98a418180')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf73cb37-84, col_values=(('external_ids', {'iface-id': 'df73cb37-8475-4c21-89c7-b02949297b63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:23:d3', 'vm-uuid': 'cb63619b-6d75-49d0-80ef-d98aa21b7d4a'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:45 user nova-compute[75083]: INFO os_vif [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:23:d3,bridge_name='br-int',has_traffic_filtering=True,id=df73cb37-8475-4c21-89c7-b02949297b63,network=Network(4c9f102f-b100-4ec2-95cb-4c66dafebf29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf73cb37-84')
Nov 29 05:55:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] No VIF found with MAC fa:16:3e:58:23:d3, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:55:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:46 user nova-compute[75083]: DEBUG nova.network.neutron [req-dca11463-8140-4dec-8824-a9845af87cda req-3d8cf0bf-21aa-43e8-8bc0-e85f4834a399 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Updated VIF entry in instance network info cache for port f83928cd-3df5-4752-bcab-077bad5fd8b8. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:55:46 user nova-compute[75083]: DEBUG nova.network.neutron [req-dca11463-8140-4dec-8824-a9845af87cda req-3d8cf0bf-21aa-43e8-8bc0-e85f4834a399 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Updating instance_info_cache with network_info: [{"id": "f83928cd-3df5-4752-bcab-077bad5fd8b8", "address": "fa:16:3e:ff:c3:de", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83928cd-3d", "ovs_interfaceid": "f83928cd-3df5-4752-bcab-077bad5fd8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:55:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-dca11463-8140-4dec-8824-a9845af87cda req-3d8cf0bf-21aa-43e8-8bc0-e85f4834a399 service nova] Releasing lock "refresh_cache-d206e7ab-eb5b-4026-a1ea-4b34837b0fed" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:55:46 user nova-compute[75083]: DEBUG nova.compute.manager [req-2203de23-902f-4af0-ac94-d4510b45dfa1 req-a63f6917-df5e-43cc-8258-750b4869188b service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Received event network-vif-plugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:55:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2203de23-902f-4af0-ac94-d4510b45dfa1 req-a63f6917-df5e-43cc-8258-750b4869188b service nova] Acquiring lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2203de23-902f-4af0-ac94-d4510b45dfa1 req-a63f6917-df5e-43cc-8258-750b4869188b service nova] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2203de23-902f-4af0-ac94-d4510b45dfa1 req-a63f6917-df5e-43cc-8258-750b4869188b service nova] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:46 user nova-compute[75083]: DEBUG nova.compute.manager [req-2203de23-902f-4af0-ac94-d4510b45dfa1 req-a63f6917-df5e-43cc-8258-750b4869188b service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] No waiting events found dispatching network-vif-plugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:55:46 user nova-compute[75083]: WARNING nova.compute.manager [req-2203de23-902f-4af0-ac94-d4510b45dfa1 req-a63f6917-df5e-43cc-8258-750b4869188b service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Received unexpected event network-vif-plugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 for instance with vm_state building and task_state spawning.
Nov 29 05:55:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:48 user nova-compute[75083]: DEBUG nova.compute.manager [req-d9d3032f-3ef6-49f4-9faf-dcfd5cf7985b req-728e57a8-df07-4f1e-8fd0-99430e9f5396 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Received event network-vif-plugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:55:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d9d3032f-3ef6-49f4-9faf-dcfd5cf7985b req-728e57a8-df07-4f1e-8fd0-99430e9f5396 service nova] Acquiring lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d9d3032f-3ef6-49f4-9faf-dcfd5cf7985b req-728e57a8-df07-4f1e-8fd0-99430e9f5396 service nova] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d9d3032f-3ef6-49f4-9faf-dcfd5cf7985b req-728e57a8-df07-4f1e-8fd0-99430e9f5396 service nova] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:48 user nova-compute[75083]: DEBUG nova.compute.manager [req-d9d3032f-3ef6-49f4-9faf-dcfd5cf7985b req-728e57a8-df07-4f1e-8fd0-99430e9f5396 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] No waiting events found dispatching network-vif-plugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:55:48 user nova-compute[75083]: WARNING nova.compute.manager [req-d9d3032f-3ef6-49f4-9faf-dcfd5cf7985b req-728e57a8-df07-4f1e-8fd0-99430e9f5396 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Received unexpected event network-vif-plugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 for instance with vm_state building and task_state spawning.
Nov 29 05:55:48 user nova-compute[75083]: DEBUG nova.compute.manager [req-d9d3032f-3ef6-49f4-9faf-dcfd5cf7985b req-728e57a8-df07-4f1e-8fd0-99430e9f5396 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received event network-vif-plugged-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:55:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d9d3032f-3ef6-49f4-9faf-dcfd5cf7985b req-728e57a8-df07-4f1e-8fd0-99430e9f5396 service nova] Acquiring lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d9d3032f-3ef6-49f4-9faf-dcfd5cf7985b req-728e57a8-df07-4f1e-8fd0-99430e9f5396 service nova] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d9d3032f-3ef6-49f4-9faf-dcfd5cf7985b req-728e57a8-df07-4f1e-8fd0-99430e9f5396 service nova] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:48 user nova-compute[75083]: DEBUG nova.compute.manager [req-d9d3032f-3ef6-49f4-9faf-dcfd5cf7985b req-728e57a8-df07-4f1e-8fd0-99430e9f5396 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] No waiting events found dispatching network-vif-plugged-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:55:48 user nova-compute[75083]: WARNING nova.compute.manager [req-d9d3032f-3ef6-49f4-9faf-dcfd5cf7985b req-728e57a8-df07-4f1e-8fd0-99430e9f5396 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received unexpected event network-vif-plugged-df73cb37-8475-4c21-89c7-b02949297b63 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 05:55:48 user nova-compute[75083]: DEBUG nova.compute.manager [req-d9d3032f-3ef6-49f4-9faf-dcfd5cf7985b req-728e57a8-df07-4f1e-8fd0-99430e9f5396 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received event network-vif-plugged-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:55:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d9d3032f-3ef6-49f4-9faf-dcfd5cf7985b req-728e57a8-df07-4f1e-8fd0-99430e9f5396 service nova] Acquiring lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d9d3032f-3ef6-49f4-9faf-dcfd5cf7985b req-728e57a8-df07-4f1e-8fd0-99430e9f5396 service nova] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d9d3032f-3ef6-49f4-9faf-dcfd5cf7985b req-728e57a8-df07-4f1e-8fd0-99430e9f5396 service nova] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:48 user nova-compute[75083]: DEBUG nova.compute.manager [req-d9d3032f-3ef6-49f4-9faf-dcfd5cf7985b req-728e57a8-df07-4f1e-8fd0-99430e9f5396 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] No waiting events found dispatching network-vif-plugged-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:55:48 user nova-compute[75083]: WARNING nova.compute.manager [req-d9d3032f-3ef6-49f4-9faf-dcfd5cf7985b req-728e57a8-df07-4f1e-8fd0-99430e9f5396 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received unexpected event network-vif-plugged-df73cb37-8475-4c21-89c7-b02949297b63 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 05:55:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:55:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:55:49 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Instance spawned successfully.
Nov 29 05:55:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:55:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:55:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:55:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:55:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:55:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:55:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:55:49 user nova-compute[75083]: INFO nova.compute.manager [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Took 7.92 seconds to spawn the instance on the hypervisor.
Nov 29 05:55:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:55:49 user nova-compute[75083]: INFO nova.compute.manager [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Took 8.75 seconds to build instance.
Nov 29 05:55:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27a24861-e14b-4a66-a49f-f803e410f14c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.853s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:55:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:55:49 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Instance spawned successfully.
Nov 29 05:55:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:55:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-741427a8-be9d-41de-9254-250c8cef9127 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.226s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:50 user nova-compute[75083]: INFO nova.compute.manager [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Terminating instance
Nov 29 05:55:50 user nova-compute[75083]: DEBUG nova.compute.manager [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:55:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:50 user nova-compute[75083]: DEBUG nova.compute.manager [req-c858531b-5634-486c-aa4e-aa0bf398a33d req-1bbc5946-091c-44ff-a017-fb96fa78c2e8 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Received event network-vif-unplugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:55:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c858531b-5634-486c-aa4e-aa0bf398a33d req-1bbc5946-091c-44ff-a017-fb96fa78c2e8 service nova] Acquiring lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c858531b-5634-486c-aa4e-aa0bf398a33d req-1bbc5946-091c-44ff-a017-fb96fa78c2e8 service nova] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c858531b-5634-486c-aa4e-aa0bf398a33d req-1bbc5946-091c-44ff-a017-fb96fa78c2e8 service nova] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:50 user nova-compute[75083]: DEBUG nova.compute.manager [req-c858531b-5634-486c-aa4e-aa0bf398a33d req-1bbc5946-091c-44ff-a017-fb96fa78c2e8 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] No waiting events found dispatching network-vif-unplugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:55:50 user nova-compute[75083]: DEBUG nova.compute.manager [req-c858531b-5634-486c-aa4e-aa0bf398a33d req-1bbc5946-091c-44ff-a017-fb96fa78c2e8 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Received event network-vif-unplugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:55:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:51 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Instance destroyed successfully.
Nov 29 05:55:51 user nova-compute[75083]: DEBUG nova.objects.instance [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lazy-loading 'resources' on Instance uuid b6d38a2c-a512-41f2-a7df-6a54058f8f8b {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:55:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T05:50:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-767389487',display_name='tempest-ServerActionsTestOtherA-server-1845157183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-767389487',id=12,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfvHF6/oSNRPLODGah+lUX+h6/YktVuSfbjhiVUADedZo8ZZa8yTY3sj5iWRDCdXv2wxDvaROa6nC6uX8hHjhEFAijNYi3sdzIr+uRnWW/58teiEfkLjGJRSM5qLnzVvA==',key_name='tempest-keypair-720253988',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:52:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95d0f3dd09bf436498e67d7bfdd904bf',ramdisk_id='',reservation_id='r-z46r3ddw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2114836332',owner_user_name='tempest-ServerActionsTestOtherA-2114836332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:52:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbd7f863ad7c4229957c4b08601b5003',uuid=b6d38a2c-a512-41f2-a7df-6a54058f8f8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "address": "fa:16:3e:f6:1e:5c", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf04f87a-6d", "ovs_interfaceid": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:55:51 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converting VIF {"id": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "address": "fa:16:3e:f6:1e:5c", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf04f87a-6d", "ovs_interfaceid": "cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:55:51 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf04f87a-6d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:55:51 user nova-compute[75083]: DEBUG os_vif [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf04f87a-6d') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:55:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf04f87a-6d, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:55:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a4c555d-d015-4a21-937d-117ccd8695a8) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:55:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:55:51 user nova-compute[75083]: INFO os_vif [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf04f87a-6d')
Nov 29 05:55:51 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Deleting instance files /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b_del
Nov 29 05:55:51 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Deletion of /opt/stack/data/nova/instances/b6d38a2c-a512-41f2-a7df-6a54058f8f8b_del complete
Nov 29 05:55:51 user nova-compute[75083]: INFO nova.compute.manager [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 05:55:51 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 05:55:51 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 05:55:51 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 05:55:51 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:55:51 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Took 0.67 seconds to deallocate network for instance.
Nov 29 05:55:51 user nova-compute[75083]: DEBUG nova.compute.manager [req-41866e08-93fd-42f1-a4e9-145c1daa9132 req-53a3e5ba-3aab-4c16-bc41-4bb42713cb79 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Received event network-vif-deleted-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:55:51 user nova-compute[75083]: INFO nova.compute.manager [req-41866e08-93fd-42f1-a4e9-145c1daa9132 req-53a3e5ba-3aab-4c16-bc41-4bb42713cb79 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Neutron deleted interface cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3; detaching it from the instance and deleting it from the info cache
Nov 29 05:55:51 user nova-compute[75083]: DEBUG nova.network.neutron [req-41866e08-93fd-42f1-a4e9-145c1daa9132 req-53a3e5ba-3aab-4c16-bc41-4bb42713cb79 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:55:51 user nova-compute[75083]: DEBUG nova.compute.manager [req-41866e08-93fd-42f1-a4e9-145c1daa9132 req-53a3e5ba-3aab-4c16-bc41-4bb42713cb79 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Detach interface failed, port_id=cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3, reason: Instance b6d38a2c-a512-41f2-a7df-6a54058f8f8b could not be found. {{(pid=75083) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 05:55:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:52 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:55:52 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:55:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:52 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Deleted allocations for instance b6d38a2c-a512-41f2-a7df-6a54058f8f8b
Nov 29 05:55:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7c116c21-c1a1-46a7-86bd-534fc2cbb6e9 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.206s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:52 user nova-compute[75083]: DEBUG nova.compute.manager [req-ef481cf1-cf60-48d5-bc14-363060cff3f5 req-1963a387-bc23-49b0-b2fe-19b86869c9d7 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Received event network-vif-plugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:55:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ef481cf1-cf60-48d5-bc14-363060cff3f5 req-1963a387-bc23-49b0-b2fe-19b86869c9d7 service nova] Acquiring lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:55:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ef481cf1-cf60-48d5-bc14-363060cff3f5 req-1963a387-bc23-49b0-b2fe-19b86869c9d7 service nova] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:55:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ef481cf1-cf60-48d5-bc14-363060cff3f5 req-1963a387-bc23-49b0-b2fe-19b86869c9d7 service nova] Lock "b6d38a2c-a512-41f2-a7df-6a54058f8f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:55:52 user nova-compute[75083]: DEBUG nova.compute.manager [req-ef481cf1-cf60-48d5-bc14-363060cff3f5 req-1963a387-bc23-49b0-b2fe-19b86869c9d7 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] No waiting events found dispatching network-vif-plugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:55:52 user nova-compute[75083]: WARNING nova.compute.manager [req-ef481cf1-cf60-48d5-bc14-363060cff3f5 req-1963a387-bc23-49b0-b2fe-19b86869c9d7 service nova] [instance: b6d38a2c-a512-41f2-a7df-6a54058f8f8b] Received unexpected event network-vif-plugged-cf04f87a-6d7e-4850-8d7f-2e1d1ba607e3 for instance with vm_state deleted and task_state None.
Nov 29 05:55:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:55:57 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:55:59 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:56:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:56:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 05:56:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:02 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:56:03 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:56:04 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:56:04 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:56:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:04 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 05:56:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:56:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:56:08 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:56:08 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:56:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=7458MB free_disk=25.26074981689453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 05:56:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Applying migration context for instance fb8244c4-f2a7-4ad8-a210-0f62c165a4dc as it has an incoming, in-progress migration cf5b552d-fb41-4bc3-9033-f6622a9b82a4. Migration status is finished {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 05:56:08 user nova-compute[75083]: INFO nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Updating resource usage from migration cf5b552d-fb41-4bc3-9033-f6622a9b82a4
Nov 29 05:56:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance e6d49806-cecd-473a-b92f-9255868d35c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:56:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 161c6455-90ce-4c40-a33e-7f582989135d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:56:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:56:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4435ed78-e35f-4859-8a4f-9920815d968a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:56:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a34d9d98-be73-4d52-85f0-83e48f60bc12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:56:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 63e7d632-d185-4cac-97c9-eafddd90c259 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:56:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Migration cf5b552d-fb41-4bc3-9033-f6622a9b82a4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 05:56:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fb8244c4-f2a7-4ad8-a210-0f62c165a4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:56:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance cb63619b-6d75-49d0-80ef-d98aa21b7d4a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:56:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance d206e7ab-eb5b-4026-a1ea-4b34837b0fed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:56:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 05:56:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 05:56:08 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:56:08 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:56:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 05:56:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:09 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:56:09 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 05:56:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:56:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:56:09 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Updating instance_info_cache with network_info: [{"id": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "address": "fa:16:3e:0f:c8:f5", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape58bdd4f-98", "ovs_interfaceid": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "e6d49806-cecd-473a-b92f-9255868d35c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:10 user nova-compute[75083]: INFO nova.compute.manager [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Terminating instance
Nov 29 05:56:10 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-ddb0e5d5-2b0e-4366-84ca-562f171eff3a req-096853a0-61b5-4752-ad1a-9fab2276baee service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received event network-vif-unplugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ddb0e5d5-2b0e-4366-84ca-562f171eff3a req-096853a0-61b5-4752-ad1a-9fab2276baee service nova] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ddb0e5d5-2b0e-4366-84ca-562f171eff3a req-096853a0-61b5-4752-ad1a-9fab2276baee service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ddb0e5d5-2b0e-4366-84ca-562f171eff3a req-096853a0-61b5-4752-ad1a-9fab2276baee service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-ddb0e5d5-2b0e-4366-84ca-562f171eff3a req-096853a0-61b5-4752-ad1a-9fab2276baee service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] No waiting events found dispatching network-vif-unplugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:56:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-ddb0e5d5-2b0e-4366-84ca-562f171eff3a req-096853a0-61b5-4752-ad1a-9fab2276baee service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received event network-vif-unplugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:56:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:11 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Instance destroyed successfully.
Nov 29 05:56:11 user nova-compute[75083]: DEBUG nova.objects.instance [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'resources' on Instance uuid e6d49806-cecd-473a-b92f-9255868d35c7 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:56:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1653680976',display_name='tempest-AttachVolumeTestJSON-server-1653680976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1653680976',id=1,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOJP1hrn9YscfxvgIeV/wzeq3iJtsHPsw4UYwsBDpY8QrDAnobm8WRbnfZio9s2zPze+QLzStURV3KhLmNcFlFIYVxh1xHzL9FnGoRwL1BjeWphRTOqz9jLnn2TEGffsg==',key_name='tempest-keypair-1515818350',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4c1cb7a503b446f945f12b3b998035b',ramdisk_id='',reservation_id='r-50iyzeul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1539985865',owner_user_name='tempest-AttachVolumeTestJSON-1539985865-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:54:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f2d92aba5c4069b94b8a5cd8b72a46',uuid=e6d49806-cecd-473a-b92f-9255868d35c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:56:11 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converting VIF {"id": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "address": "fa:16:3e:7a:b6:78", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec74c9e-a1", "ovs_interfaceid": "1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:56:11 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:56:11 user nova-compute[75083]: DEBUG os_vif [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:56:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ec74c9e-a1, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:56:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:56:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be5e6c51-e12a-4bec-b8cb-0f83fda33464) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:56:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:56:11 user nova-compute[75083]: INFO os_vif [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b6:78,bridge_name='br-int',has_traffic_filtering=True,id=1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec74c9e-a1')
Nov 29 05:56:11 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Deleting instance files /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7_del
Nov 29 05:56:11 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Deletion of /opt/stack/data/nova/instances/e6d49806-cecd-473a-b92f-9255868d35c7_del complete
Nov 29 05:56:11 user nova-compute[75083]: INFO nova.compute.manager [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 29 05:56:11 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 05:56:11 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 05:56:11 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 05:56:12 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:56:12 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Took 1.29 seconds to deallocate network for instance.
Nov 29 05:56:12 user nova-compute[75083]: DEBUG nova.compute.manager [req-49e0e1ef-3f68-4a44-9cd3-5abcdbfb1d0e req-fb7662e7-2af4-4b09-bb62-e459413b4f2d service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received event network-vif-deleted-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:56:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:13 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:56:13 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:56:13 user nova-compute[75083]: DEBUG nova.compute.manager [req-17e86473-f344-4aaf-a050-859c1ff07eaf req-eca2ae62-f111-46b8-aa93-a18e72daf328 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:56:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-17e86473-f344-4aaf-a050-859c1ff07eaf req-eca2ae62-f111-46b8-aa93-a18e72daf328 service nova] Acquiring lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-17e86473-f344-4aaf-a050-859c1ff07eaf req-eca2ae62-f111-46b8-aa93-a18e72daf328 service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-17e86473-f344-4aaf-a050-859c1ff07eaf req-eca2ae62-f111-46b8-aa93-a18e72daf328 service nova] Lock "e6d49806-cecd-473a-b92f-9255868d35c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:13 user nova-compute[75083]: DEBUG nova.compute.manager [req-17e86473-f344-4aaf-a050-859c1ff07eaf req-eca2ae62-f111-46b8-aa93-a18e72daf328 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] No waiting events found dispatching network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:56:13 user nova-compute[75083]: WARNING nova.compute.manager [req-17e86473-f344-4aaf-a050-859c1ff07eaf req-eca2ae62-f111-46b8-aa93-a18e72daf328 service nova] [instance: e6d49806-cecd-473a-b92f-9255868d35c7] Received unexpected event network-vif-plugged-1ec74c9e-a190-4e1f-8ffc-cb8ae143cfd0 for instance with vm_state deleted and task_state None.
Nov 29 05:56:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:13 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Deleted allocations for instance e6d49806-cecd-473a-b92f-9255868d35c7
Nov 29 05:56:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fee0fcba-8938-4532-adf6-f9db8d3874c8 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "e6d49806-cecd-473a-b92f-9255868d35c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.481s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Acquiring lock "05f45fef-c8a7-41c1-a571-863307caca6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "05f45fef-c8a7-41c1-a571-863307caca6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:17 user nova-compute[75083]: INFO nova.compute.manager [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Rescuing
Nov 29 05:56:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "refresh_cache-a34d9d98-be73-4d52-85f0-83e48f60bc12" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:56:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquired lock "refresh_cache-a34d9d98-be73-4d52-85f0-83e48f60bc12" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:56:17 user nova-compute[75083]: DEBUG nova.network.neutron [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:56:17 user nova-compute[75083]: DEBUG nova.compute.manager [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:56:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:17 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:56:17 user nova-compute[75083]: INFO nova.compute.claims [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Claim successful on node user
Nov 29 05:56:17 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG nova.compute.manager [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG nova.network.neutron [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Updating instance_info_cache with network_info: [{"id": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "address": "fa:16:3e:eb:95:6e", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31b37f5-06", "ovs_interfaceid": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Releasing lock "refresh_cache-a34d9d98-be73-4d52-85f0-83e48f60bc12" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG nova.compute.manager [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG nova.network.neutron [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:56:18 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:56:18 user nova-compute[75083]: DEBUG nova.compute.manager [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG nova.policy [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e3cf798ed354d3ba55c0ff609e22d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42598c48c05439f8059b4b8bf30b9dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG nova.compute.manager [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:56:18 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Creating image(s)
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Acquiring lock "/opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "/opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "/opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-5a96ecb9-0f3c-4b19-9962-a02380d89d7e req-9c6728fc-9ab6-4baa-97df-a0fe4d78cad4 service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Received event network-vif-unplugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5a96ecb9-0f3c-4b19-9962-a02380d89d7e req-9c6728fc-9ab6-4baa-97df-a0fe4d78cad4 service nova] Acquiring lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5a96ecb9-0f3c-4b19-9962-a02380d89d7e req-9c6728fc-9ab6-4baa-97df-a0fe4d78cad4 service nova] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5a96ecb9-0f3c-4b19-9962-a02380d89d7e req-9c6728fc-9ab6-4baa-97df-a0fe4d78cad4 service nova] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-5a96ecb9-0f3c-4b19-9962-a02380d89d7e req-9c6728fc-9ab6-4baa-97df-a0fe4d78cad4 service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] No waiting events found dispatching network-vif-unplugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:56:18 user nova-compute[75083]: WARNING nova.compute.manager [req-5a96ecb9-0f3c-4b19-9962-a02380d89d7e req-9c6728fc-9ab6-4baa-97df-a0fe4d78cad4 service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Received unexpected event network-vif-unplugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 for instance with vm_state active and task_state rescuing.
Nov 29 05:56:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.198s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.191s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk 1073741824" returned: 0 in 0.056s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG nova.network.neutron [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Successfully created port: 27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:18 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Instance destroyed successfully.
Nov 29 05:56:18 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Attempting rescue
Nov 29 05:56:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75083) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Instance directory exists: not creating {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 05:56:18 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Creating image(s)
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "/opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "/opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "/opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG nova.objects.instance [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'trusted_certs' on Instance uuid a34d9d98-be73-4d52-85f0-83e48f60bc12 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.190s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:56:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.182s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Cannot resize image /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Ensure instance console log exists: /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue" returned: 0 in 0.058s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.objects.instance [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'migration_context' on Instance uuid a34d9d98-be73-4d52-85f0-83e48f60bc12 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.objects.base [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Object Instance<a34d9d98-be73-4d52-85f0-83e48f60bc12> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Start _get_guest_xml network_info=[{"id": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "address": "fa:16:3e:eb:95:6e", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "vif_mac": "fa:16:3e:eb:95:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31b37f5-06", "ovs_interfaceid": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.objects.instance [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'resources' on Instance uuid a34d9d98-be73-4d52-85f0-83e48f60bc12 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.objects.base [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Object Instance<a34d9d98-be73-4d52-85f0-83e48f60bc12> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.objects.instance [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'numa_topology' on Instance uuid a34d9d98-be73-4d52-85f0-83e48f60bc12 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.objects.base [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Object Instance<a34d9d98-be73-4d52-85f0-83e48f60bc12> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:56:19 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:56:19 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.objects.instance [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'vcpu_model' on Instance uuid a34d9d98-be73-4d52-85f0-83e48f60bc12 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.objects.base [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Object Instance<a34d9d98-be73-4d52-85f0-83e48f60bc12> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-682698187',display_name='tempest-ServerRescueNegativeTestJSON-server-682698187',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-682698187',id=21,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:54:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7833259e5df546ba86139af68fcb7906',ramdisk_id='',reservation_id='r-et4t7qoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1120078925',owner_user_name='tempest-ServerRescueNegativeTestJSON-1120078925-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:54:36Z,user_data=None,user_id='eb74d3aef4664ff8bdec4110c6867056',uuid=a34d9d98-be73-4d52-85f0-83e48f60bc12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "address": "fa:16:3e:eb:95:6e", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "vif_mac": "fa:16:3e:eb:95:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31b37f5-06", "ovs_interfaceid": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converting VIF {"id": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "address": "fa:16:3e:eb:95:6e", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "vif_mac": "fa:16:3e:eb:95:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31b37f5-06", "ovs_interfaceid": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:95:6e,bridge_name='br-int',has_traffic_filtering=True,id=b31b37f5-06db-44ee-a798-37e3a7ea9ab5,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31b37f5-06') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.objects.instance [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'pci_devices' on Instance uuid a34d9d98-be73-4d52-85f0-83e48f60bc12 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.objects.base [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Object Instance<a34d9d98-be73-4d52-85f0-83e48f60bc12> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:56:19 user nova-compute[75083]:   <uuid>a34d9d98-be73-4d52-85f0-83e48f60bc12</uuid>
Nov 29 05:56:19 user nova-compute[75083]:   <name>instance-00000015</name>
Nov 29 05:56:19 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:56:19 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:56:19 user nova-compute[75083]:   <metadata>
Nov 29 05:56:19 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:56:19 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:56:19 user nova-compute[75083]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-682698187</nova:name>
Nov 29 05:56:19 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:56:19</nova:creationTime>
Nov 29 05:56:19 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:56:19 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:56:19 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:56:19 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:56:19 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:56:19 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:56:19 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:56:19 user nova-compute[75083]:       <nova:owner>
Nov 29 05:56:19 user nova-compute[75083]:         <nova:user uuid="eb74d3aef4664ff8bdec4110c6867056">tempest-ServerRescueNegativeTestJSON-1120078925-project-member</nova:user>
Nov 29 05:56:19 user nova-compute[75083]:         <nova:project uuid="7833259e5df546ba86139af68fcb7906">tempest-ServerRescueNegativeTestJSON-1120078925</nova:project>
Nov 29 05:56:19 user nova-compute[75083]:       </nova:owner>
Nov 29 05:56:19 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:56:19 user nova-compute[75083]:       <nova:ports>
Nov 29 05:56:19 user nova-compute[75083]:         <nova:port uuid="b31b37f5-06db-44ee-a798-37e3a7ea9ab5">
Nov 29 05:56:19 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 05:56:19 user nova-compute[75083]:         </nova:port>
Nov 29 05:56:19 user nova-compute[75083]:       </nova:ports>
Nov 29 05:56:19 user nova-compute[75083]:     </nova:instance>
Nov 29 05:56:19 user nova-compute[75083]:   </metadata>
Nov 29 05:56:19 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:56:19 user nova-compute[75083]:     <system>
Nov 29 05:56:19 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:56:19 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:56:19 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:56:19 user nova-compute[75083]:       <entry name="serial">a34d9d98-be73-4d52-85f0-83e48f60bc12</entry>
Nov 29 05:56:19 user nova-compute[75083]:       <entry name="uuid">a34d9d98-be73-4d52-85f0-83e48f60bc12</entry>
Nov 29 05:56:19 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:56:19 user nova-compute[75083]:     </system>
Nov 29 05:56:19 user nova-compute[75083]:   </sysinfo>
Nov 29 05:56:19 user nova-compute[75083]:   <os>
Nov 29 05:56:19 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:56:19 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:56:19 user nova-compute[75083]:   </os>
Nov 29 05:56:19 user nova-compute[75083]:   <features>
Nov 29 05:56:19 user nova-compute[75083]:     <acpi/>
Nov 29 05:56:19 user nova-compute[75083]:     <apic/>
Nov 29 05:56:19 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:56:19 user nova-compute[75083]:   </features>
Nov 29 05:56:19 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:56:19 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:56:19 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:56:19 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:56:19 user nova-compute[75083]:   </clock>
Nov 29 05:56:19 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:56:19 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:56:19 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:56:19 user nova-compute[75083]:   </cpu>
Nov 29 05:56:19 user nova-compute[75083]:   <devices>
Nov 29 05:56:19 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:56:19 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:56:19 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue"/>
Nov 29 05:56:19 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:56:19 user nova-compute[75083]:     </disk>
Nov 29 05:56:19 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:56:19 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:56:19 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk"/>
Nov 29 05:56:19 user nova-compute[75083]:       <target dev="vdb" bus="virtio"/>
Nov 29 05:56:19 user nova-compute[75083]:     </disk>
Nov 29 05:56:19 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:56:19 user nova-compute[75083]:       <mac address="fa:16:3e:eb:95:6e"/>
Nov 29 05:56:19 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:56:19 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:56:19 user nova-compute[75083]:       <target dev="tapb31b37f5-06"/>
Nov 29 05:56:19 user nova-compute[75083]:     </interface>
Nov 29 05:56:19 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:56:19 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/console.log" append="off"/>
Nov 29 05:56:19 user nova-compute[75083]:     </serial>
Nov 29 05:56:19 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:56:19 user nova-compute[75083]:     <video>
Nov 29 05:56:19 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:56:19 user nova-compute[75083]:     </video>
Nov 29 05:56:19 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:56:19 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:56:19 user nova-compute[75083]:     </rng>
Nov 29 05:56:19 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:56:19 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:56:19 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:56:19 user nova-compute[75083]:     </memballoon>
Nov 29 05:56:19 user nova-compute[75083]:   </devices>
Nov 29 05:56:19 user nova-compute[75083]: </domain>
Nov 29 05:56:19 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:56:19 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Instance destroyed successfully.
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] No VIF found with MAC fa:16:3e:eb:95:6e, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.network.neutron [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Successfully updated port: 27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Acquiring lock "refresh_cache-05f45fef-c8a7-41c1-a571-863307caca6a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Acquired lock "refresh_cache-05f45fef-c8a7-41c1-a571-863307caca6a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.network.neutron [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.network.neutron [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.compute.manager [req-21606187-5d03-455d-9f47-926558ba6ba0 req-bb2d55b0-20e4-4f9f-a813-55bf1cb4fafb service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Received event network-changed-27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.compute.manager [req-21606187-5d03-455d-9f47-926558ba6ba0 req-bb2d55b0-20e4-4f9f-a813-55bf1cb4fafb service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Refreshing instance network info cache due to event network-changed-27a46712-1675-4c3d-83bd-9131f899b487. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-21606187-5d03-455d-9f47-926558ba6ba0 req-bb2d55b0-20e4-4f9f-a813-55bf1cb4fafb service nova] Acquiring lock "refresh_cache-05f45fef-c8a7-41c1-a571-863307caca6a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.network.neutron [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Updating instance_info_cache with network_info: [{"id": "27a46712-1675-4c3d-83bd-9131f899b487", "address": "fa:16:3e:a8:58:c9", "network": {"id": "f41035e0-21bb-472a-959b-099a854e4629", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-994952120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b42598c48c05439f8059b4b8bf30b9dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a46712-16", "ovs_interfaceid": "27a46712-1675-4c3d-83bd-9131f899b487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Releasing lock "refresh_cache-05f45fef-c8a7-41c1-a571-863307caca6a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.compute.manager [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Instance network_info: |[{"id": "27a46712-1675-4c3d-83bd-9131f899b487", "address": "fa:16:3e:a8:58:c9", "network": {"id": "f41035e0-21bb-472a-959b-099a854e4629", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-994952120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b42598c48c05439f8059b4b8bf30b9dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a46712-16", "ovs_interfaceid": "27a46712-1675-4c3d-83bd-9131f899b487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-21606187-5d03-455d-9f47-926558ba6ba0 req-bb2d55b0-20e4-4f9f-a813-55bf1cb4fafb service nova] Acquired lock "refresh_cache-05f45fef-c8a7-41c1-a571-863307caca6a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.network.neutron [req-21606187-5d03-455d-9f47-926558ba6ba0 req-bb2d55b0-20e4-4f9f-a813-55bf1cb4fafb service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Refreshing network info cache for port 27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Start _get_guest_xml network_info=[{"id": "27a46712-1675-4c3d-83bd-9131f899b487", "address": "fa:16:3e:a8:58:c9", "network": {"id": "f41035e0-21bb-472a-959b-099a854e4629", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-994952120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b42598c48c05439f8059b4b8bf30b9dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a46712-16", "ovs_interfaceid": "27a46712-1675-4c3d-83bd-9131f899b487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:56:19 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:56:19 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1394586748',display_name='tempest-ServersNegativeTestJSON-server-1394586748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1394586748',id=24,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b42598c48c05439f8059b4b8bf30b9dd',ramdisk_id='',reservation_id='r-oz1j06l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1931576508',owner_user_name='tempest-ServersNegativeTestJSON-1931576508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:56:18Z,user_data=None,user_id='1e3cf798ed354d3ba55c0ff609e22d7f',uuid=05f45fef-c8a7-41c1-a571-863307caca6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27a46712-1675-4c3d-83bd-9131f899b487", "address": "fa:16:3e:a8:58:c9", "network": {"id": "f41035e0-21bb-472a-959b-099a854e4629", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-994952120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b42598c48c05439f8059b4b8bf30b9dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a46712-16", "ovs_interfaceid": "27a46712-1675-4c3d-83bd-9131f899b487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Converting VIF {"id": "27a46712-1675-4c3d-83bd-9131f899b487", "address": "fa:16:3e:a8:58:c9", "network": {"id": "f41035e0-21bb-472a-959b-099a854e4629", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-994952120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b42598c48c05439f8059b4b8bf30b9dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a46712-16", "ovs_interfaceid": "27a46712-1675-4c3d-83bd-9131f899b487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:58:c9,bridge_name='br-int',has_traffic_filtering=True,id=27a46712-1675-4c3d-83bd-9131f899b487,network=Network(f41035e0-21bb-472a-959b-099a854e4629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a46712-16') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.objects.instance [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lazy-loading 'pci_devices' on Instance uuid 05f45fef-c8a7-41c1-a571-863307caca6a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:56:19 user nova-compute[75083]:   <uuid>05f45fef-c8a7-41c1-a571-863307caca6a</uuid>
Nov 29 05:56:19 user nova-compute[75083]:   <name>instance-00000018</name>
Nov 29 05:56:19 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:56:19 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:56:19 user nova-compute[75083]:   <metadata>
Nov 29 05:56:19 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:56:19 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:56:19 user nova-compute[75083]:       <nova:name>tempest-ServersNegativeTestJSON-server-1394586748</nova:name>
Nov 29 05:56:19 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:56:19</nova:creationTime>
Nov 29 05:56:19 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:56:19 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:56:19 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:56:19 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:56:19 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:56:19 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:56:19 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:56:19 user nova-compute[75083]:       <nova:owner>
Nov 29 05:56:19 user nova-compute[75083]:         <nova:user uuid="1e3cf798ed354d3ba55c0ff609e22d7f">tempest-ServersNegativeTestJSON-1931576508-project-member</nova:user>
Nov 29 05:56:19 user nova-compute[75083]:         <nova:project uuid="b42598c48c05439f8059b4b8bf30b9dd">tempest-ServersNegativeTestJSON-1931576508</nova:project>
Nov 29 05:56:19 user nova-compute[75083]:       </nova:owner>
Nov 29 05:56:19 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:56:19 user nova-compute[75083]:       <nova:ports>
Nov 29 05:56:19 user nova-compute[75083]:         <nova:port uuid="27a46712-1675-4c3d-83bd-9131f899b487">
Nov 29 05:56:19 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 05:56:19 user nova-compute[75083]:         </nova:port>
Nov 29 05:56:19 user nova-compute[75083]:       </nova:ports>
Nov 29 05:56:19 user nova-compute[75083]:     </nova:instance>
Nov 29 05:56:19 user nova-compute[75083]:   </metadata>
Nov 29 05:56:19 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:56:19 user nova-compute[75083]:     <system>
Nov 29 05:56:19 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:56:19 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:56:19 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:56:19 user nova-compute[75083]:       <entry name="serial">05f45fef-c8a7-41c1-a571-863307caca6a</entry>
Nov 29 05:56:19 user nova-compute[75083]:       <entry name="uuid">05f45fef-c8a7-41c1-a571-863307caca6a</entry>
Nov 29 05:56:19 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:56:19 user nova-compute[75083]:     </system>
Nov 29 05:56:19 user nova-compute[75083]:   </sysinfo>
Nov 29 05:56:19 user nova-compute[75083]:   <os>
Nov 29 05:56:19 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:56:19 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:56:19 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:56:19 user nova-compute[75083]:   </os>
Nov 29 05:56:19 user nova-compute[75083]:   <features>
Nov 29 05:56:19 user nova-compute[75083]:     <acpi/>
Nov 29 05:56:19 user nova-compute[75083]:     <apic/>
Nov 29 05:56:19 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:56:19 user nova-compute[75083]:   </features>
Nov 29 05:56:19 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:56:19 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:56:19 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:56:19 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:56:19 user nova-compute[75083]:   </clock>
Nov 29 05:56:19 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:56:19 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:56:19 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:56:19 user nova-compute[75083]:   </cpu>
Nov 29 05:56:19 user nova-compute[75083]:   <devices>
Nov 29 05:56:19 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:56:19 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:56:19 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk"/>
Nov 29 05:56:19 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:56:19 user nova-compute[75083]:     </disk>
Nov 29 05:56:19 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:56:19 user nova-compute[75083]:       <mac address="fa:16:3e:a8:58:c9"/>
Nov 29 05:56:19 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:56:19 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:56:19 user nova-compute[75083]:       <target dev="tap27a46712-16"/>
Nov 29 05:56:19 user nova-compute[75083]:     </interface>
Nov 29 05:56:19 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:56:19 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/console.log" append="off"/>
Nov 29 05:56:19 user nova-compute[75083]:     </serial>
Nov 29 05:56:19 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:56:19 user nova-compute[75083]:     <video>
Nov 29 05:56:19 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:56:19 user nova-compute[75083]:     </video>
Nov 29 05:56:19 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:56:19 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:56:19 user nova-compute[75083]:     </rng>
Nov 29 05:56:19 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:56:19 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:56:19 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:56:19 user nova-compute[75083]:     </memballoon>
Nov 29 05:56:19 user nova-compute[75083]:   </devices>
Nov 29 05:56:19 user nova-compute[75083]: </domain>
Nov 29 05:56:19 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1394586748',display_name='tempest-ServersNegativeTestJSON-server-1394586748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1394586748',id=24,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b42598c48c05439f8059b4b8bf30b9dd',ramdisk_id='',reservation_id='r-oz1j06l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1931576508',owner_user_name='tempest-ServersNegativeTestJSON-1931576508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:56:18Z,user_data=None,user_id='1e3cf798ed354d3ba55c0ff609e22d7f',uuid=05f45fef-c8a7-41c1-a571-863307caca6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27a46712-1675-4c3d-83bd-9131f899b487", "address": "fa:16:3e:a8:58:c9", "network": {"id": "f41035e0-21bb-472a-959b-099a854e4629", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-994952120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b42598c48c05439f8059b4b8bf30b9dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a46712-16", "ovs_interfaceid": "27a46712-1675-4c3d-83bd-9131f899b487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Converting VIF {"id": "27a46712-1675-4c3d-83bd-9131f899b487", "address": "fa:16:3e:a8:58:c9", "network": {"id": "f41035e0-21bb-472a-959b-099a854e4629", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-994952120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b42598c48c05439f8059b4b8bf30b9dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a46712-16", "ovs_interfaceid": "27a46712-1675-4c3d-83bd-9131f899b487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:58:c9,bridge_name='br-int',has_traffic_filtering=True,id=27a46712-1675-4c3d-83bd-9131f899b487,network=Network(f41035e0-21bb-472a-959b-099a854e4629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a46712-16') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG os_vif [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:58:c9,bridge_name='br-int',has_traffic_filtering=True,id=27a46712-1675-4c3d-83bd-9131f899b487,network=Network(f41035e0-21bb-472a-959b-099a854e4629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a46712-16') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c4fc949-913e-544e-97f5-b3e5952e27bd', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27a46712-16, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27a46712-16, col_values=(('qos', UUID('4c6dae8f-dbf1-4ba8-ae9f-34cb3a273f2f')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27a46712-16, col_values=(('external_ids', {'iface-id': '27a46712-1675-4c3d-83bd-9131f899b487', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:58:c9', 'vm-uuid': '05f45fef-c8a7-41c1-a571-863307caca6a'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:56:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:20 user nova-compute[75083]: INFO os_vif [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:58:c9,bridge_name='br-int',has_traffic_filtering=True,id=27a46712-1675-4c3d-83bd-9131f899b487,network=Network(f41035e0-21bb-472a-959b-099a854e4629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a46712-16')
Nov 29 05:56:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:56:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] No VIF found with MAC fa:16:3e:a8:58:c9, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:56:20 user nova-compute[75083]: DEBUG nova.network.neutron [req-21606187-5d03-455d-9f47-926558ba6ba0 req-bb2d55b0-20e4-4f9f-a813-55bf1cb4fafb service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Updated VIF entry in instance network info cache for port 27a46712-1675-4c3d-83bd-9131f899b487. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:56:20 user nova-compute[75083]: DEBUG nova.network.neutron [req-21606187-5d03-455d-9f47-926558ba6ba0 req-bb2d55b0-20e4-4f9f-a813-55bf1cb4fafb service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Updating instance_info_cache with network_info: [{"id": "27a46712-1675-4c3d-83bd-9131f899b487", "address": "fa:16:3e:a8:58:c9", "network": {"id": "f41035e0-21bb-472a-959b-099a854e4629", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-994952120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b42598c48c05439f8059b4b8bf30b9dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a46712-16", "ovs_interfaceid": "27a46712-1675-4c3d-83bd-9131f899b487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:56:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-21606187-5d03-455d-9f47-926558ba6ba0 req-bb2d55b0-20e4-4f9f-a813-55bf1cb4fafb service nova] Releasing lock "refresh_cache-05f45fef-c8a7-41c1-a571-863307caca6a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:56:20 user nova-compute[75083]: DEBUG nova.compute.manager [req-8baa7a71-ac29-4715-b697-d0de662bf648 req-b22336e1-a774-4c48-be81-6b1951666797 service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Received event network-vif-plugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:56:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8baa7a71-ac29-4715-b697-d0de662bf648 req-b22336e1-a774-4c48-be81-6b1951666797 service nova] Acquiring lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8baa7a71-ac29-4715-b697-d0de662bf648 req-b22336e1-a774-4c48-be81-6b1951666797 service nova] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8baa7a71-ac29-4715-b697-d0de662bf648 req-b22336e1-a774-4c48-be81-6b1951666797 service nova] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:20 user nova-compute[75083]: DEBUG nova.compute.manager [req-8baa7a71-ac29-4715-b697-d0de662bf648 req-b22336e1-a774-4c48-be81-6b1951666797 service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] No waiting events found dispatching network-vif-plugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:56:20 user nova-compute[75083]: WARNING nova.compute.manager [req-8baa7a71-ac29-4715-b697-d0de662bf648 req-b22336e1-a774-4c48-be81-6b1951666797 service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Received unexpected event network-vif-plugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 for instance with vm_state active and task_state rescuing.
Nov 29 05:56:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:22 user nova-compute[75083]: DEBUG nova.compute.manager [req-993b7a7a-78d2-4ea3-875e-811abcf3a81d req-9a18624e-c511-4e98-9c1a-410b59cd51e4 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Received event network-vif-plugged-27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:56:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-993b7a7a-78d2-4ea3-875e-811abcf3a81d req-9a18624e-c511-4e98-9c1a-410b59cd51e4 service nova] Acquiring lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-993b7a7a-78d2-4ea3-875e-811abcf3a81d req-9a18624e-c511-4e98-9c1a-410b59cd51e4 service nova] Lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-993b7a7a-78d2-4ea3-875e-811abcf3a81d req-9a18624e-c511-4e98-9c1a-410b59cd51e4 service nova] Lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:22 user nova-compute[75083]: DEBUG nova.compute.manager [req-993b7a7a-78d2-4ea3-875e-811abcf3a81d req-9a18624e-c511-4e98-9c1a-410b59cd51e4 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] No waiting events found dispatching network-vif-plugged-27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:56:22 user nova-compute[75083]: WARNING nova.compute.manager [req-993b7a7a-78d2-4ea3-875e-811abcf3a81d req-9a18624e-c511-4e98-9c1a-410b59cd51e4 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Received unexpected event network-vif-plugged-27a46712-1675-4c3d-83bd-9131f899b487 for instance with vm_state building and task_state spawning.
Nov 29 05:56:22 user nova-compute[75083]: DEBUG nova.compute.manager [req-732d4ecf-4605-4177-85e0-9f4f3d60d4a7 req-b82f5a0c-d308-4faf-b21b-6cdc8c1f844b service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Received event network-vif-plugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:56:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-732d4ecf-4605-4177-85e0-9f4f3d60d4a7 req-b82f5a0c-d308-4faf-b21b-6cdc8c1f844b service nova] Acquiring lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-732d4ecf-4605-4177-85e0-9f4f3d60d4a7 req-b82f5a0c-d308-4faf-b21b-6cdc8c1f844b service nova] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-732d4ecf-4605-4177-85e0-9f4f3d60d4a7 req-b82f5a0c-d308-4faf-b21b-6cdc8c1f844b service nova] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:22 user nova-compute[75083]: DEBUG nova.compute.manager [req-732d4ecf-4605-4177-85e0-9f4f3d60d4a7 req-b82f5a0c-d308-4faf-b21b-6cdc8c1f844b service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] No waiting events found dispatching network-vif-plugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:56:22 user nova-compute[75083]: WARNING nova.compute.manager [req-732d4ecf-4605-4177-85e0-9f4f3d60d4a7 req-b82f5a0c-d308-4faf-b21b-6cdc8c1f844b service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Received unexpected event network-vif-plugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 for instance with vm_state active and task_state rescuing.
Nov 29 05:56:22 user nova-compute[75083]: DEBUG nova.compute.manager [req-732d4ecf-4605-4177-85e0-9f4f3d60d4a7 req-b82f5a0c-d308-4faf-b21b-6cdc8c1f844b service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Received event network-vif-plugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:56:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-732d4ecf-4605-4177-85e0-9f4f3d60d4a7 req-b82f5a0c-d308-4faf-b21b-6cdc8c1f844b service nova] Acquiring lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-732d4ecf-4605-4177-85e0-9f4f3d60d4a7 req-b82f5a0c-d308-4faf-b21b-6cdc8c1f844b service nova] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-732d4ecf-4605-4177-85e0-9f4f3d60d4a7 req-b82f5a0c-d308-4faf-b21b-6cdc8c1f844b service nova] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:22 user nova-compute[75083]: DEBUG nova.compute.manager [req-732d4ecf-4605-4177-85e0-9f4f3d60d4a7 req-b82f5a0c-d308-4faf-b21b-6cdc8c1f844b service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] No waiting events found dispatching network-vif-plugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:56:22 user nova-compute[75083]: WARNING nova.compute.manager [req-732d4ecf-4605-4177-85e0-9f4f3d60d4a7 req-b82f5a0c-d308-4faf-b21b-6cdc8c1f844b service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Received unexpected event network-vif-plugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 for instance with vm_state active and task_state rescuing.
Nov 29 05:56:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:24 user nova-compute[75083]: DEBUG nova.compute.manager [None req-1bd5bc64-6373-419e-a1b0-95082def0ba2 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:56:24 user nova-compute[75083]: DEBUG nova.compute.manager [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:56:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:56:24 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Instance spawned successfully.
Nov 29 05:56:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:56:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:56:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:56:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:56:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:56:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:56:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:56:24 user nova-compute[75083]: INFO nova.compute.manager [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Took 6.26 seconds to spawn the instance on the hypervisor.
Nov 29 05:56:24 user nova-compute[75083]: DEBUG nova.compute.manager [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:56:24 user nova-compute[75083]: DEBUG nova.compute.manager [req-50f5c26f-c3da-45c7-8789-fc61cdb8a519 req-03c7b54e-6812-47cc-a7dc-055baba9a547 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Received event network-vif-plugged-27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:56:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-50f5c26f-c3da-45c7-8789-fc61cdb8a519 req-03c7b54e-6812-47cc-a7dc-055baba9a547 service nova] Acquiring lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-50f5c26f-c3da-45c7-8789-fc61cdb8a519 req-03c7b54e-6812-47cc-a7dc-055baba9a547 service nova] Lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-50f5c26f-c3da-45c7-8789-fc61cdb8a519 req-03c7b54e-6812-47cc-a7dc-055baba9a547 service nova] Lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:24 user nova-compute[75083]: DEBUG nova.compute.manager [req-50f5c26f-c3da-45c7-8789-fc61cdb8a519 req-03c7b54e-6812-47cc-a7dc-055baba9a547 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] No waiting events found dispatching network-vif-plugged-27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:56:24 user nova-compute[75083]: WARNING nova.compute.manager [req-50f5c26f-c3da-45c7-8789-fc61cdb8a519 req-03c7b54e-6812-47cc-a7dc-055baba9a547 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Received unexpected event network-vif-plugged-27a46712-1675-4c3d-83bd-9131f899b487 for instance with vm_state building and task_state spawning.
Nov 29 05:56:24 user nova-compute[75083]: INFO nova.compute.manager [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Took 7.05 seconds to build instance.
Nov 29 05:56:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-56b7a8f7-2ab2-425e-8aa8-b5a6814fbae9 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "05f45fef-c8a7-41c1-a571-863307caca6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.164s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Acquiring lock "63e7d632-d185-4cac-97c9-eafddd90c259" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "63e7d632-d185-4cac-97c9-eafddd90c259" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Acquiring lock "63e7d632-d185-4cac-97c9-eafddd90c259-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "63e7d632-d185-4cac-97c9-eafddd90c259-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "63e7d632-d185-4cac-97c9-eafddd90c259-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:35 user nova-compute[75083]: INFO nova.compute.manager [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Terminating instance
Nov 29 05:56:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:56:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG nova.compute.manager [req-658bf0a7-f1b7-4273-9eb5-c92d845f97da req-44402c67-05ee-48bb-9c9b-2bbb9e89e8f3 service nova] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Received event network-vif-unplugged-80382d2b-73e7-43fc-9220-778fb3bf9e76 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-658bf0a7-f1b7-4273-9eb5-c92d845f97da req-44402c67-05ee-48bb-9c9b-2bbb9e89e8f3 service nova] Acquiring lock "63e7d632-d185-4cac-97c9-eafddd90c259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-658bf0a7-f1b7-4273-9eb5-c92d845f97da req-44402c67-05ee-48bb-9c9b-2bbb9e89e8f3 service nova] Lock "63e7d632-d185-4cac-97c9-eafddd90c259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-658bf0a7-f1b7-4273-9eb5-c92d845f97da req-44402c67-05ee-48bb-9c9b-2bbb9e89e8f3 service nova] Lock "63e7d632-d185-4cac-97c9-eafddd90c259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG nova.compute.manager [req-658bf0a7-f1b7-4273-9eb5-c92d845f97da req-44402c67-05ee-48bb-9c9b-2bbb9e89e8f3 service nova] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] No waiting events found dispatching network-vif-unplugged-80382d2b-73e7-43fc-9220-778fb3bf9e76 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG nova.compute.manager [req-658bf0a7-f1b7-4273-9eb5-c92d845f97da req-44402c67-05ee-48bb-9c9b-2bbb9e89e8f3 service nova] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Received event network-vif-unplugged-80382d2b-73e7-43fc-9220-778fb3bf9e76 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:56:36 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Instance destroyed successfully.
Nov 29 05:56:36 user nova-compute[75083]: DEBUG nova.objects.instance [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lazy-loading 'resources' on Instance uuid 63e7d632-d185-4cac-97c9-eafddd90c259 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:54:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1218597620',display_name='tempest-VolumesActionsTest-instance-1218597620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1218597620',id=22,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:54:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e9994d0f11f4f3d9d5efd77db3dd8b6',ramdisk_id='',reservation_id='r-jd5vw407',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-357770937',owner_user_name='tempest-VolumesActionsTest-357770937-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:54:51Z,user_data=None,user_id='203e79e1d87b4a74bfc9c665b6cef19d',uuid=63e7d632-d185-4cac-97c9-eafddd90c259,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80382d2b-73e7-43fc-9220-778fb3bf9e76", "address": "fa:16:3e:80:7b:de", "network": {"id": "39ff6758-4cee-4758-b66f-7a071d9c68e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-274780460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e9994d0f11f4f3d9d5efd77db3dd8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80382d2b-73", "ovs_interfaceid": "80382d2b-73e7-43fc-9220-778fb3bf9e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Converting VIF {"id": "80382d2b-73e7-43fc-9220-778fb3bf9e76", "address": "fa:16:3e:80:7b:de", "network": {"id": "39ff6758-4cee-4758-b66f-7a071d9c68e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-274780460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e9994d0f11f4f3d9d5efd77db3dd8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80382d2b-73", "ovs_interfaceid": "80382d2b-73e7-43fc-9220-778fb3bf9e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:7b:de,bridge_name='br-int',has_traffic_filtering=True,id=80382d2b-73e7-43fc-9220-778fb3bf9e76,network=Network(39ff6758-4cee-4758-b66f-7a071d9c68e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80382d2b-73') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG os_vif [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:7b:de,bridge_name='br-int',has_traffic_filtering=True,id=80382d2b-73e7-43fc-9220-778fb3bf9e76,network=Network(39ff6758-4cee-4758-b66f-7a071d9c68e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80382d2b-73') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80382d2b-73, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=751fde7c-8b3b-4470-82b2-ec7d50a254be) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:56:36 user nova-compute[75083]: INFO os_vif [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:7b:de,bridge_name='br-int',has_traffic_filtering=True,id=80382d2b-73e7-43fc-9220-778fb3bf9e76,network=Network(39ff6758-4cee-4758-b66f-7a071d9c68e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80382d2b-73')
Nov 29 05:56:36 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Deleting instance files /opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259_del
Nov 29 05:56:36 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Deletion of /opt/stack/data/nova/instances/63e7d632-d185-4cac-97c9-eafddd90c259_del complete
Nov 29 05:56:36 user nova-compute[75083]: INFO nova.compute.manager [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 29 05:56:36 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 05:56:36 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 05:56:37 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:56:37 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Took 0.68 seconds to deallocate network for instance.
Nov 29 05:56:37 user nova-compute[75083]: DEBUG nova.compute.manager [req-c48995f9-efae-448a-953e-03d3b08340d2 req-b1f56d5c-0bec-405a-b7e3-8253f037a1d8 service nova] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Received event network-vif-deleted-80382d2b-73e7-43fc-9220-778fb3bf9e76 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:56:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:37 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:56:37 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:56:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:37 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Deleted allocations for instance 63e7d632-d185-4cac-97c9-eafddd90c259
Nov 29 05:56:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-290940ac-c4b3-491b-b632-252e27423f17 tempest-VolumesActionsTest-357770937 tempest-VolumesActionsTest-357770937-project-member] Lock "63e7d632-d185-4cac-97c9-eafddd90c259" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.156s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-bf329258-a13c-44f4-8329-ea95d79b50c3 req-18ac2458-9976-4bc6-9fda-5f3bf7a71cb3 service nova] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Received event network-vif-plugged-80382d2b-73e7-43fc-9220-778fb3bf9e76 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:56:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bf329258-a13c-44f4-8329-ea95d79b50c3 req-18ac2458-9976-4bc6-9fda-5f3bf7a71cb3 service nova] Acquiring lock "63e7d632-d185-4cac-97c9-eafddd90c259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:56:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bf329258-a13c-44f4-8329-ea95d79b50c3 req-18ac2458-9976-4bc6-9fda-5f3bf7a71cb3 service nova] Lock "63e7d632-d185-4cac-97c9-eafddd90c259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:56:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bf329258-a13c-44f4-8329-ea95d79b50c3 req-18ac2458-9976-4bc6-9fda-5f3bf7a71cb3 service nova] Lock "63e7d632-d185-4cac-97c9-eafddd90c259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:56:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-bf329258-a13c-44f4-8329-ea95d79b50c3 req-18ac2458-9976-4bc6-9fda-5f3bf7a71cb3 service nova] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] No waiting events found dispatching network-vif-plugged-80382d2b-73e7-43fc-9220-778fb3bf9e76 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:56:38 user nova-compute[75083]: WARNING nova.compute.manager [req-bf329258-a13c-44f4-8329-ea95d79b50c3 req-18ac2458-9976-4bc6-9fda-5f3bf7a71cb3 service nova] [instance: 63e7d632-d185-4cac-97c9-eafddd90c259] Received unexpected event network-vif-plugged-80382d2b-73e7-43fc-9220-778fb3bf9e76 for instance with vm_state deleted and task_state None.
Nov 29 05:56:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:56:58 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:57:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:57:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 05:57:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:57:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 05:57:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 05:57:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 05:57:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:01 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:57:01 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:57:01 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75083) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 05:57:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:02 user nova-compute[75083]: DEBUG nova.network.neutron [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Port 388c9969-42dc-4e34-8fb8-c2399687751d binding to destination host user is already ACTIVE {{(pid=75083) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 05:57:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:57:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquired lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:57:02 user nova-compute[75083]: DEBUG nova.network.neutron [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:57:03 user nova-compute[75083]: DEBUG nova.network.neutron [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Updating instance_info_cache with network_info: [{"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:57:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Releasing lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:57:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Creating tmpfile /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/tmpa08gf8_u to verify with other compute node that the instance is on the same shared storage. {{(pid=75083) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 29 05:57:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:03 user nova-compute[75083]: DEBUG nova.compute.manager [req-a7b21d31-46ee-4f89-9ae8-d72f6f083ab2 req-95514842-6cc0-4654-abec-61f90b80cb0d service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received event network-vif-unplugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a7b21d31-46ee-4f89-9ae8-d72f6f083ab2 req-95514842-6cc0-4654-abec-61f90b80cb0d service nova] Acquiring lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a7b21d31-46ee-4f89-9ae8-d72f6f083ab2 req-95514842-6cc0-4654-abec-61f90b80cb0d service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a7b21d31-46ee-4f89-9ae8-d72f6f083ab2 req-95514842-6cc0-4654-abec-61f90b80cb0d service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:03 user nova-compute[75083]: DEBUG nova.compute.manager [req-a7b21d31-46ee-4f89-9ae8-d72f6f083ab2 req-95514842-6cc0-4654-abec-61f90b80cb0d service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] No waiting events found dispatching network-vif-unplugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:57:03 user nova-compute[75083]: WARNING nova.compute.manager [req-a7b21d31-46ee-4f89-9ae8-d72f6f083ab2 req-95514842-6cc0-4654-abec-61f90b80cb0d service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received unexpected event network-vif-unplugged-388c9969-42dc-4e34-8fb8-c2399687751d for instance with vm_state resized and task_state resize_reverting.
Nov 29 05:57:04 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Instance destroyed successfully.
Nov 29 05:57:04 user nova-compute[75083]: DEBUG nova.objects.instance [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lazy-loading 'resources' on Instance uuid fb8244c4-f2a7-4ad8-a210-0f62c165a4dc {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:51:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1765064185',display_name='tempest-ServerActionsTestOtherB-server-1765064185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1765064185',id=15,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKfQt22BKdk3qqBMkdZDrlzUPc5OzBSJvBUhpD5lx0G7UqWh0HRdHS4+8i15ioAIjPFv14fiTBp00VBH9cOAzOvFWtO61YBHreoMNXT+V9qZ3bdKSP6OX3ggUHyDT/bOg==',key_name='tempest-keypair-1198752933',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:55:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41fbbebd414945beb2130f46013125d8',ramdisk_id='',reservation_id='r-349fa5rg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1953829293',owner_user_name='tempest-ServerActionsTestOtherB-1953829293-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:55:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7f8a0e94feb47bb875ab4d7f1f2a2a1',uuid=fb8244c4-f2a7-4ad8-a210-0f62c165a4dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Converting VIF {"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_vif [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap388c9969-42, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05b19e1e-a0c0-49a1-a3fd-04b4f182213c) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:57:04 user nova-compute[75083]: INFO os_vif [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42')
Nov 29 05:57:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNxDFkJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:57:04 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ba9f00-15a5-4bbe-b6c2-2ab5fc64f206]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:57:04 user nova-compute[75083]: No targets found.
Nov 29 05:57:04 user nova-compute[75083]: iSNS:
Nov 29 05:57:04 user nova-compute[75083]: No targets found.
Nov 29 05:57:04 user nova-compute[75083]: STATIC:
Nov 29 05:57:04 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256
Nov 29 05:57:04 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:57:04 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:57:04 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1
Nov 29 05:57:04 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:57:04 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:57:04 user nova-compute[75083]: FIRMWARE:
Nov 29 05:57:04 user nova-compute[75083]: No targets found.
Nov 29 05:57:04 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:57:04 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:57:04 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a71cfdc-ceef-4c48-a934-06469ee0ca94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c172f932-5d49-4aed-8da7-847c25a57f4c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:57:04 user nova-compute[75083]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:57:04 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:57:04 user nova-compute[75083]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:57:04 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b82d16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9e4f41-452a-4858-8832-831e6441d454]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[def56c1e-38a8-4516-bf27-75baaef016a4]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[77418050-d0d3-4772-9967-45a479167a28]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[89468ee4-0755-42bd-9815-9a77bd546d20]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb088b9-40bf-4af6-9da5-eaa5ac7c443d]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca9848a-7b34-4d83-8436-cb28f888816f]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260]
Nov 29 05:57:04 user nova-compute[75083]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260] successful.
Nov 29 05:57:04 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6f8c99-fd49-4bd7-ab18-c799b5246585]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] <== disconnect_volume: return (297ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "c1baf96b-be32-42f1-85a8-9b2321226199" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "c1baf96b-be32-42f1-85a8-9b2321226199" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG nova.compute.manager [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:04 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:57:04 user nova-compute[75083]: INFO nova.compute.claims [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Claim successful on node user
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Refreshing inventories for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Updating ProviderTree inventory for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Updating inventory in ProviderTree for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Refreshing aggregate associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, aggregates: None {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Refreshing trait associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, traits: HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.compute.manager [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.123s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.objects.instance [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lazy-loading 'migration_context' on Instance uuid fb8244c4-f2a7-4ad8-a210-0f62c165a4dc {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.objects.base [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Object Instance<fb8244c4-f2a7-4ad8-a210-0f62c165a4dc> lazy-loaded attributes: resources,migration_context {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.compute.manager [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.network.neutron [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:57:05 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:57:05 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.compute.manager [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.policy [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25f2d92aba5c4069b94b8a5cd8b72a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c1cb7a503b446f945f12b3b998035b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.compute.manager [req-7ad2d0e8-2729-4878-8456-88a881a28060 req-0155fb90-8579-4fca-90cc-442e4fda6da5 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received event network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7ad2d0e8-2729-4878-8456-88a881a28060 req-0155fb90-8579-4fca-90cc-442e4fda6da5 service nova] Acquiring lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7ad2d0e8-2729-4878-8456-88a881a28060 req-0155fb90-8579-4fca-90cc-442e4fda6da5 service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7ad2d0e8-2729-4878-8456-88a881a28060 req-0155fb90-8579-4fca-90cc-442e4fda6da5 service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.compute.manager [req-7ad2d0e8-2729-4878-8456-88a881a28060 req-0155fb90-8579-4fca-90cc-442e4fda6da5 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] No waiting events found dispatching network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:57:05 user nova-compute[75083]: WARNING nova.compute.manager [req-7ad2d0e8-2729-4878-8456-88a881a28060 req-0155fb90-8579-4fca-90cc-442e4fda6da5 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received unexpected event network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d for instance with vm_state resized and task_state resize_reverting.
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.compute.manager [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:57:05 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Creating image(s)
Nov 29 05:57:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "/opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "/opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.500s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.416s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk 1073741824" returned: 0 in 0.053s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:06 user nova-compute[75083]: INFO nova.compute.manager [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Swapping old allocation on dict_keys(['8aaf783a-f9f1-4872-9f20-91f33ff1e95c']) held by migration cf5b552d-fb41-4bc3-9033-f6622a9b82a4 for instance
Nov 29 05:57:06 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Overwriting current allocation {'allocations': {'8aaf783a-f9f1-4872-9f20-91f33ff1e95c': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 31}}, 'project_id': '41fbbebd414945beb2130f46013125d8', 'user_id': 'd7f8a0e94feb47bb875ab4d7f1f2a2a1', 'consumer_generation': 1} on consumer fb8244c4-f2a7-4ad8-a210-0f62c165a4dc {{(pid=75083) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.198s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Cannot resize image /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Ensure instance console log exists: /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquired lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG nova.network.neutron [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG nova.network.neutron [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Successfully created port: 1331cb58-30d1-4578-9a05-6a70116d925b {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG nova.network.neutron [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Updating instance_info_cache with network_info: [{"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Releasing lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG os_brick.utils [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5969f46e-5d09-4bf8-afaf-f274f2bd10bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19779c9-6dae-4d8e-941d-f80b1aba30cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4043c3c8-5e6a-4be5-b142-e07903fe0a0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5ff473-b7bb-4f53-9b1a-deae424382bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:57:07 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a39428-bfb9-4ca0-86bd-d7b27839eb05]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG os_brick.utils [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG nova.network.neutron [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Successfully updated port: 1331cb58-30d1-4578-9a05-6a70116d925b {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "refresh_cache-c1baf96b-be32-42f1-85a8-9b2321226199" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquired lock "refresh_cache-c1baf96b-be32-42f1-85a8-9b2321226199" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG nova.network.neutron [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG nova.compute.manager [req-3a96922f-ae1d-4190-991c-dd728ccdb364 req-f54235fd-f6fc-48e2-a8f6-187652bb994b service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Received event network-changed-1331cb58-30d1-4578-9a05-6a70116d925b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG nova.compute.manager [req-3a96922f-ae1d-4190-991c-dd728ccdb364 req-f54235fd-f6fc-48e2-a8f6-187652bb994b service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Refreshing instance network info cache due to event network-changed-1331cb58-30d1-4578-9a05-6a70116d925b. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3a96922f-ae1d-4190-991c-dd728ccdb364 req-f54235fd-f6fc-48e2-a8f6-187652bb994b service nova] Acquiring lock "refresh_cache-c1baf96b-be32-42f1-85a8-9b2321226199" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG nova.network.neutron [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.network.neutron [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Updating instance_info_cache with network_info: [{"id": "1331cb58-30d1-4578-9a05-6a70116d925b", "address": "fa:16:3e:50:1a:f0", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1331cb58-30", "ovs_interfaceid": "1331cb58-30d1-4578-9a05-6a70116d925b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Releasing lock "refresh_cache-c1baf96b-be32-42f1-85a8-9b2321226199" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.compute.manager [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Instance network_info: |[{"id": "1331cb58-30d1-4578-9a05-6a70116d925b", "address": "fa:16:3e:50:1a:f0", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1331cb58-30", "ovs_interfaceid": "1331cb58-30d1-4578-9a05-6a70116d925b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3a96922f-ae1d-4190-991c-dd728ccdb364 req-f54235fd-f6fc-48e2-a8f6-187652bb994b service nova] Acquired lock "refresh_cache-c1baf96b-be32-42f1-85a8-9b2321226199" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.network.neutron [req-3a96922f-ae1d-4190-991c-dd728ccdb364 req-f54235fd-f6fc-48e2-a8f6-187652bb994b service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Refreshing network info cache for port 1331cb58-30d1-4578-9a05-6a70116d925b {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Start _get_guest_xml network_info=[{"id": "1331cb58-30d1-4578-9a05-6a70116d925b", "address": "fa:16:3e:50:1a:f0", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1331cb58-30", "ovs_interfaceid": "1331cb58-30d1-4578-9a05-6a70116d925b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:57:08 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:57:08 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:57:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:57:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-69525671',display_name='tempest-AttachVolumeTestJSON-server-69525671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-69525671',id=25,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdd7mwKfLnZjGbw3RYJJKQCJsLnI6mEQqeroY/tHA6GJ8pJGdkqdp+y4+lrDHtk10ALLpz5HMQx8fEmNTm7OsnQjfiHr2zLGlYlg0kbJFZ6KUgH7F3y+DqjIm2iou1wLg==',key_name='tempest-keypair-1400711518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4c1cb7a503b446f945f12b3b998035b',ramdisk_id='',reservation_id='r-y5j4p270',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1539985865',owner_user_name='tempest-AttachVolumeTestJSON-1539985865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:57:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f2d92aba5c4069b94b8a5cd8b72a46',uuid=c1baf96b-be32-42f1-85a8-9b2321226199,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1331cb58-30d1-4578-9a05-6a70116d925b", "address": "fa:16:3e:50:1a:f0", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1331cb58-30", "ovs_interfaceid": "1331cb58-30d1-4578-9a05-6a70116d925b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converting VIF {"id": "1331cb58-30d1-4578-9a05-6a70116d925b", "address": "fa:16:3e:50:1a:f0", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1331cb58-30", "ovs_interfaceid": "1331cb58-30d1-4578-9a05-6a70116d925b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:1a:f0,bridge_name='br-int',has_traffic_filtering=True,id=1331cb58-30d1-4578-9a05-6a70116d925b,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1331cb58-30') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.objects.instance [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'pci_devices' on Instance uuid c1baf96b-be32-42f1-85a8-9b2321226199 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:57:08 user nova-compute[75083]:   <uuid>c1baf96b-be32-42f1-85a8-9b2321226199</uuid>
Nov 29 05:57:08 user nova-compute[75083]:   <name>instance-00000019</name>
Nov 29 05:57:08 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:57:08 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:57:08 user nova-compute[75083]:   <metadata>
Nov 29 05:57:08 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:57:08 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:57:08 user nova-compute[75083]:       <nova:name>tempest-AttachVolumeTestJSON-server-69525671</nova:name>
Nov 29 05:57:08 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:57:08</nova:creationTime>
Nov 29 05:57:08 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:57:08 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:57:08 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:57:08 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:57:08 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:57:08 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:57:08 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:57:08 user nova-compute[75083]:       <nova:owner>
Nov 29 05:57:08 user nova-compute[75083]:         <nova:user uuid="25f2d92aba5c4069b94b8a5cd8b72a46">tempest-AttachVolumeTestJSON-1539985865-project-member</nova:user>
Nov 29 05:57:08 user nova-compute[75083]:         <nova:project uuid="c4c1cb7a503b446f945f12b3b998035b">tempest-AttachVolumeTestJSON-1539985865</nova:project>
Nov 29 05:57:08 user nova-compute[75083]:       </nova:owner>
Nov 29 05:57:08 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:57:08 user nova-compute[75083]:       <nova:ports>
Nov 29 05:57:08 user nova-compute[75083]:         <nova:port uuid="1331cb58-30d1-4578-9a05-6a70116d925b">
Nov 29 05:57:08 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 05:57:08 user nova-compute[75083]:         </nova:port>
Nov 29 05:57:08 user nova-compute[75083]:       </nova:ports>
Nov 29 05:57:08 user nova-compute[75083]:     </nova:instance>
Nov 29 05:57:08 user nova-compute[75083]:   </metadata>
Nov 29 05:57:08 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:57:08 user nova-compute[75083]:     <system>
Nov 29 05:57:08 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:57:08 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:57:08 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:57:08 user nova-compute[75083]:       <entry name="serial">c1baf96b-be32-42f1-85a8-9b2321226199</entry>
Nov 29 05:57:08 user nova-compute[75083]:       <entry name="uuid">c1baf96b-be32-42f1-85a8-9b2321226199</entry>
Nov 29 05:57:08 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:57:08 user nova-compute[75083]:     </system>
Nov 29 05:57:08 user nova-compute[75083]:   </sysinfo>
Nov 29 05:57:08 user nova-compute[75083]:   <os>
Nov 29 05:57:08 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:57:08 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:57:08 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:57:08 user nova-compute[75083]:   </os>
Nov 29 05:57:08 user nova-compute[75083]:   <features>
Nov 29 05:57:08 user nova-compute[75083]:     <acpi/>
Nov 29 05:57:08 user nova-compute[75083]:     <apic/>
Nov 29 05:57:08 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:57:08 user nova-compute[75083]:   </features>
Nov 29 05:57:08 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:57:08 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:57:08 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:57:08 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:57:08 user nova-compute[75083]:   </clock>
Nov 29 05:57:08 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:57:08 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:57:08 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:57:08 user nova-compute[75083]:   </cpu>
Nov 29 05:57:08 user nova-compute[75083]:   <devices>
Nov 29 05:57:08 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:57:08 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:57:08 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk"/>
Nov 29 05:57:08 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:57:08 user nova-compute[75083]:     </disk>
Nov 29 05:57:08 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:57:08 user nova-compute[75083]:       <mac address="fa:16:3e:50:1a:f0"/>
Nov 29 05:57:08 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:57:08 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:57:08 user nova-compute[75083]:       <target dev="tap1331cb58-30"/>
Nov 29 05:57:08 user nova-compute[75083]:     </interface>
Nov 29 05:57:08 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:57:08 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/console.log" append="off"/>
Nov 29 05:57:08 user nova-compute[75083]:     </serial>
Nov 29 05:57:08 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:57:08 user nova-compute[75083]:     <video>
Nov 29 05:57:08 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:57:08 user nova-compute[75083]:     </video>
Nov 29 05:57:08 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:57:08 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:57:08 user nova-compute[75083]:     </rng>
Nov 29 05:57:08 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:57:08 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:57:08 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:57:08 user nova-compute[75083]:     </memballoon>
Nov 29 05:57:08 user nova-compute[75083]:   </devices>
Nov 29 05:57:08 user nova-compute[75083]: </domain>
Nov 29 05:57:08 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:57:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-69525671',display_name='tempest-AttachVolumeTestJSON-server-69525671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-69525671',id=25,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdd7mwKfLnZjGbw3RYJJKQCJsLnI6mEQqeroY/tHA6GJ8pJGdkqdp+y4+lrDHtk10ALLpz5HMQx8fEmNTm7OsnQjfiHr2zLGlYlg0kbJFZ6KUgH7F3y+DqjIm2iou1wLg==',key_name='tempest-keypair-1400711518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4c1cb7a503b446f945f12b3b998035b',ramdisk_id='',reservation_id='r-y5j4p270',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1539985865',owner_user_name='tempest-AttachVolumeTestJSON-1539985865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:57:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f2d92aba5c4069b94b8a5cd8b72a46',uuid=c1baf96b-be32-42f1-85a8-9b2321226199,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1331cb58-30d1-4578-9a05-6a70116d925b", "address": "fa:16:3e:50:1a:f0", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1331cb58-30", "ovs_interfaceid": "1331cb58-30d1-4578-9a05-6a70116d925b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converting VIF {"id": "1331cb58-30d1-4578-9a05-6a70116d925b", "address": "fa:16:3e:50:1a:f0", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1331cb58-30", "ovs_interfaceid": "1331cb58-30d1-4578-9a05-6a70116d925b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:1a:f0,bridge_name='br-int',has_traffic_filtering=True,id=1331cb58-30d1-4578-9a05-6a70116d925b,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1331cb58-30') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG os_vif [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:1a:f0,bridge_name='br-int',has_traffic_filtering=True,id=1331cb58-30d1-4578-9a05-6a70116d925b,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1331cb58-30') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42afef41-d595-51a0-a0c4-de3943aa0416', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1331cb58-30, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1331cb58-30, col_values=(('qos', UUID('6964abdf-ab99-4f0e-a11a-daeac27c90d3')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1331cb58-30, col_values=(('external_ids', {'iface-id': '1331cb58-30d1-4578-9a05-6a70116d925b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:1a:f0', 'vm-uuid': 'c1baf96b-be32-42f1-85a8-9b2321226199'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:08 user nova-compute[75083]: INFO os_vif [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:1a:f0,bridge_name='br-int',has_traffic_filtering=True,id=1331cb58-30d1-4578-9a05-6a70116d925b,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1331cb58-30')
Nov 29 05:57:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] No VIF found with MAC fa:16:3e:50:1a:f0, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.network.neutron [req-3a96922f-ae1d-4190-991c-dd728ccdb364 req-f54235fd-f6fc-48e2-a8f6-187652bb994b service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Updated VIF entry in instance network info cache for port 1331cb58-30d1-4578-9a05-6a70116d925b. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.network.neutron [req-3a96922f-ae1d-4190-991c-dd728ccdb364 req-f54235fd-f6fc-48e2-a8f6-187652bb994b service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Updating instance_info_cache with network_info: [{"id": "1331cb58-30d1-4578-9a05-6a70116d925b", "address": "fa:16:3e:50:1a:f0", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1331cb58-30", "ovs_interfaceid": "1331cb58-30d1-4578-9a05-6a70116d925b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3a96922f-ae1d-4190-991c-dd728ccdb364 req-f54235fd-f6fc-48e2-a8f6-187652bb994b service nova] Releasing lock "refresh_cache-c1baf96b-be32-42f1-85a8-9b2321226199" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:57:09 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:57:09 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:57:09 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=7813MB free_disk=25.282745361328125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 161c6455-90ce-4c40-a33e-7f582989135d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4435ed78-e35f-4859-8a4f-9920815d968a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a34d9d98-be73-4d52-85f0-83e48f60bc12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fb8244c4-f2a7-4ad8-a210-0f62c165a4dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance cb63619b-6d75-49d0-80ef-d98aa21b7d4a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance d206e7ab-eb5b-4026-a1ea-4b34837b0fed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 05f45fef-c8a7-41c1-a571-863307caca6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance c1baf96b-be32-42f1-85a8-9b2321226199 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] There are 0 instances to clean {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-55ae4242-9592-4efa-9176-05abfb679e31 req-14f393a7-7b22-43b5-9a1b-93e4afb51754 service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Received event network-vif-plugged-1331cb58-30d1-4578-9a05-6a70116d925b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-55ae4242-9592-4efa-9176-05abfb679e31 req-14f393a7-7b22-43b5-9a1b-93e4afb51754 service nova] Acquiring lock "c1baf96b-be32-42f1-85a8-9b2321226199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-55ae4242-9592-4efa-9176-05abfb679e31 req-14f393a7-7b22-43b5-9a1b-93e4afb51754 service nova] Lock "c1baf96b-be32-42f1-85a8-9b2321226199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-55ae4242-9592-4efa-9176-05abfb679e31 req-14f393a7-7b22-43b5-9a1b-93e4afb51754 service nova] Lock "c1baf96b-be32-42f1-85a8-9b2321226199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-55ae4242-9592-4efa-9176-05abfb679e31 req-14f393a7-7b22-43b5-9a1b-93e4afb51754 service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] No waiting events found dispatching network-vif-plugged-1331cb58-30d1-4578-9a05-6a70116d925b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:57:10 user nova-compute[75083]: WARNING nova.compute.manager [req-55ae4242-9592-4efa-9176-05abfb679e31 req-14f393a7-7b22-43b5-9a1b-93e4afb51754 service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Received unexpected event network-vif-plugged-1331cb58-30d1-4578-9a05-6a70116d925b for instance with vm_state building and task_state spawning.
Nov 29 05:57:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:10 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:57:10 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 05:57:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:57:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:57:11 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 05:57:11 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Updating instance_info_cache with network_info: [{"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:57:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:57:11 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 05:57:11 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:57:11 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:57:11 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:57:12 user nova-compute[75083]: DEBUG nova.compute.manager [req-d0a6f5e4-5af3-434b-96d8-a7c2dab8229b req-3c3230c7-b004-4e85-beb4-bc417faf130f service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Received event network-vif-plugged-1331cb58-30d1-4578-9a05-6a70116d925b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d0a6f5e4-5af3-434b-96d8-a7c2dab8229b req-3c3230c7-b004-4e85-beb4-bc417faf130f service nova] Acquiring lock "c1baf96b-be32-42f1-85a8-9b2321226199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d0a6f5e4-5af3-434b-96d8-a7c2dab8229b req-3c3230c7-b004-4e85-beb4-bc417faf130f service nova] Lock "c1baf96b-be32-42f1-85a8-9b2321226199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d0a6f5e4-5af3-434b-96d8-a7c2dab8229b req-3c3230c7-b004-4e85-beb4-bc417faf130f service nova] Lock "c1baf96b-be32-42f1-85a8-9b2321226199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:12 user nova-compute[75083]: DEBUG nova.compute.manager [req-d0a6f5e4-5af3-434b-96d8-a7c2dab8229b req-3c3230c7-b004-4e85-beb4-bc417faf130f service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] No waiting events found dispatching network-vif-plugged-1331cb58-30d1-4578-9a05-6a70116d925b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:57:12 user nova-compute[75083]: WARNING nova.compute.manager [req-d0a6f5e4-5af3-434b-96d8-a7c2dab8229b req-3c3230c7-b004-4e85-beb4-bc417faf130f service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Received unexpected event network-vif-plugged-1331cb58-30d1-4578-9a05-6a70116d925b for instance with vm_state building and task_state spawning.
Nov 29 05:57:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:57:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:57:12 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Instance spawned successfully.
Nov 29 05:57:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:57:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:57:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:57:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:57:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:57:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:57:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:57:12 user nova-compute[75083]: INFO nova.compute.manager [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Took 6.64 seconds to spawn the instance on the hypervisor.
Nov 29 05:57:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:57:12 user nova-compute[75083]: INFO nova.compute.manager [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Took 7.62 seconds to build instance.
Nov 29 05:57:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-518e6454-7dfb-432f-807b-a0af2e9936b3 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "c1baf96b-be32-42f1-85a8-9b2321226199" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.715s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Starting finish_revert_migration {{(pid=75083) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Start _get_guest_xml network_info=[{"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'b38a80d9-0e94-4528-80e6-4e4afe97103f', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNxDFkJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'fb8244c4-f2a7-4ad8-a210-0f62c165a4dc', 'attached_at': '2023-11-29T05:57:15.000000', 'detached_at': '', 'volume_id': 'ed1112c6-7998-4bf8-b679-c13dddd615a1', 'serial': 'ed1112c6-7998-4bf8-b679-c13dddd615a1'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:57:15 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:57:15 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:57:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG nova.objects.instance [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lazy-loading 'vcpu_model' on Instance uuid fb8244c4-f2a7-4ad8-a210-0f62c165a4dc {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNxDFkJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:57:15 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:57:15 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:57:15 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e457f8f-ec33-4008-8fa3-08bb717e205a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:57:15 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bc6e36-fb6f-4df0-9d57-5560b062bd5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1] added
Nov 29 05:57:15 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[64075ad5-e422-4b41-9390-94cc64f417c0]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.045s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa0238f-eed3-4575-a9de-9d22d15ad2b1]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNxDFkJH {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNxDFkJH" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8beb86-d411-4ff1-bcee-f30f6e100f7c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rNxDFkJH'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[117b7fae-a996-4c5f-b14e-f094a7f96625]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcd94da-01da-4e0f-bf8a-1a53565573f3]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:57:15 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:57:15 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[285590dc-2670-4e63-9c0c-9c4a3f99d135]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260]
Nov 29 05:57:15 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260] successful.
Nov 29 05:57:15 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3170c08a-fade-420f-9714-4eb83b2552fb]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[10503e86-bbd2-476f-978c-78356006f0fe]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:57:15 user nova-compute[75083]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:57:15 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:57:15 user nova-compute[75083]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:57:15 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfd98bc-f8f9-44e3-86c4-54fe1c69f048]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNxDFkJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:57:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23863643362326566', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863643362326566', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:51:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1765064185',display_name='tempest-ServerActionsTestOtherB-server-1765064185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1765064185',id=15,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKfQt22BKdk3qqBMkdZDrlzUPc5OzBSJvBUhpD5lx0G7UqWh0HRdHS4+8i15ioAIjPFv14fiTBp00VBH9cOAzOvFWtO61YBHreoMNXT+V9qZ3bdKSP6OX3ggUHyDT/bOg==',key_name='tempest-keypair-1198752933',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:55:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='41fbbebd414945beb2130f46013125d8',ramdisk_id='',reservation_id='r-349fa5rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1953829293',owner_user_name='tempest-ServerActionsTestOtherB-1953829293-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:57:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7f8a0e94feb47bb875ab4d7f1f2a2a1',uuid=fb8244c4-f2a7-4ad8-a210-0f62c165a4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Converting VIF {"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:57:16 user nova-compute[75083]:   <uuid>fb8244c4-f2a7-4ad8-a210-0f62c165a4dc</uuid>
Nov 29 05:57:16 user nova-compute[75083]:   <name>instance-0000000f</name>
Nov 29 05:57:16 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:57:16 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:57:16 user nova-compute[75083]:   <metadata>
Nov 29 05:57:16 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:57:16 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:57:16 user nova-compute[75083]:       <nova:name>tempest-ServerActionsTestOtherB-server-1765064185</nova:name>
Nov 29 05:57:16 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:57:15</nova:creationTime>
Nov 29 05:57:16 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:57:16 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:57:16 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:57:16 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:57:16 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:57:16 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:57:16 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:57:16 user nova-compute[75083]:       <nova:owner>
Nov 29 05:57:16 user nova-compute[75083]:         <nova:user uuid="d7f8a0e94feb47bb875ab4d7f1f2a2a1">tempest-ServerActionsTestOtherB-1953829293-project-member</nova:user>
Nov 29 05:57:16 user nova-compute[75083]:         <nova:project uuid="41fbbebd414945beb2130f46013125d8">tempest-ServerActionsTestOtherB-1953829293</nova:project>
Nov 29 05:57:16 user nova-compute[75083]:       </nova:owner>
Nov 29 05:57:16 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:57:16 user nova-compute[75083]:       <nova:ports>
Nov 29 05:57:16 user nova-compute[75083]:         <nova:port uuid="388c9969-42dc-4e34-8fb8-c2399687751d">
Nov 29 05:57:16 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 05:57:16 user nova-compute[75083]:         </nova:port>
Nov 29 05:57:16 user nova-compute[75083]:       </nova:ports>
Nov 29 05:57:16 user nova-compute[75083]:     </nova:instance>
Nov 29 05:57:16 user nova-compute[75083]:   </metadata>
Nov 29 05:57:16 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:57:16 user nova-compute[75083]:     <system>
Nov 29 05:57:16 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:57:16 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:57:16 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:57:16 user nova-compute[75083]:       <entry name="serial">fb8244c4-f2a7-4ad8-a210-0f62c165a4dc</entry>
Nov 29 05:57:16 user nova-compute[75083]:       <entry name="uuid">fb8244c4-f2a7-4ad8-a210-0f62c165a4dc</entry>
Nov 29 05:57:16 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:57:16 user nova-compute[75083]:     </system>
Nov 29 05:57:16 user nova-compute[75083]:   </sysinfo>
Nov 29 05:57:16 user nova-compute[75083]:   <os>
Nov 29 05:57:16 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:57:16 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:57:16 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:57:16 user nova-compute[75083]:   </os>
Nov 29 05:57:16 user nova-compute[75083]:   <features>
Nov 29 05:57:16 user nova-compute[75083]:     <acpi/>
Nov 29 05:57:16 user nova-compute[75083]:     <apic/>
Nov 29 05:57:16 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:57:16 user nova-compute[75083]:   </features>
Nov 29 05:57:16 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:57:16 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:57:16 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:57:16 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:57:16 user nova-compute[75083]:   </clock>
Nov 29 05:57:16 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:57:16 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:57:16 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:57:16 user nova-compute[75083]:   </cpu>
Nov 29 05:57:16 user nova-compute[75083]:   <devices>
Nov 29 05:57:16 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:57:16 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:57:16 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk"/>
Nov 29 05:57:16 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:57:16 user nova-compute[75083]:     </disk>
Nov 29 05:57:16 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 05:57:16 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:57:16 user nova-compute[75083]:       <source dev="/dev/sdb"/>
Nov 29 05:57:16 user nova-compute[75083]:       <target dev="vdb" bus="virtio"/>
Nov 29 05:57:16 user nova-compute[75083]:       <serial>ed1112c6-7998-4bf8-b679-c13dddd615a1</serial>
Nov 29 05:57:16 user nova-compute[75083]:     </disk>
Nov 29 05:57:16 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:57:16 user nova-compute[75083]:       <mac address="fa:16:3e:8c:af:fc"/>
Nov 29 05:57:16 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:57:16 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:57:16 user nova-compute[75083]:       <target dev="tap388c9969-42"/>
Nov 29 05:57:16 user nova-compute[75083]:     </interface>
Nov 29 05:57:16 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:57:16 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/console.log" append="off"/>
Nov 29 05:57:16 user nova-compute[75083]:     </serial>
Nov 29 05:57:16 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:57:16 user nova-compute[75083]:     <video>
Nov 29 05:57:16 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:57:16 user nova-compute[75083]:     </video>
Nov 29 05:57:16 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:57:16 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:57:16 user nova-compute[75083]:     </rng>
Nov 29 05:57:16 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:57:16 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:57:16 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:57:16 user nova-compute[75083]:     </memballoon>
Nov 29 05:57:16 user nova-compute[75083]:   </devices>
Nov 29 05:57:16 user nova-compute[75083]: </domain>
Nov 29 05:57:16 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:51:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1765064185',display_name='tempest-ServerActionsTestOtherB-server-1765064185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1765064185',id=15,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKfQt22BKdk3qqBMkdZDrlzUPc5OzBSJvBUhpD5lx0G7UqWh0HRdHS4+8i15ioAIjPFv14fiTBp00VBH9cOAzOvFWtO61YBHreoMNXT+V9qZ3bdKSP6OX3ggUHyDT/bOg==',key_name='tempest-keypair-1198752933',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:55:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='41fbbebd414945beb2130f46013125d8',ramdisk_id='',reservation_id='r-349fa5rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1953829293',owner_user_name='tempest-ServerActionsTestOtherB-1953829293-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:57:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7f8a0e94feb47bb875ab4d7f1f2a2a1',uuid=fb8244c4-f2a7-4ad8-a210-0f62c165a4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Converting VIF {"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG os_vif [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ac88727-4ed1-5098-9195-9904c3eebfcc', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap388c9969-42, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap388c9969-42, col_values=(('qos', UUID('cf0c061e-45bd-479b-8360-a681e8d44cb0')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap388c9969-42, col_values=(('external_ids', {'iface-id': '388c9969-42dc-4e34-8fb8-c2399687751d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:af:fc', 'vm-uuid': 'fb8244c4-f2a7-4ad8-a210-0f62c165a4dc'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:57:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:16 user nova-compute[75083]: INFO os_vif [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42')
Nov 29 05:57:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-7774713a-b19d-41a4-a65a-794fe218c429 req-5ee56038-0f6c-43a0-a0b3-f4ec3acbf480 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received event network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7774713a-b19d-41a4-a65a-794fe218c429 req-5ee56038-0f6c-43a0-a0b3-f4ec3acbf480 service nova] Acquiring lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7774713a-b19d-41a4-a65a-794fe218c429 req-5ee56038-0f6c-43a0-a0b3-f4ec3acbf480 service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7774713a-b19d-41a4-a65a-794fe218c429 req-5ee56038-0f6c-43a0-a0b3-f4ec3acbf480 service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-7774713a-b19d-41a4-a65a-794fe218c429 req-5ee56038-0f6c-43a0-a0b3-f4ec3acbf480 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] No waiting events found dispatching network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:57:18 user nova-compute[75083]: WARNING nova.compute.manager [req-7774713a-b19d-41a4-a65a-794fe218c429 req-5ee56038-0f6c-43a0-a0b3-f4ec3acbf480 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received unexpected event network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d for instance with vm_state resized and task_state resize_reverting.
Nov 29 05:57:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:20 user nova-compute[75083]: DEBUG nova.compute.manager [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:57:20 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Instance running successfully.
Nov 29 05:57:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] finish_revert_migration finished successfully. {{(pid=75083) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 29 05:57:20 user nova-compute[75083]: DEBUG nova.compute.manager [req-8badfe02-7327-4d10-85c7-16af472b896f req-48c5b71d-5695-4d14-9cb6-df898c5eb067 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received event network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8badfe02-7327-4d10-85c7-16af472b896f req-48c5b71d-5695-4d14-9cb6-df898c5eb067 service nova] Acquiring lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8badfe02-7327-4d10-85c7-16af472b896f req-48c5b71d-5695-4d14-9cb6-df898c5eb067 service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8badfe02-7327-4d10-85c7-16af472b896f req-48c5b71d-5695-4d14-9cb6-df898c5eb067 service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:20 user nova-compute[75083]: DEBUG nova.compute.manager [req-8badfe02-7327-4d10-85c7-16af472b896f req-48c5b71d-5695-4d14-9cb6-df898c5eb067 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] No waiting events found dispatching network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:57:20 user nova-compute[75083]: WARNING nova.compute.manager [req-8badfe02-7327-4d10-85c7-16af472b896f req-48c5b71d-5695-4d14-9cb6-df898c5eb067 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received unexpected event network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d for instance with vm_state resized and task_state resize_reverting.
Nov 29 05:57:20 user nova-compute[75083]: INFO nova.compute.manager [None req-a9030b81-294d-4ff1-a98a-606b613cc635 tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Updating instance to original state: 'active'
Nov 29 05:57:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-2ff1a059-b703-4daa-bd32-5ee6c48cc965 req-e7318b60-1b29-49bd-9828-eb0df4e78d13 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received event network-changed-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-2ff1a059-b703-4daa-bd32-5ee6c48cc965 req-e7318b60-1b29-49bd-9828-eb0df4e78d13 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Refreshing instance network info cache due to event network-changed-df73cb37-8475-4c21-89c7-b02949297b63. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:57:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2ff1a059-b703-4daa-bd32-5ee6c48cc965 req-e7318b60-1b29-49bd-9828-eb0df4e78d13 service nova] Acquiring lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:57:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2ff1a059-b703-4daa-bd32-5ee6c48cc965 req-e7318b60-1b29-49bd-9828-eb0df4e78d13 service nova] Acquired lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:57:23 user nova-compute[75083]: DEBUG nova.network.neutron [req-2ff1a059-b703-4daa-bd32-5ee6c48cc965 req-e7318b60-1b29-49bd-9828-eb0df4e78d13 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Refreshing network info cache for port df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:57:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquiring lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquiring lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:23 user nova-compute[75083]: INFO nova.compute.manager [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Terminating instance
Nov 29 05:57:23 user nova-compute[75083]: DEBUG nova.compute.manager [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:57:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG nova.network.neutron [req-2ff1a059-b703-4daa-bd32-5ee6c48cc965 req-e7318b60-1b29-49bd-9828-eb0df4e78d13 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Updated VIF entry in instance network info cache for port df73cb37-8475-4c21-89c7-b02949297b63. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG nova.network.neutron [req-2ff1a059-b703-4daa-bd32-5ee6c48cc965 req-e7318b60-1b29-49bd-9828-eb0df4e78d13 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Updating instance_info_cache with network_info: [{"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2ff1a059-b703-4daa-bd32-5ee6c48cc965 req-e7318b60-1b29-49bd-9828-eb0df4e78d13 service nova] Releasing lock "refresh_cache-cb63619b-6d75-49d0-80ef-d98aa21b7d4a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:57:24 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Instance destroyed successfully.
Nov 29 05:57:24 user nova-compute[75083]: DEBUG nova.objects.instance [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lazy-loading 'resources' on Instance uuid cb63619b-6d75-49d0-80ef-d98aa21b7d4a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T05:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2116511993',display_name='tempest-TestShelveInstance-server-2116511993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2116511993',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3XRiOYiMyy1cMKrc1L5kmaEw25NqJKhIhaSi9XAjuBjymTSblD1gvpU4X9lRZjCdo4ELni/eCQVBbsZcwHCjK+TtBxYCIy7uoJiDP2ByGmZdSvxYSiXvrvCVbCnPZgcQ==',key_name='tempest-TestShelveInstance-728939459',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:55:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='385f39574be145b6b47e5a7dddf9415e',ramdisk_id='',reservation_id='r-oqenqftq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-925751842',owner_user_name='tempest-TestShelveInstance-925751842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:55:50Z,user_data=None,user_id='d4fd22380d304dac9cc3db3ad3c971d9',uuid=cb63619b-6d75-49d0-80ef-d98aa21b7d4a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Converting VIF {"id": "df73cb37-8475-4c21-89c7-b02949297b63", "address": "fa:16:3e:58:23:d3", "network": {"id": "4c9f102f-b100-4ec2-95cb-4c66dafebf29", "bridge": "br-int", "label": "tempest-TestShelveInstance-2087453326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385f39574be145b6b47e5a7dddf9415e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf73cb37-84", "ovs_interfaceid": "df73cb37-8475-4c21-89c7-b02949297b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:23:d3,bridge_name='br-int',has_traffic_filtering=True,id=df73cb37-8475-4c21-89c7-b02949297b63,network=Network(4c9f102f-b100-4ec2-95cb-4c66dafebf29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf73cb37-84') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_vif [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:23:d3,bridge_name='br-int',has_traffic_filtering=True,id=df73cb37-8475-4c21-89c7-b02949297b63,network=Network(4c9f102f-b100-4ec2-95cb-4c66dafebf29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf73cb37-84') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf73cb37-84, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f61222e-0e52-4ab2-a254-4db98a418180) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:57:24 user nova-compute[75083]: INFO os_vif [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:23:d3,bridge_name='br-int',has_traffic_filtering=True,id=df73cb37-8475-4c21-89c7-b02949297b63,network=Network(4c9f102f-b100-4ec2-95cb-4c66dafebf29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf73cb37-84')
Nov 29 05:57:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHCjmAZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:57:24 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3468a77a-a5c0-40d9-9c32-609be0fd8eb7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:57:24 user nova-compute[75083]: No targets found.
Nov 29 05:57:24 user nova-compute[75083]: iSNS:
Nov 29 05:57:24 user nova-compute[75083]: No targets found.
Nov 29 05:57:24 user nova-compute[75083]: STATIC:
Nov 29 05:57:24 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256
Nov 29 05:57:24 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:57:24 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:57:24 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1
Nov 29 05:57:24 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:57:24 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:57:24 user nova-compute[75083]: FIRMWARE:
Nov 29 05:57:24 user nova-compute[75083]: No targets found.
Nov 29 05:57:24 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:57:24 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:57:24 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8ba168-bfe0-4a04-a40e-0c55de936a7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04dd506-f4f5-4a37-a4fe-85681a612fea]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:57:24 user nova-compute[75083]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:57:24 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 (non-flash)
Nov 29 05:57:24 user nova-compute[75083]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:57:24 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b82d3010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256'): ({'sdc'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Removing single pathed devices sdc {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[085060a3-df86-4c36-a289-34b789693b96]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b30821b-68d6-4cff-b5fa-d02a86b1de2c]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Flushing IO for device /dev/sdc {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd91811-7606-47df-ac1e-8e704cf5fd12]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[628e949e-942e-4045-a122-e9b72439e009]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23462323163323363', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e205ed6e', '/dev/disk/by-id/scsi-1SCST_BIOe205ed6e-4b21c23c8b740e42') {{(pid=86165) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 05:57:24 user nova-compute[75083]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23462323163323363
Nov 29 05:57:24 user nova-compute[75083]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_e205ed6e
Nov 29 05:57:24 user nova-compute[75083]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOe205ed6e-4b21c23c8b740e42
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6446f01-ca1e-4ebe-9cea-db3fc52eb5f9]: (4, None) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6010ee65-c5bf-468e-ad7e-8c20384d8e7a]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bc0bfc-3d60-495b-984b-9491233aa1c7]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256, portal: 172.16.0.220,3260]
Nov 29 05:57:24 user nova-compute[75083]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256, portal: 172.16.0.220,3260] successful.
Nov 29 05:57:24 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637c2fd0-db61-4184-8eee-be13661c3256 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac5ad48-1ced-446e-9ecb-2f888a0c3b97]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] <== disconnect_volume: return (407ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:57:24 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Deleting instance files /opt/stack/data/nova/instances/cb63619b-6d75-49d0-80ef-d98aa21b7d4a_del
Nov 29 05:57:24 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Deletion of /opt/stack/data/nova/instances/cb63619b-6d75-49d0-80ef-d98aa21b7d4a_del complete
Nov 29 05:57:24 user nova-compute[75083]: INFO nova.compute.manager [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 29 05:57:24 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 05:57:24 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 05:57:25 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:57:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "2778daf0-f727-4185-a404-1793b75ac523" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "2778daf0-f727-4185-a404-1793b75ac523" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:25 user nova-compute[75083]: INFO nova.compute.manager [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Unshelving
Nov 29 05:57:25 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Took 0.52 seconds to deallocate network for instance.
Nov 29 05:57:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-11bad91d-94c9-4901-8967-2c2a543d3b84 req-f3fe2a41-7209-4083-ae4d-ff17b0975144 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received event network-vif-deleted-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:25 user nova-compute[75083]: DEBUG nova.objects.instance [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'pci_requests' on Instance uuid 2778daf0-f727-4185-a404-1793b75ac523 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:57:25 user nova-compute[75083]: DEBUG nova.objects.instance [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'numa_topology' on Instance uuid 2778daf0-f727-4185-a404-1793b75ac523 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:57:25 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:57:25 user nova-compute[75083]: INFO nova.compute.claims [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Claim successful on node user
Nov 29 05:57:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-47bf9475-de89-4a4f-a513-ca71b33428f2 req-cf7a7d45-34c7-4350-8cbf-53f0bd79f970 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received event network-vif-unplugged-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-47bf9475-de89-4a4f-a513-ca71b33428f2 req-cf7a7d45-34c7-4350-8cbf-53f0bd79f970 service nova] Acquiring lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-47bf9475-de89-4a4f-a513-ca71b33428f2 req-cf7a7d45-34c7-4350-8cbf-53f0bd79f970 service nova] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-47bf9475-de89-4a4f-a513-ca71b33428f2 req-cf7a7d45-34c7-4350-8cbf-53f0bd79f970 service nova] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-47bf9475-de89-4a4f-a513-ca71b33428f2 req-cf7a7d45-34c7-4350-8cbf-53f0bd79f970 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] No waiting events found dispatching network-vif-unplugged-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:57:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-47bf9475-de89-4a4f-a513-ca71b33428f2 req-cf7a7d45-34c7-4350-8cbf-53f0bd79f970 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received event network-vif-unplugged-df73cb37-8475-4c21-89c7-b02949297b63 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:57:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-47bf9475-de89-4a4f-a513-ca71b33428f2 req-cf7a7d45-34c7-4350-8cbf-53f0bd79f970 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received event network-vif-plugged-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-47bf9475-de89-4a4f-a513-ca71b33428f2 req-cf7a7d45-34c7-4350-8cbf-53f0bd79f970 service nova] Acquiring lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-47bf9475-de89-4a4f-a513-ca71b33428f2 req-cf7a7d45-34c7-4350-8cbf-53f0bd79f970 service nova] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-47bf9475-de89-4a4f-a513-ca71b33428f2 req-cf7a7d45-34c7-4350-8cbf-53f0bd79f970 service nova] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-47bf9475-de89-4a4f-a513-ca71b33428f2 req-cf7a7d45-34c7-4350-8cbf-53f0bd79f970 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] No waiting events found dispatching network-vif-plugged-df73cb37-8475-4c21-89c7-b02949297b63 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:57:25 user nova-compute[75083]: WARNING nova.compute.manager [req-47bf9475-de89-4a4f-a513-ca71b33428f2 req-cf7a7d45-34c7-4350-8cbf-53f0bd79f970 service nova] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Received unexpected event network-vif-plugged-df73cb37-8475-4c21-89c7-b02949297b63 for instance with vm_state active and task_state deleting.
Nov 29 05:57:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:26 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:57:26 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:57:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:26 user nova-compute[75083]: INFO nova.network.neutron [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Updating port f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 05:57:26 user nova-compute[75083]: INFO nova.compute.manager [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Took 0.82 seconds to detach 1 volumes for instance.
Nov 29 05:57:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] [instance: cb63619b-6d75-49d0-80ef-d98aa21b7d4a] Deleting volume: 637c2fd0-db61-4184-8eee-be13661c3256 {{(pid=75083) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 05:57:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:57:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquired lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:57:26 user nova-compute[75083]: DEBUG nova.network.neutron [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:57:26 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:57:26 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:57:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:26 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Deleted allocations for instance cb63619b-6d75-49d0-80ef-d98aa21b7d4a
Nov 29 05:57:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-152b5658-518f-473d-872c-cba0b5cd0336 tempest-TestShelveInstance-925751842 tempest-TestShelveInstance-925751842-project-member] Lock "cb63619b-6d75-49d0-80ef-d98aa21b7d4a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.392s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:27 user nova-compute[75083]: DEBUG nova.network.neutron [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Updating instance_info_cache with network_info: [{"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:57:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Releasing lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:57:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:57:27 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Creating image(s)
Nov 29 05:57:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "/opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "/opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "/opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:27 user nova-compute[75083]: DEBUG nova.objects.instance [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2778daf0-f727-4185-a404-1793b75ac523 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:57:27 user nova-compute[75083]: DEBUG nova.objects.base [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Object Instance<2778daf0-f727-4185-a404-1793b75ac523> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:57:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "eb849e8c7f35bf45efddaa4765813fbf32129ca8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "eb849e8c7f35bf45efddaa4765813fbf32129ca8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb849e8c7f35bf45efddaa4765813fbf32129ca8.part --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-fed407f0-5180-42d4-a5da-3d62c27b430d req-62b0249e-12f7-4b22-a3a1-9ef7dba66efa service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received event network-changed-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-fed407f0-5180-42d4-a5da-3d62c27b430d req-62b0249e-12f7-4b22-a3a1-9ef7dba66efa service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Refreshing instance network info cache due to event network-changed-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:57:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fed407f0-5180-42d4-a5da-3d62c27b430d req-62b0249e-12f7-4b22-a3a1-9ef7dba66efa service nova] Acquiring lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:57:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fed407f0-5180-42d4-a5da-3d62c27b430d req-62b0249e-12f7-4b22-a3a1-9ef7dba66efa service nova] Acquired lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:57:28 user nova-compute[75083]: DEBUG nova.network.neutron [req-fed407f0-5180-42d4-a5da-3d62c27b430d req-62b0249e-12f7-4b22-a3a1-9ef7dba66efa service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Refreshing network info cache for port f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:57:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb849e8c7f35bf45efddaa4765813fbf32129ca8.part --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:28 user nova-compute[75083]: DEBUG nova.virt.images [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] 08824c7e-6bed-4f4b-9c9c-2ad712c7b5e8 was qcow2, converting to raw {{(pid=75083) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 05:57:28 user nova-compute[75083]: DEBUG nova.privsep.utils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75083) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 05:57:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb849e8c7f35bf45efddaa4765813fbf32129ca8.part /opt/stack/data/nova/instances/_base/eb849e8c7f35bf45efddaa4765813fbf32129ca8.converted {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb849e8c7f35bf45efddaa4765813fbf32129ca8.part /opt/stack/data/nova/instances/_base/eb849e8c7f35bf45efddaa4765813fbf32129ca8.converted" returned: 0 in 0.508s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb849e8c7f35bf45efddaa4765813fbf32129ca8.converted --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:29 user nova-compute[75083]: DEBUG nova.network.neutron [req-fed407f0-5180-42d4-a5da-3d62c27b430d req-62b0249e-12f7-4b22-a3a1-9ef7dba66efa service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Updated VIF entry in instance network info cache for port f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:57:29 user nova-compute[75083]: DEBUG nova.network.neutron [req-fed407f0-5180-42d4-a5da-3d62c27b430d req-62b0249e-12f7-4b22-a3a1-9ef7dba66efa service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Updating instance_info_cache with network_info: [{"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:57:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fed407f0-5180-42d4-a5da-3d62c27b430d req-62b0249e-12f7-4b22-a3a1-9ef7dba66efa service nova] Releasing lock "refresh_cache-2778daf0-f727-4185-a404-1793b75ac523" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:57:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb849e8c7f35bf45efddaa4765813fbf32129ca8.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "eb849e8c7f35bf45efddaa4765813fbf32129ca8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.222s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb849e8c7f35bf45efddaa4765813fbf32129ca8 --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb849e8c7f35bf45efddaa4765813fbf32129ca8 --force-share --output=json" returned: 0 in 0.185s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "eb849e8c7f35bf45efddaa4765813fbf32129ca8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "eb849e8c7f35bf45efddaa4765813fbf32129ca8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb849e8c7f35bf45efddaa4765813fbf32129ca8 --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb849e8c7f35bf45efddaa4765813fbf32129ca8 --force-share --output=json" returned: 0 in 0.187s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb849e8c7f35bf45efddaa4765813fbf32129ca8,backing_fmt=raw /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb849e8c7f35bf45efddaa4765813fbf32129ca8,backing_fmt=raw /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk 1073741824" returned: 0 in 0.053s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "eb849e8c7f35bf45efddaa4765813fbf32129ca8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb849e8c7f35bf45efddaa4765813fbf32129ca8 --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb849e8c7f35bf45efddaa4765813fbf32129ca8 --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:30 user nova-compute[75083]: DEBUG nova.objects.instance [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'migration_context' on Instance uuid 2778daf0-f727-4185-a404-1793b75ac523 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:57:30 user nova-compute[75083]: DEBUG nova.objects.base [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Object Instance<2778daf0-f727-4185-a404-1793b75ac523> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:57:30 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Rebasing disk image.
Nov 29 05:57:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.184s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a -F raw /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a -F raw /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk" returned: 0 in 2.640s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Ensure instance console log exists: /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Start _get_guest_xml network_info=[{"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='76593e91fcbe5f51a8c71a731c382701',container_format='bare',created_at=2023-11-29T05:55:33Z,direct_url=<?>,disk_format='qcow2',id=08824c7e-6bed-4f4b-9c9c-2ad712c7b5e8,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-496298622-shelved',owner='d1c63c54083f4a0eba38539e7c196d61',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T05:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:57:32 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:57:32 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='76593e91fcbe5f51a8c71a731c382701',container_format='bare',created_at=2023-11-29T05:55:33Z,direct_url=<?>,disk_format='qcow2',id=08824c7e-6bed-4f4b-9c9c-2ad712c7b5e8,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-496298622-shelved',owner='d1c63c54083f4a0eba38539e7c196d61',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T05:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.objects.instance [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2778daf0-f727-4185-a404-1793b75ac523 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:57:32 user nova-compute[75083]: DEBUG nova.objects.base [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Object Instance<2778daf0-f727-4185-a404-1793b75ac523> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T05:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-496298622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-496298622',id=19,image_ref='08824c7e-6bed-4f4b-9c9c-2ad712c7b5e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1008779938',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:53:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d1c63c54083f4a0eba38539e7c196d61',ramdisk_id='',reservation_id='r-c9eon0oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-961204558',owner_user_name='tempest-AttachVolumeShelveTestJSON-961204558-project-member',shelved_at='2023-11-29T05:55:37.579413',shelved_host='user',shelved_image_id='08824c7e-6bed-4f4b-9c9c-2ad712c7b5e8'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:57:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4e6b7adfb1b469ab5c6c3f26633272a',uuid=2778daf0-f727-4185-a404-1793b75ac523,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converting VIF {"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:89:b6,bridge_name='br-int',has_traffic_filtering=True,id=f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ddd3c7-1b') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG nova.objects.instance [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'pci_devices' on Instance uuid 2778daf0-f727-4185-a404-1793b75ac523 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG nova.objects.base [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Object Instance<2778daf0-f727-4185-a404-1793b75ac523> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:57:33 user nova-compute[75083]:   <uuid>2778daf0-f727-4185-a404-1793b75ac523</uuid>
Nov 29 05:57:33 user nova-compute[75083]:   <name>instance-00000013</name>
Nov 29 05:57:33 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:57:33 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:57:33 user nova-compute[75083]:   <metadata>
Nov 29 05:57:33 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:57:33 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:57:33 user nova-compute[75083]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-496298622</nova:name>
Nov 29 05:57:33 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:57:32</nova:creationTime>
Nov 29 05:57:33 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:57:33 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:57:33 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:57:33 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:57:33 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:57:33 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:57:33 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:57:33 user nova-compute[75083]:       <nova:owner>
Nov 29 05:57:33 user nova-compute[75083]:         <nova:user uuid="e4e6b7adfb1b469ab5c6c3f26633272a">tempest-AttachVolumeShelveTestJSON-961204558-project-member</nova:user>
Nov 29 05:57:33 user nova-compute[75083]:         <nova:project uuid="d1c63c54083f4a0eba38539e7c196d61">tempest-AttachVolumeShelveTestJSON-961204558</nova:project>
Nov 29 05:57:33 user nova-compute[75083]:       </nova:owner>
Nov 29 05:57:33 user nova-compute[75083]:       <nova:root type="image" uuid="08824c7e-6bed-4f4b-9c9c-2ad712c7b5e8"/>
Nov 29 05:57:33 user nova-compute[75083]:       <nova:ports>
Nov 29 05:57:33 user nova-compute[75083]:         <nova:port uuid="f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9">
Nov 29 05:57:33 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 05:57:33 user nova-compute[75083]:         </nova:port>
Nov 29 05:57:33 user nova-compute[75083]:       </nova:ports>
Nov 29 05:57:33 user nova-compute[75083]:     </nova:instance>
Nov 29 05:57:33 user nova-compute[75083]:   </metadata>
Nov 29 05:57:33 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:57:33 user nova-compute[75083]:     <system>
Nov 29 05:57:33 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:57:33 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:57:33 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:57:33 user nova-compute[75083]:       <entry name="serial">2778daf0-f727-4185-a404-1793b75ac523</entry>
Nov 29 05:57:33 user nova-compute[75083]:       <entry name="uuid">2778daf0-f727-4185-a404-1793b75ac523</entry>
Nov 29 05:57:33 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:57:33 user nova-compute[75083]:     </system>
Nov 29 05:57:33 user nova-compute[75083]:   </sysinfo>
Nov 29 05:57:33 user nova-compute[75083]:   <os>
Nov 29 05:57:33 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:57:33 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:57:33 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:57:33 user nova-compute[75083]:   </os>
Nov 29 05:57:33 user nova-compute[75083]:   <features>
Nov 29 05:57:33 user nova-compute[75083]:     <acpi/>
Nov 29 05:57:33 user nova-compute[75083]:     <apic/>
Nov 29 05:57:33 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:57:33 user nova-compute[75083]:   </features>
Nov 29 05:57:33 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:57:33 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:57:33 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:57:33 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:57:33 user nova-compute[75083]:   </clock>
Nov 29 05:57:33 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:57:33 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:57:33 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:57:33 user nova-compute[75083]:   </cpu>
Nov 29 05:57:33 user nova-compute[75083]:   <devices>
Nov 29 05:57:33 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:57:33 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:57:33 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk"/>
Nov 29 05:57:33 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:57:33 user nova-compute[75083]:     </disk>
Nov 29 05:57:33 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:57:33 user nova-compute[75083]:       <mac address="fa:16:3e:81:89:b6"/>
Nov 29 05:57:33 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:57:33 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:57:33 user nova-compute[75083]:       <target dev="tapf5ddd3c7-1b"/>
Nov 29 05:57:33 user nova-compute[75083]:     </interface>
Nov 29 05:57:33 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:57:33 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/console.log" append="off"/>
Nov 29 05:57:33 user nova-compute[75083]:     </serial>
Nov 29 05:57:33 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:57:33 user nova-compute[75083]:     <video>
Nov 29 05:57:33 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:57:33 user nova-compute[75083]:     </video>
Nov 29 05:57:33 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:57:33 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:57:33 user nova-compute[75083]:     </rng>
Nov 29 05:57:33 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:57:33 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:57:33 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:57:33 user nova-compute[75083]:     </memballoon>
Nov 29 05:57:33 user nova-compute[75083]:   </devices>
Nov 29 05:57:33 user nova-compute[75083]: </domain>
Nov 29 05:57:33 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T05:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-496298622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-496298622',id=19,image_ref='08824c7e-6bed-4f4b-9c9c-2ad712c7b5e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1008779938',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:53:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d1c63c54083f4a0eba38539e7c196d61',ramdisk_id='',reservation_id='r-c9eon0oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-961204558',owner_user_name='tempest-AttachVolumeShelveTestJSON-961204558-project-member',shelved_at='2023-11-29T05:55:37.579413',shelved_host='user',shelved_image_id='08824c7e-6bed-4f4b-9c9c-2ad712c7b5e8'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:57:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4e6b7adfb1b469ab5c6c3f26633272a',uuid=2778daf0-f727-4185-a404-1793b75ac523,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converting VIF {"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:89:b6,bridge_name='br-int',has_traffic_filtering=True,id=f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ddd3c7-1b') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG os_vif [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:89:b6,bridge_name='br-int',has_traffic_filtering=True,id=f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ddd3c7-1b') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b4447e5-e2cb-53ea-9319-d8156cdd318c', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5ddd3c7-1b, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5ddd3c7-1b, col_values=(('qos', UUID('0afa9741-0046-4912-9ae6-c02465f326b9')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5ddd3c7-1b, col_values=(('external_ids', {'iface-id': 'f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:89:b6', 'vm-uuid': '2778daf0-f727-4185-a404-1793b75ac523'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:33 user nova-compute[75083]: INFO os_vif [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:89:b6,bridge_name='br-int',has_traffic_filtering=True,id=f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ddd3c7-1b')
Nov 29 05:57:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:57:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] No VIF found with MAC fa:16:3e:81:89:b6, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:57:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:35 user nova-compute[75083]: DEBUG nova.compute.manager [req-6aea5445-e442-4ffa-b0fd-ebf4e5017c8b req-1b908321-6aa6-4acd-b9a7-8392d7d9dc99 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received event network-vif-plugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6aea5445-e442-4ffa-b0fd-ebf4e5017c8b req-1b908321-6aa6-4acd-b9a7-8392d7d9dc99 service nova] Acquiring lock "2778daf0-f727-4185-a404-1793b75ac523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6aea5445-e442-4ffa-b0fd-ebf4e5017c8b req-1b908321-6aa6-4acd-b9a7-8392d7d9dc99 service nova] Lock "2778daf0-f727-4185-a404-1793b75ac523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6aea5445-e442-4ffa-b0fd-ebf4e5017c8b req-1b908321-6aa6-4acd-b9a7-8392d7d9dc99 service nova] Lock "2778daf0-f727-4185-a404-1793b75ac523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:35 user nova-compute[75083]: DEBUG nova.compute.manager [req-6aea5445-e442-4ffa-b0fd-ebf4e5017c8b req-1b908321-6aa6-4acd-b9a7-8392d7d9dc99 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] No waiting events found dispatching network-vif-plugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:57:35 user nova-compute[75083]: WARNING nova.compute.manager [req-6aea5445-e442-4ffa-b0fd-ebf4e5017c8b req-1b908321-6aa6-4acd-b9a7-8392d7d9dc99 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received unexpected event network-vif-plugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 05:57:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:37 user nova-compute[75083]: DEBUG nova.compute.manager [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:57:37 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:57:37 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Instance spawned successfully.
Nov 29 05:57:37 user nova-compute[75083]: DEBUG nova.compute.manager [req-093adeff-3264-4a48-9538-a3a2ae81f87b req-c556cca6-50c2-4ee5-8733-8c973d2d6879 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received event network-vif-plugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-093adeff-3264-4a48-9538-a3a2ae81f87b req-c556cca6-50c2-4ee5-8733-8c973d2d6879 service nova] Acquiring lock "2778daf0-f727-4185-a404-1793b75ac523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-093adeff-3264-4a48-9538-a3a2ae81f87b req-c556cca6-50c2-4ee5-8733-8c973d2d6879 service nova] Lock "2778daf0-f727-4185-a404-1793b75ac523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-093adeff-3264-4a48-9538-a3a2ae81f87b req-c556cca6-50c2-4ee5-8733-8c973d2d6879 service nova] Lock "2778daf0-f727-4185-a404-1793b75ac523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:37 user nova-compute[75083]: DEBUG nova.compute.manager [req-093adeff-3264-4a48-9538-a3a2ae81f87b req-c556cca6-50c2-4ee5-8733-8c973d2d6879 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] No waiting events found dispatching network-vif-plugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:57:37 user nova-compute[75083]: WARNING nova.compute.manager [req-093adeff-3264-4a48-9538-a3a2ae81f87b req-c556cca6-50c2-4ee5-8733-8c973d2d6879 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received unexpected event network-vif-plugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 05:57:37 user nova-compute[75083]: DEBUG nova.compute.manager [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:57:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-efdfbfbc-2742-4d23-b815-e87355a7b70d tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "2778daf0-f727-4185-a404-1793b75ac523" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.147s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquiring lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquiring lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:38 user nova-compute[75083]: INFO nova.compute.manager [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Terminating instance
Nov 29 05:57:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:57:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-4e2b2092-9467-4770-bf2b-1690029db719 req-f5688e8f-218d-4219-81dc-4e6b31635bbd service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Received event network-vif-unplugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4e2b2092-9467-4770-bf2b-1690029db719 req-f5688e8f-218d-4219-81dc-4e6b31635bbd service nova] Acquiring lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4e2b2092-9467-4770-bf2b-1690029db719 req-f5688e8f-218d-4219-81dc-4e6b31635bbd service nova] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4e2b2092-9467-4770-bf2b-1690029db719 req-f5688e8f-218d-4219-81dc-4e6b31635bbd service nova] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-4e2b2092-9467-4770-bf2b-1690029db719 req-f5688e8f-218d-4219-81dc-4e6b31635bbd service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] No waiting events found dispatching network-vif-unplugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:57:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-4e2b2092-9467-4770-bf2b-1690029db719 req-f5688e8f-218d-4219-81dc-4e6b31635bbd service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Received event network-vif-unplugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:57:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:39 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Instance destroyed successfully.
Nov 29 05:57:39 user nova-compute[75083]: DEBUG nova.objects.instance [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lazy-loading 'resources' on Instance uuid d206e7ab-eb5b-4026-a1ea-4b34837b0fed {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-834786237',display_name='tempest-VolumesAdminNegativeTest-server-834786237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-834786237',id=23,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:55:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1012483943a489a862040d3a9fddfb6',ramdisk_id='',reservation_id='r-zyqaybdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-971732472',owner_user_name='tempest-VolumesAdminNegativeTest-971732472-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:55:49Z,user_data=None,user_id='a2615574010e4604b526176f69ccfff0',uuid=d206e7ab-eb5b-4026-a1ea-4b34837b0fed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f83928cd-3df5-4752-bcab-077bad5fd8b8", "address": "fa:16:3e:ff:c3:de", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83928cd-3d", "ovs_interfaceid": "f83928cd-3df5-4752-bcab-077bad5fd8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Converting VIF {"id": "f83928cd-3df5-4752-bcab-077bad5fd8b8", "address": "fa:16:3e:ff:c3:de", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83928cd-3d", "ovs_interfaceid": "f83928cd-3df5-4752-bcab-077bad5fd8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:c3:de,bridge_name='br-int',has_traffic_filtering=True,id=f83928cd-3df5-4752-bcab-077bad5fd8b8,network=Network(c6a6ca21-a775-4c8e-9075-4dc10bc6cf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83928cd-3d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG os_vif [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:c3:de,bridge_name='br-int',has_traffic_filtering=True,id=f83928cd-3df5-4752-bcab-077bad5fd8b8,network=Network(c6a6ca21-a775-4c8e-9075-4dc10bc6cf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83928cd-3d') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf83928cd-3d, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f243822-5b35-4392-8853-7982b0374039) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:57:39 user nova-compute[75083]: INFO os_vif [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:c3:de,bridge_name='br-int',has_traffic_filtering=True,id=f83928cd-3df5-4752-bcab-077bad5fd8b8,network=Network(c6a6ca21-a775-4c8e-9075-4dc10bc6cf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83928cd-3d')
Nov 29 05:57:39 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Deleting instance files /opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed_del
Nov 29 05:57:39 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Deletion of /opt/stack/data/nova/instances/d206e7ab-eb5b-4026-a1ea-4b34837b0fed_del complete
Nov 29 05:57:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:39 user nova-compute[75083]: INFO nova.compute.manager [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 29 05:57:39 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Received event network-vif-plugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] Acquiring lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] No waiting events found dispatching network-vif-plugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:57:40 user nova-compute[75083]: WARNING nova.compute.manager [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Received unexpected event network-vif-plugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 for instance with vm_state active and task_state deleting.
Nov 29 05:57:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Received event network-vif-plugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] Acquiring lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] No waiting events found dispatching network-vif-plugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:57:40 user nova-compute[75083]: WARNING nova.compute.manager [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Received unexpected event network-vif-plugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 for instance with vm_state active and task_state deleting.
Nov 29 05:57:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Received event network-vif-plugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] Acquiring lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] No waiting events found dispatching network-vif-plugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:57:40 user nova-compute[75083]: WARNING nova.compute.manager [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Received unexpected event network-vif-plugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 for instance with vm_state active and task_state deleting.
Nov 29 05:57:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Received event network-vif-unplugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] Acquiring lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] No waiting events found dispatching network-vif-unplugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:57:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-25f86768-b752-4481-85fc-49dd0e260bd5 req-9c7e2747-9260-4f56-ade5-9fe675edf137 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Received event network-vif-unplugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:57:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:41 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:57:41 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Took 1.84 seconds to deallocate network for instance.
Nov 29 05:57:41 user nova-compute[75083]: DEBUG nova.compute.manager [req-bb24f484-5c17-4dce-8462-aa4a01e6112b req-ee05bc8d-78ed-459a-9173-fc87cf8d3660 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Received event network-vif-deleted-f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:41 user nova-compute[75083]: INFO nova.compute.manager [req-bb24f484-5c17-4dce-8462-aa4a01e6112b req-ee05bc8d-78ed-459a-9173-fc87cf8d3660 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Neutron deleted interface f83928cd-3df5-4752-bcab-077bad5fd8b8; detaching it from the instance and deleting it from the info cache
Nov 29 05:57:41 user nova-compute[75083]: DEBUG nova.network.neutron [req-bb24f484-5c17-4dce-8462-aa4a01e6112b req-ee05bc8d-78ed-459a-9173-fc87cf8d3660 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:57:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:41 user nova-compute[75083]: DEBUG nova.compute.manager [req-bb24f484-5c17-4dce-8462-aa4a01e6112b req-ee05bc8d-78ed-459a-9173-fc87cf8d3660 service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Detach interface failed, port_id=f83928cd-3df5-4752-bcab-077bad5fd8b8, reason: Instance d206e7ab-eb5b-4026-a1ea-4b34837b0fed could not be found. {{(pid=75083) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 05:57:41 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:57:41 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:57:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:41 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Deleted allocations for instance d206e7ab-eb5b-4026-a1ea-4b34837b0fed
Nov 29 05:57:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3b145732-2a1b-42c5-8039-a601580f865c tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.741s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-b6deaab3-f16e-4a94-b913-87c1feccdd4b req-bb92d02c-d060-4765-995d-322d2414429a service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Received event network-vif-plugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b6deaab3-f16e-4a94-b913-87c1feccdd4b req-bb92d02c-d060-4765-995d-322d2414429a service nova] Acquiring lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b6deaab3-f16e-4a94-b913-87c1feccdd4b req-bb92d02c-d060-4765-995d-322d2414429a service nova] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b6deaab3-f16e-4a94-b913-87c1feccdd4b req-bb92d02c-d060-4765-995d-322d2414429a service nova] Lock "d206e7ab-eb5b-4026-a1ea-4b34837b0fed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-b6deaab3-f16e-4a94-b913-87c1feccdd4b req-bb92d02c-d060-4765-995d-322d2414429a service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] No waiting events found dispatching network-vif-plugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:57:43 user nova-compute[75083]: WARNING nova.compute.manager [req-b6deaab3-f16e-4a94-b913-87c1feccdd4b req-bb92d02c-d060-4765-995d-322d2414429a service nova] [instance: d206e7ab-eb5b-4026-a1ea-4b34837b0fed] Received unexpected event network-vif-plugged-f83928cd-3df5-4752-bcab-077bad5fd8b8 for instance with vm_state deleted and task_state None.
Nov 29 05:57:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:51 user nova-compute[75083]: DEBUG nova.compute.manager [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:57:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:57:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:57:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:57:51 user nova-compute[75083]: INFO nova.compute.claims [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Claim successful on node user
Nov 29 05:57:52 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:57:52 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:57:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:57:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:57:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:57:52 user nova-compute[75083]: DEBUG nova.network.neutron [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:57:52 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:57:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:57:52 user nova-compute[75083]: INFO nova.virt.block_device [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Booting with volume dd16d88f-6e45-4545-9260-ba380f6262e4 at /dev/vda
Nov 29 05:57:52 user nova-compute[75083]: DEBUG nova.policy [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbd7f863ad7c4229957c4b08601b5003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d0f3dd09bf436498e67d7bfdd904bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:57:52 user nova-compute[75083]: DEBUG os_brick.utils [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:57:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d76cb0-ecd6-4c6e-9ea3-cd780148c81a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.119s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[44484cb4-ace6-4d42-a56a-122cba0e7c39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.216s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:57:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9e54cf-be51-4a51-b539-8ee875f146e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[707120b5-0201-4561-8c96-fe973b3b92cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:57:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:57:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:57:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:57:53 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:57:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae41df2-6dec-420c-bb48-871d8f673c10]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:57:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:57:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:57:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:57:53 user nova-compute[75083]: DEBUG os_brick.utils [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] <== get_connector_properties: return (495ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:57:53 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Updating existing volume attachment record: ef5d77ae-93e8-4651-9698-5734feac18cc {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:57:54 user nova-compute[75083]: DEBUG nova.network.neutron [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Successfully created port: 5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:57:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:55 user nova-compute[75083]: DEBUG nova.network.neutron [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Successfully updated port: 5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:57:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-83d01baa-feb2-411d-8c0f-ed9971e16b0d req-7a1cb98e-d873-40cc-bec6-3808e9cbb7be service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Received event network-changed-5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:57:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-83d01baa-feb2-411d-8c0f-ed9971e16b0d req-7a1cb98e-d873-40cc-bec6-3808e9cbb7be service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Refreshing instance network info cache due to event network-changed-5c054e6a-71b8-4b15-8153-356638de21d7. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:57:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-83d01baa-feb2-411d-8c0f-ed9971e16b0d req-7a1cb98e-d873-40cc-bec6-3808e9cbb7be service nova] Acquiring lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:57:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-83d01baa-feb2-411d-8c0f-ed9971e16b0d req-7a1cb98e-d873-40cc-bec6-3808e9cbb7be service nova] Acquired lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:57:55 user nova-compute[75083]: DEBUG nova.network.neutron [req-83d01baa-feb2-411d-8c0f-ed9971e16b0d req-7a1cb98e-d873-40cc-bec6-3808e9cbb7be service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Refreshing network info cache for port 5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:57:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:57:55 user nova-compute[75083]: DEBUG nova.network.neutron [req-83d01baa-feb2-411d-8c0f-ed9971e16b0d req-7a1cb98e-d873-40cc-bec6-3808e9cbb7be service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:57:55 user nova-compute[75083]: DEBUG nova.network.neutron [req-83d01baa-feb2-411d-8c0f-ed9971e16b0d req-7a1cb98e-d873-40cc-bec6-3808e9cbb7be service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:57:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-83d01baa-feb2-411d-8c0f-ed9971e16b0d req-7a1cb98e-d873-40cc-bec6-3808e9cbb7be service nova] Releasing lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:57:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquired lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:57:55 user nova-compute[75083]: DEBUG nova.network.neutron [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:57:55 user nova-compute[75083]: DEBUG nova.network.neutron [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:57:55 user nova-compute[75083]: DEBUG nova.network.neutron [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Updating instance_info_cache with network_info: [{"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:57:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Releasing lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:57:55 user nova-compute[75083]: DEBUG nova.compute.manager [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Instance network_info: |[{"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:57:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:57:59 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:58:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:58:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.compute.manager [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:58:01 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Creating image(s)
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Did not create local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Ensure instance console log exists: /opt/stack/data/nova/instances/18dc5c9c-8fb3-41c7-a124-4881788b3c48/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Start _get_guest_xml network_info=[{"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'ef5d77ae-93e8-4651-9698-5734feac18cc', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VBpGufml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '18dc5c9c-8fb3-41c7-a124-4881788b3c48', 'attached_at': '', 'detached_at': '', 'volume_id': 'dd16d88f-6e45-4545-9260-ba380f6262e4', 'serial': 'dd16d88f-6e45-4545-9260-ba380f6262e4'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:58:01 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:58:01 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VBpGufml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:58:01 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:58:01 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:58:01 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1fd0eb-c725-45ab-a3c5-9e1f746a1b35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:58:01 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2edb9c-ede8-4afc-af2d-a34cd63ebd8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4] added
Nov 29 05:58:01 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ee49b6-8958-4a00-a9ca-fd5f9b246fda]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7521c0b-ef70-4719-b194-28fec4d67a06]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VBpGufml {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VBpGufml" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[89683f66-80b7-45c5-aa7a-0d61d1ee8566]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VBpGufml'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9340b1-c19e-4998-9e04-f3055941cfa2]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a585c3f-323b-4c88-9e76-6925b8244f4d]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:58:01 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:58:01 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9847ba0a-f873-4191-91c0-ffa6cdaa24f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4, portal: 172.16.0.220,3260]
Nov 29 05:58:01 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4, portal: 172.16.0.220,3260] successful.
Nov 29 05:58:01 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e561a778-736e-4938-9e09-e07a49803efb]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc187b0-89b5-45b4-903d-76effd4f1ffd]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:58:01 user nova-compute[75083]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 05:58:01 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:58:01 user nova-compute[75083]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 05:58:01 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[60732690-2aab-488a-b988-2b180340db02]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: None {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:58:01 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VBpGufml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23161336438646462', 'path': '/dev/sdc'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161336438646462', 'path': '/dev/sdc'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1662636095',display_name='tempest-ServerActionsTestOtherA-server-1662636095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1662636095',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/QARryHVy9tL0HspVgAb5d+hXfz/yMgw4/juPCBWiK9jONO+/KTLCL7Bj2On8DfV4bHN063zv9H1zJ2YV2YRCRWmcFlsfDLpgZRojBg+ehebykt/upaC2Fb+0QP3Sb0w==',key_name='tempest-keypair-908590560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95d0f3dd09bf436498e67d7bfdd904bf',ramdisk_id='',reservation_id='r-5gd7ljor',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2114836332',owner_user_name='tempest-ServerActionsTestOtherA-2114836332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:57:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbd7f863ad7c4229957c4b08601b5003',uuid=18dc5c9c-8fb3-41c7-a124-4881788b3c48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converting VIF {"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:e7:fa,bridge_name='br-int',has_traffic_filtering=True,id=5c054e6a-71b8-4b15-8153-356638de21d7,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c054e6a-71') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG nova.objects.instance [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lazy-loading 'pci_devices' on Instance uuid 18dc5c9c-8fb3-41c7-a124-4881788b3c48 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:58:02 user nova-compute[75083]:   <uuid>18dc5c9c-8fb3-41c7-a124-4881788b3c48</uuid>
Nov 29 05:58:02 user nova-compute[75083]:   <name>instance-0000001a</name>
Nov 29 05:58:02 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:58:02 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:58:02 user nova-compute[75083]:   <metadata>
Nov 29 05:58:02 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:58:02 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:58:02 user nova-compute[75083]:       <nova:name>tempest-ServerActionsTestOtherA-server-1662636095</nova:name>
Nov 29 05:58:02 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:58:01</nova:creationTime>
Nov 29 05:58:02 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:58:02 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:58:02 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:58:02 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:58:02 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:58:02 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:58:02 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:58:02 user nova-compute[75083]:       <nova:owner>
Nov 29 05:58:02 user nova-compute[75083]:         <nova:user uuid="cbd7f863ad7c4229957c4b08601b5003">tempest-ServerActionsTestOtherA-2114836332-project-member</nova:user>
Nov 29 05:58:02 user nova-compute[75083]:         <nova:project uuid="95d0f3dd09bf436498e67d7bfdd904bf">tempest-ServerActionsTestOtherA-2114836332</nova:project>
Nov 29 05:58:02 user nova-compute[75083]:       </nova:owner>
Nov 29 05:58:02 user nova-compute[75083]:       <nova:ports>
Nov 29 05:58:02 user nova-compute[75083]:         <nova:port uuid="5c054e6a-71b8-4b15-8153-356638de21d7">
Nov 29 05:58:02 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 05:58:02 user nova-compute[75083]:         </nova:port>
Nov 29 05:58:02 user nova-compute[75083]:       </nova:ports>
Nov 29 05:58:02 user nova-compute[75083]:     </nova:instance>
Nov 29 05:58:02 user nova-compute[75083]:   </metadata>
Nov 29 05:58:02 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:58:02 user nova-compute[75083]:     <system>
Nov 29 05:58:02 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:58:02 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:58:02 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:58:02 user nova-compute[75083]:       <entry name="serial">18dc5c9c-8fb3-41c7-a124-4881788b3c48</entry>
Nov 29 05:58:02 user nova-compute[75083]:       <entry name="uuid">18dc5c9c-8fb3-41c7-a124-4881788b3c48</entry>
Nov 29 05:58:02 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:58:02 user nova-compute[75083]:     </system>
Nov 29 05:58:02 user nova-compute[75083]:   </sysinfo>
Nov 29 05:58:02 user nova-compute[75083]:   <os>
Nov 29 05:58:02 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:58:02 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:58:02 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:58:02 user nova-compute[75083]:   </os>
Nov 29 05:58:02 user nova-compute[75083]:   <features>
Nov 29 05:58:02 user nova-compute[75083]:     <acpi/>
Nov 29 05:58:02 user nova-compute[75083]:     <apic/>
Nov 29 05:58:02 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:58:02 user nova-compute[75083]:   </features>
Nov 29 05:58:02 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:58:02 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:58:02 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:58:02 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:58:02 user nova-compute[75083]:   </clock>
Nov 29 05:58:02 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:58:02 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:58:02 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:58:02 user nova-compute[75083]:   </cpu>
Nov 29 05:58:02 user nova-compute[75083]:   <devices>
Nov 29 05:58:02 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 05:58:02 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:58:02 user nova-compute[75083]:       <source dev="/dev/sdc"/>
Nov 29 05:58:02 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:58:02 user nova-compute[75083]:       <serial>dd16d88f-6e45-4545-9260-ba380f6262e4</serial>
Nov 29 05:58:02 user nova-compute[75083]:     </disk>
Nov 29 05:58:02 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:58:02 user nova-compute[75083]:       <mac address="fa:16:3e:34:e7:fa"/>
Nov 29 05:58:02 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:58:02 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:58:02 user nova-compute[75083]:       <target dev="tap5c054e6a-71"/>
Nov 29 05:58:02 user nova-compute[75083]:     </interface>
Nov 29 05:58:02 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:58:02 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/18dc5c9c-8fb3-41c7-a124-4881788b3c48/console.log" append="off"/>
Nov 29 05:58:02 user nova-compute[75083]:     </serial>
Nov 29 05:58:02 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:58:02 user nova-compute[75083]:     <video>
Nov 29 05:58:02 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:58:02 user nova-compute[75083]:     </video>
Nov 29 05:58:02 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:58:02 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:58:02 user nova-compute[75083]:     </rng>
Nov 29 05:58:02 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:58:02 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:58:02 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:58:02 user nova-compute[75083]:     </memballoon>
Nov 29 05:58:02 user nova-compute[75083]:   </devices>
Nov 29 05:58:02 user nova-compute[75083]: </domain>
Nov 29 05:58:02 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1662636095',display_name='tempest-ServerActionsTestOtherA-server-1662636095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1662636095',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/QARryHVy9tL0HspVgAb5d+hXfz/yMgw4/juPCBWiK9jONO+/KTLCL7Bj2On8DfV4bHN063zv9H1zJ2YV2YRCRWmcFlsfDLpgZRojBg+ehebykt/upaC2Fb+0QP3Sb0w==',key_name='tempest-keypair-908590560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95d0f3dd09bf436498e67d7bfdd904bf',ramdisk_id='',reservation_id='r-5gd7ljor',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2114836332',owner_user_name='tempest-ServerActionsTestOtherA-2114836332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:57:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbd7f863ad7c4229957c4b08601b5003',uuid=18dc5c9c-8fb3-41c7-a124-4881788b3c48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converting VIF {"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:e7:fa,bridge_name='br-int',has_traffic_filtering=True,id=5c054e6a-71b8-4b15-8153-356638de21d7,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c054e6a-71') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG os_vif [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:e7:fa,bridge_name='br-int',has_traffic_filtering=True,id=5c054e6a-71b8-4b15-8153-356638de21d7,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c054e6a-71') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef427b46-7126-5f14-a676-0bde9ffaf3fd', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c054e6a-71, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c054e6a-71, col_values=(('qos', UUID('69ca0104-1311-436e-aad7-82ffa45b3ba3')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c054e6a-71, col_values=(('external_ids', {'iface-id': '5c054e6a-71b8-4b15-8153-356638de21d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:e7:fa', 'vm-uuid': '18dc5c9c-8fb3-41c7-a124-4881788b3c48'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:02 user nova-compute[75083]: INFO os_vif [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:e7:fa,bridge_name='br-int',has_traffic_filtering=True,id=5c054e6a-71b8-4b15-8153-356638de21d7,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c054e6a-71')
Nov 29 05:58:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:58:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] No VIF found with MAC fa:16:3e:34:e7:fa, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:58:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-dac8b7ba-05a9-461d-92d6-657e51fb6b16 req-bf247a16-3a4a-436a-81ba-2ab99b974372 service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Received event network-vif-plugged-5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:58:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-dac8b7ba-05a9-461d-92d6-657e51fb6b16 req-bf247a16-3a4a-436a-81ba-2ab99b974372 service nova] Acquiring lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:58:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-dac8b7ba-05a9-461d-92d6-657e51fb6b16 req-bf247a16-3a4a-436a-81ba-2ab99b974372 service nova] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:58:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-dac8b7ba-05a9-461d-92d6-657e51fb6b16 req-bf247a16-3a4a-436a-81ba-2ab99b974372 service nova] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:58:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-dac8b7ba-05a9-461d-92d6-657e51fb6b16 req-bf247a16-3a4a-436a-81ba-2ab99b974372 service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] No waiting events found dispatching network-vif-plugged-5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:58:04 user nova-compute[75083]: WARNING nova.compute.manager [req-dac8b7ba-05a9-461d-92d6-657e51fb6b16 req-bf247a16-3a4a-436a-81ba-2ab99b974372 service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Received unexpected event network-vif-plugged-5c054e6a-71b8-4b15-8153-356638de21d7 for instance with vm_state building and task_state spawning.
Nov 29 05:58:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:04 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:58:05 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:58:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG nova.compute.manager [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:58:06 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Instance spawned successfully.
Nov 29 05:58:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:58:06 user nova-compute[75083]: INFO nova.compute.manager [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 29 05:58:06 user nova-compute[75083]: DEBUG nova.compute.manager [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-1f24a118-086d-42c3-90a6-4e9a6ee586a5 req-89fef5b4-945f-45a7-8b27-b229a1cabade service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Received event network-vif-plugged-5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-1f24a118-086d-42c3-90a6-4e9a6ee586a5 req-89fef5b4-945f-45a7-8b27-b229a1cabade service nova] Acquiring lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-1f24a118-086d-42c3-90a6-4e9a6ee586a5 req-89fef5b4-945f-45a7-8b27-b229a1cabade service nova] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-1f24a118-086d-42c3-90a6-4e9a6ee586a5 req-89fef5b4-945f-45a7-8b27-b229a1cabade service nova] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-1f24a118-086d-42c3-90a6-4e9a6ee586a5 req-89fef5b4-945f-45a7-8b27-b229a1cabade service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] No waiting events found dispatching network-vif-plugged-5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:58:06 user nova-compute[75083]: WARNING nova.compute.manager [req-1f24a118-086d-42c3-90a6-4e9a6ee586a5 req-89fef5b4-945f-45a7-8b27-b229a1cabade service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Received unexpected event network-vif-plugged-5c054e6a-71b8-4b15-8153-356638de21d7 for instance with vm_state building and task_state spawning.
Nov 29 05:58:06 user nova-compute[75083]: INFO nova.compute.manager [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Took 14.63 seconds to build instance.
Nov 29 05:58:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-50149f4f-abba-47e4-86e0-9d24fb8b0a94 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.751s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 05:58:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:07 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:58:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Acquiring lock "cb409505-c9d8-46d3-b7d0-aad486942ccf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:58:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "cb409505-c9d8-46d3-b7d0-aad486942ccf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:58:08 user nova-compute[75083]: DEBUG nova.compute.manager [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:58:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:58:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:58:08 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:58:08 user nova-compute[75083]: INFO nova.compute.claims [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Claim successful on node user
Nov 29 05:58:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.621s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG nova.compute.manager [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG nova.compute.manager [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG nova.network.neutron [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:58:09 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:58:09 user nova-compute[75083]: DEBUG nova.compute.manager [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG nova.policy [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e3cf798ed354d3ba55c0ff609e22d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42598c48c05439f8059b4b8bf30b9dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG nova.compute.manager [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:58:09 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Creating image(s)
Nov 29 05:58:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb409505-c9d8-46d3-b7d0-aad486942ccf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "/opt/stack/data/nova/instances/cb409505-c9d8-46d3-b7d0-aad486942ccf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "/opt/stack/data/nova/instances/cb409505-c9d8-46d3-b7d0-aad486942ccf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.214s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.213s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/cb409505-c9d8-46d3-b7d0-aad486942ccf/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/cb409505-c9d8-46d3-b7d0-aad486942ccf/disk 1073741824" returned: 0 in 0.058s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG nova.network.neutron [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Successfully created port: 97768cc7-9bc1-4d5e-bea3-8855bfbe6121 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.264s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.193s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb409505-c9d8-46d3-b7d0-aad486942ccf/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb409505-c9d8-46d3-b7d0-aad486942ccf/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb409505-c9d8-46d3-b7d0-aad486942ccf/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Cannot resize image /opt/stack/data/nova/instances/cb409505-c9d8-46d3-b7d0-aad486942ccf/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Ensure instance console log exists: /opt/stack/data/nova/instances/cb409505-c9d8-46d3-b7d0-aad486942ccf/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.network.neutron [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Successfully updated port: 97768cc7-9bc1-4d5e-bea3-8855bfbe6121 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.compute.manager [req-91869d3b-86d1-4bb3-bdf2-20455ab2e95e req-bfef1e94-bc05-4625-8b03-16627fde7a1f service nova] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Received event network-changed-97768cc7-9bc1-4d5e-bea3-8855bfbe6121 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.compute.manager [req-91869d3b-86d1-4bb3-bdf2-20455ab2e95e req-bfef1e94-bc05-4625-8b03-16627fde7a1f service nova] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Refreshing instance network info cache due to event network-changed-97768cc7-9bc1-4d5e-bea3-8855bfbe6121. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-91869d3b-86d1-4bb3-bdf2-20455ab2e95e req-bfef1e94-bc05-4625-8b03-16627fde7a1f service nova] Acquiring lock "refresh_cache-cb409505-c9d8-46d3-b7d0-aad486942ccf" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-91869d3b-86d1-4bb3-bdf2-20455ab2e95e req-bfef1e94-bc05-4625-8b03-16627fde7a1f service nova] Acquired lock "refresh_cache-cb409505-c9d8-46d3-b7d0-aad486942ccf" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.network.neutron [req-91869d3b-86d1-4bb3-bdf2-20455ab2e95e req-bfef1e94-bc05-4625-8b03-16627fde7a1f service nova] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Refreshing network info cache for port 97768cc7-9bc1-4d5e-bea3-8855bfbe6121 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:58:11 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:58:11 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=7664MB free_disk=25.272560119628906GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Acquiring lock "refresh_cache-cb409505-c9d8-46d3-b7d0-aad486942ccf" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.network.neutron [req-91869d3b-86d1-4bb3-bdf2-20455ab2e95e req-bfef1e94-bc05-4625-8b03-16627fde7a1f service nova] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 161c6455-90ce-4c40-a33e-7f582989135d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4435ed78-e35f-4859-8a4f-9920815d968a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a34d9d98-be73-4d52-85f0-83e48f60bc12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fb8244c4-f2a7-4ad8-a210-0f62c165a4dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 05f45fef-c8a7-41c1-a571-863307caca6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance c1baf96b-be32-42f1-85a8-9b2321226199 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 2778daf0-f727-4185-a404-1793b75ac523 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 18dc5c9c-8fb3-41c7-a124-4881788b3c48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance cb409505-c9d8-46d3-b7d0-aad486942ccf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.network.neutron [req-91869d3b-86d1-4bb3-bdf2-20455ab2e95e req-bfef1e94-bc05-4625-8b03-16627fde7a1f service nova] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-91869d3b-86d1-4bb3-bdf2-20455ab2e95e req-bfef1e94-bc05-4625-8b03-16627fde7a1f service nova] Releasing lock "refresh_cache-cb409505-c9d8-46d3-b7d0-aad486942ccf" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Acquired lock "refresh_cache-cb409505-c9d8-46d3-b7d0-aad486942ccf" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.network.neutron [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.network.neutron [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.network.neutron [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Updating instance_info_cache with network_info: [{"id": "97768cc7-9bc1-4d5e-bea3-8855bfbe6121", "address": "fa:16:3e:64:c3:1d", "network": {"id": "f41035e0-21bb-472a-959b-099a854e4629", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-994952120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b42598c48c05439f8059b4b8bf30b9dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97768cc7-9b", "ovs_interfaceid": "97768cc7-9bc1-4d5e-bea3-8855bfbe6121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Releasing lock "refresh_cache-cb409505-c9d8-46d3-b7d0-aad486942ccf" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.compute.manager [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Instance network_info: |[{"id": "97768cc7-9bc1-4d5e-bea3-8855bfbe6121", "address": "fa:16:3e:64:c3:1d", "network": {"id": "f41035e0-21bb-472a-959b-099a854e4629", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-994952120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b42598c48c05439f8059b4b8bf30b9dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97768cc7-9b", "ovs_interfaceid": "97768cc7-9bc1-4d5e-bea3-8855bfbe6121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Start _get_guest_xml network_info=[{"id": "97768cc7-9bc1-4d5e-bea3-8855bfbe6121", "address": "fa:16:3e:64:c3:1d", "network": {"id": "f41035e0-21bb-472a-959b-099a854e4629", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-994952120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b42598c48c05439f8059b4b8bf30b9dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97768cc7-9b", "ovs_interfaceid": "97768cc7-9bc1-4d5e-bea3-8855bfbe6121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:58:11 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:58:11 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-230799648',display_name='tempest-ServersNegativeTestJSON-server-230799648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-230799648',id=27,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b42598c48c05439f8059b4b8bf30b9dd',ramdisk_id='',reservation_id='r-wbove0zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1931576508',owner_user_name='tempest-ServersNegativeTestJSON-1931576508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:58:10Z,user_data=None,user_id='1e3cf798ed354d3ba55c0ff609e22d7f',uuid=cb409505-c9d8-46d3-b7d0-aad486942ccf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97768cc7-9bc1-4d5e-bea3-8855bfbe6121", "address": "fa:16:3e:64:c3:1d", "network": {"id": "f41035e0-21bb-472a-959b-099a854e4629", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-994952120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b42598c48c05439f8059b4b8bf30b9dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97768cc7-9b", "ovs_interfaceid": "97768cc7-9bc1-4d5e-bea3-8855bfbe6121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Converting VIF {"id": "97768cc7-9bc1-4d5e-bea3-8855bfbe6121", "address": "fa:16:3e:64:c3:1d", "network": {"id": "f41035e0-21bb-472a-959b-099a854e4629", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-994952120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b42598c48c05439f8059b4b8bf30b9dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97768cc7-9b", "ovs_interfaceid": "97768cc7-9bc1-4d5e-bea3-8855bfbe6121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:c3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97768cc7-9bc1-4d5e-bea3-8855bfbe6121,network=Network(f41035e0-21bb-472a-959b-099a854e4629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97768cc7-9b') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.objects.instance [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lazy-loading 'pci_devices' on Instance uuid cb409505-c9d8-46d3-b7d0-aad486942ccf {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:58:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:58:11 user nova-compute[75083]:   <uuid>cb409505-c9d8-46d3-b7d0-aad486942ccf</uuid>
Nov 29 05:58:11 user nova-compute[75083]:   <name>instance-0000001b</name>
Nov 29 05:58:11 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:58:11 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:58:11 user nova-compute[75083]:   <metadata>
Nov 29 05:58:11 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:58:11 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:58:11 user nova-compute[75083]:       <nova:name>tempest-ServersNegativeTestJSON-server-230799648</nova:name>
Nov 29 05:58:11 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:58:11</nova:creationTime>
Nov 29 05:58:11 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:58:11 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:58:11 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:58:11 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:58:11 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:58:11 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:58:11 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:58:11 user nova-compute[75083]:       <nova:owner>
Nov 29 05:58:11 user nova-compute[75083]:         <nova:user uuid="1e3cf798ed354d3ba55c0ff609e22d7f">tempest-ServersNegativeTestJSON-1931576508-project-member</nova:user>
Nov 29 05:58:11 user nova-compute[75083]:         <nova:project uuid="b42598c48c05439f8059b4b8bf30b9dd">tempest-ServersNegativeTestJSON-1931576508</nova:project>
Nov 29 05:58:11 user nova-compute[75083]:       </nova:owner>
Nov 29 05:58:11 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:58:11 user nova-compute[75083]:       <nova:ports>
Nov 29 05:58:11 user nova-compute[75083]:         <nova:port uuid="97768cc7-9bc1-4d5e-bea3-8855bfbe6121">
Nov 29 05:58:11 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 05:58:11 user nova-compute[75083]:         </nova:port>
Nov 29 05:58:11 user nova-compute[75083]:       </nova:ports>
Nov 29 05:58:11 user nova-compute[75083]:     </nova:instance>
Nov 29 05:58:11 user nova-compute[75083]:   </metadata>
Nov 29 05:58:11 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:58:11 user nova-compute[75083]:     <system>
Nov 29 05:58:11 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:58:11 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:58:11 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:58:11 user nova-compute[75083]:       <entry name="serial">cb409505-c9d8-46d3-b7d0-aad486942ccf</entry>
Nov 29 05:58:11 user nova-compute[75083]:       <entry name="uuid">cb409505-c9d8-46d3-b7d0-aad486942ccf</entry>
Nov 29 05:58:11 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:58:11 user nova-compute[75083]:     </system>
Nov 29 05:58:11 user nova-compute[75083]:   </sysinfo>
Nov 29 05:58:11 user nova-compute[75083]:   <os>
Nov 29 05:58:11 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:58:11 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:58:11 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:58:11 user nova-compute[75083]:   </os>
Nov 29 05:58:11 user nova-compute[75083]:   <features>
Nov 29 05:58:11 user nova-compute[75083]:     <acpi/>
Nov 29 05:58:11 user nova-compute[75083]:     <apic/>
Nov 29 05:58:11 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:58:11 user nova-compute[75083]:   </features>
Nov 29 05:58:11 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:58:11 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:58:11 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:58:11 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:58:11 user nova-compute[75083]:   </clock>
Nov 29 05:58:11 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:58:11 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:58:11 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:58:11 user nova-compute[75083]:   </cpu>
Nov 29 05:58:11 user nova-compute[75083]:   <devices>
Nov 29 05:58:11 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:58:11 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:58:11 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/cb409505-c9d8-46d3-b7d0-aad486942ccf/disk"/>
Nov 29 05:58:11 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:58:11 user nova-compute[75083]:     </disk>
Nov 29 05:58:11 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:58:11 user nova-compute[75083]:       <mac address="fa:16:3e:64:c3:1d"/>
Nov 29 05:58:11 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:58:11 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:58:11 user nova-compute[75083]:       <target dev="tap97768cc7-9b"/>
Nov 29 05:58:11 user nova-compute[75083]:     </interface>
Nov 29 05:58:11 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:58:11 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/cb409505-c9d8-46d3-b7d0-aad486942ccf/console.log" append="off"/>
Nov 29 05:58:11 user nova-compute[75083]:     </serial>
Nov 29 05:58:11 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:58:11 user nova-compute[75083]:     <video>
Nov 29 05:58:11 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:58:11 user nova-compute[75083]:     </video>
Nov 29 05:58:11 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:58:11 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:58:11 user nova-compute[75083]:     </rng>
Nov 29 05:58:11 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:58:11 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:58:11 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:58:11 user nova-compute[75083]:     </memballoon>
Nov 29 05:58:11 user nova-compute[75083]:   </devices>
Nov 29 05:58:11 user nova-compute[75083]: </domain>
Nov 29 05:58:11 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-230799648',display_name='tempest-ServersNegativeTestJSON-server-230799648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-230799648',id=27,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b42598c48c05439f8059b4b8bf30b9dd',ramdisk_id='',reservation_id='r-wbove0zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1931576508',owner_user_name='tempest-ServersNegativeTestJSON-1931576508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:58:10Z,user_data=None,user_id='1e3cf798ed354d3ba55c0ff609e22d7f',uuid=cb409505-c9d8-46d3-b7d0-aad486942ccf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97768cc7-9bc1-4d5e-bea3-8855bfbe6121", "address": "fa:16:3e:64:c3:1d", "network": {"id": "f41035e0-21bb-472a-959b-099a854e4629", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-994952120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b42598c48c05439f8059b4b8bf30b9dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97768cc7-9b", "ovs_interfaceid": "97768cc7-9bc1-4d5e-bea3-8855bfbe6121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Converting VIF {"id": "97768cc7-9bc1-4d5e-bea3-8855bfbe6121", "address": "fa:16:3e:64:c3:1d", "network": {"id": "f41035e0-21bb-472a-959b-099a854e4629", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-994952120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b42598c48c05439f8059b4b8bf30b9dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97768cc7-9b", "ovs_interfaceid": "97768cc7-9bc1-4d5e-bea3-8855bfbe6121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:c3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97768cc7-9bc1-4d5e-bea3-8855bfbe6121,network=Network(f41035e0-21bb-472a-959b-099a854e4629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97768cc7-9b') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG os_vif [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:c3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97768cc7-9bc1-4d5e-bea3-8855bfbe6121,network=Network(f41035e0-21bb-472a-959b-099a854e4629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97768cc7-9b') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f92ffb3a-3979-5e6e-a04d-7603edb75e91', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97768cc7-9b, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97768cc7-9b, col_values=(('qos', UUID('8494facd-19a2-4e74-acd8-8d0e2783c29b')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97768cc7-9b, col_values=(('external_ids', {'iface-id': '97768cc7-9bc1-4d5e-bea3-8855bfbe6121', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:c3:1d', 'vm-uuid': 'cb409505-c9d8-46d3-b7d0-aad486942ccf'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:12 user nova-compute[75083]: INFO os_vif [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:c3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97768cc7-9bc1-4d5e-bea3-8855bfbe6121,network=Network(f41035e0-21bb-472a-959b-099a854e4629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97768cc7-9b')
Nov 29 05:58:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] No VIF found with MAC fa:16:3e:64:c3:1d, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:58:12 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:58:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:13 user nova-compute[75083]: DEBUG nova.compute.manager [req-3d1ada52-e6b2-4e79-a44a-73d272795e6f req-93f3c3b6-3908-4be3-a109-327923d9e6f8 service nova] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Received event network-vif-plugged-97768cc7-9bc1-4d5e-bea3-8855bfbe6121 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:58:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3d1ada52-e6b2-4e79-a44a-73d272795e6f req-93f3c3b6-3908-4be3-a109-327923d9e6f8 service nova] Acquiring lock "cb409505-c9d8-46d3-b7d0-aad486942ccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:58:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3d1ada52-e6b2-4e79-a44a-73d272795e6f req-93f3c3b6-3908-4be3-a109-327923d9e6f8 service nova] Lock "cb409505-c9d8-46d3-b7d0-aad486942ccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:58:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3d1ada52-e6b2-4e79-a44a-73d272795e6f req-93f3c3b6-3908-4be3-a109-327923d9e6f8 service nova] Lock "cb409505-c9d8-46d3-b7d0-aad486942ccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:58:13 user nova-compute[75083]: DEBUG nova.compute.manager [req-3d1ada52-e6b2-4e79-a44a-73d272795e6f req-93f3c3b6-3908-4be3-a109-327923d9e6f8 service nova] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] No waiting events found dispatching network-vif-plugged-97768cc7-9bc1-4d5e-bea3-8855bfbe6121 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:58:13 user nova-compute[75083]: WARNING nova.compute.manager [req-3d1ada52-e6b2-4e79-a44a-73d272795e6f req-93f3c3b6-3908-4be3-a109-327923d9e6f8 service nova] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Received unexpected event network-vif-plugged-97768cc7-9bc1-4d5e-bea3-8855bfbe6121 for instance with vm_state building and task_state spawning.
Nov 29 05:58:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:15 user nova-compute[75083]: DEBUG nova.compute.manager [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:58:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:58:15 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Instance spawned successfully.
Nov 29 05:58:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:58:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:58:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:58:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:58:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:58:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:58:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:58:15 user nova-compute[75083]: DEBUG nova.compute.manager [req-5069e54b-3eda-4366-a390-cfa60ff836f2 req-184f64db-a545-45a4-ae03-4cd014873791 service nova] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Received event network-vif-plugged-97768cc7-9bc1-4d5e-bea3-8855bfbe6121 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:58:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5069e54b-3eda-4366-a390-cfa60ff836f2 req-184f64db-a545-45a4-ae03-4cd014873791 service nova] Acquiring lock "cb409505-c9d8-46d3-b7d0-aad486942ccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:58:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5069e54b-3eda-4366-a390-cfa60ff836f2 req-184f64db-a545-45a4-ae03-4cd014873791 service nova] Lock "cb409505-c9d8-46d3-b7d0-aad486942ccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:58:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5069e54b-3eda-4366-a390-cfa60ff836f2 req-184f64db-a545-45a4-ae03-4cd014873791 service nova] Lock "cb409505-c9d8-46d3-b7d0-aad486942ccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:58:15 user nova-compute[75083]: DEBUG nova.compute.manager [req-5069e54b-3eda-4366-a390-cfa60ff836f2 req-184f64db-a545-45a4-ae03-4cd014873791 service nova] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] No waiting events found dispatching network-vif-plugged-97768cc7-9bc1-4d5e-bea3-8855bfbe6121 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:58:15 user nova-compute[75083]: WARNING nova.compute.manager [req-5069e54b-3eda-4366-a390-cfa60ff836f2 req-184f64db-a545-45a4-ae03-4cd014873791 service nova] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Received unexpected event network-vif-plugged-97768cc7-9bc1-4d5e-bea3-8855bfbe6121 for instance with vm_state building and task_state spawning.
Nov 29 05:58:15 user nova-compute[75083]: INFO nova.compute.manager [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Took 6.09 seconds to spawn the instance on the hypervisor.
Nov 29 05:58:15 user nova-compute[75083]: DEBUG nova.compute.manager [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:58:15 user nova-compute[75083]: INFO nova.compute.manager [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Took 7.13 seconds to build instance.
Nov 29 05:58:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66d97f60-c2e8-460f-b96f-d8b3c18b5101 tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "cb409505-c9d8-46d3-b7d0-aad486942ccf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.300s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:58:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquiring lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:58:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:58:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquiring lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:58:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:58:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:58:33 user nova-compute[75083]: INFO nova.compute.manager [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Terminating instance
Nov 29 05:58:33 user nova-compute[75083]: DEBUG nova.compute.manager [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:58:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:33 user nova-compute[75083]: DEBUG nova.compute.manager [req-67e3b78b-55a8-430d-b149-4e661d53ea8d req-10e24a25-1650-4408-a959-bc8f1fd0f8e5 service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Received event network-vif-unplugged-e58bdd4f-988b-40e7-867b-25c7c306f96f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:58:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-67e3b78b-55a8-430d-b149-4e661d53ea8d req-10e24a25-1650-4408-a959-bc8f1fd0f8e5 service nova] Acquiring lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:58:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-67e3b78b-55a8-430d-b149-4e661d53ea8d req-10e24a25-1650-4408-a959-bc8f1fd0f8e5 service nova] Lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:58:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-67e3b78b-55a8-430d-b149-4e661d53ea8d req-10e24a25-1650-4408-a959-bc8f1fd0f8e5 service nova] Lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:58:33 user nova-compute[75083]: DEBUG nova.compute.manager [req-67e3b78b-55a8-430d-b149-4e661d53ea8d req-10e24a25-1650-4408-a959-bc8f1fd0f8e5 service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] No waiting events found dispatching network-vif-unplugged-e58bdd4f-988b-40e7-867b-25c7c306f96f {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:58:33 user nova-compute[75083]: DEBUG nova.compute.manager [req-67e3b78b-55a8-430d-b149-4e661d53ea8d req-10e24a25-1650-4408-a959-bc8f1fd0f8e5 service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Received event network-vif-unplugged-e58bdd4f-988b-40e7-867b-25c7c306f96f for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:58:34 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Instance destroyed successfully.
Nov 29 05:58:34 user nova-compute[75083]: DEBUG nova.objects.instance [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lazy-loading 'resources' on Instance uuid eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:58:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-794950177',display_name='tempest-VolumesAdminNegativeTest-server-794950177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-794950177',id=13,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOifxrw9oj4jT4psUDDcu8gRts7j7C2WqINDoEEELfOg8Q+KNuGsopf7w9BuKjxFnpF+mTK3WSBQNWmyY07q6cTo1oyFxbaTQLPr8EJbttZwPt/Al8jcgvFbvfrYhWLTqQ==',key_name='tempest-keypair-1799727666',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1012483943a489a862040d3a9fddfb6',ramdisk_id='',reservation_id='r-uiztzhe0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-971732472',owner_user_name='tempest-VolumesAdminNegativeTest-971732472-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2615574010e4604b526176f69ccfff0',uuid=eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "address": "fa:16:3e:0f:c8:f5", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape58bdd4f-98", "ovs_interfaceid": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:58:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Converting VIF {"id": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "address": "fa:16:3e:0f:c8:f5", "network": {"id": "c6a6ca21-a775-4c8e-9075-4dc10bc6cf70", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-341488145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1012483943a489a862040d3a9fddfb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape58bdd4f-98", "ovs_interfaceid": "e58bdd4f-988b-40e7-867b-25c7c306f96f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:58:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:c8:f5,bridge_name='br-int',has_traffic_filtering=True,id=e58bdd4f-988b-40e7-867b-25c7c306f96f,network=Network(c6a6ca21-a775-4c8e-9075-4dc10bc6cf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape58bdd4f-98') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:58:34 user nova-compute[75083]: DEBUG os_vif [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:c8:f5,bridge_name='br-int',has_traffic_filtering=True,id=e58bdd4f-988b-40e7-867b-25c7c306f96f,network=Network(c6a6ca21-a775-4c8e-9075-4dc10bc6cf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape58bdd4f-98') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:58:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape58bdd4f-98, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:58:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:58:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec854371-59f4-4f6e-a5d0-27f2869045f2) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:58:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:58:34 user nova-compute[75083]: INFO os_vif [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:c8:f5,bridge_name='br-int',has_traffic_filtering=True,id=e58bdd4f-988b-40e7-867b-25c7c306f96f,network=Network(c6a6ca21-a775-4c8e-9075-4dc10bc6cf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape58bdd4f-98')
Nov 29 05:58:34 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Deleting instance files /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d_del
Nov 29 05:58:34 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Deletion of /opt/stack/data/nova/instances/eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d_del complete
Nov 29 05:58:34 user nova-compute[75083]: INFO nova.compute.manager [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 29 05:58:34 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 05:58:34 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 05:58:34 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 05:58:35 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:58:35 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Took 0.87 seconds to deallocate network for instance.
Nov 29 05:58:35 user nova-compute[75083]: DEBUG nova.compute.manager [req-a5dfe1ef-a770-49e6-92cb-a8c36b42a836 req-02a01af3-1614-4105-bab0-6cac1a544113 service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Received event network-vif-deleted-e58bdd4f-988b-40e7-867b-25c7c306f96f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:58:35 user nova-compute[75083]: INFO nova.compute.manager [req-a5dfe1ef-a770-49e6-92cb-a8c36b42a836 req-02a01af3-1614-4105-bab0-6cac1a544113 service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Neutron deleted interface e58bdd4f-988b-40e7-867b-25c7c306f96f; detaching it from the instance and deleting it from the info cache
Nov 29 05:58:35 user nova-compute[75083]: DEBUG nova.network.neutron [req-a5dfe1ef-a770-49e6-92cb-a8c36b42a836 req-02a01af3-1614-4105-bab0-6cac1a544113 service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:58:35 user nova-compute[75083]: DEBUG nova.compute.manager [req-a5dfe1ef-a770-49e6-92cb-a8c36b42a836 req-02a01af3-1614-4105-bab0-6cac1a544113 service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Detach interface failed, port_id=e58bdd4f-988b-40e7-867b-25c7c306f96f, reason: Instance eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d could not be found. {{(pid=75083) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 05:58:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:58:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:58:35 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:58:35 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:58:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:58:35 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Deleted allocations for instance eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d
Nov 29 05:58:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1771eaed-6011-4dc4-9936-9f8125562b9d tempest-VolumesAdminNegativeTest-971732472 tempest-VolumesAdminNegativeTest-971732472-project-member] Lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.274s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:58:35 user nova-compute[75083]: DEBUG nova.compute.manager [req-82351bbd-5a91-4305-90a8-0d8ad029b25f req-a8a45980-47df-495d-9a75-9a8884eaeb1f service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Received event network-vif-plugged-e58bdd4f-988b-40e7-867b-25c7c306f96f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:58:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-82351bbd-5a91-4305-90a8-0d8ad029b25f req-a8a45980-47df-495d-9a75-9a8884eaeb1f service nova] Acquiring lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:58:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-82351bbd-5a91-4305-90a8-0d8ad029b25f req-a8a45980-47df-495d-9a75-9a8884eaeb1f service nova] Lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:58:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-82351bbd-5a91-4305-90a8-0d8ad029b25f req-a8a45980-47df-495d-9a75-9a8884eaeb1f service nova] Lock "eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:58:35 user nova-compute[75083]: DEBUG nova.compute.manager [req-82351bbd-5a91-4305-90a8-0d8ad029b25f req-a8a45980-47df-495d-9a75-9a8884eaeb1f service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] No waiting events found dispatching network-vif-plugged-e58bdd4f-988b-40e7-867b-25c7c306f96f {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:58:35 user nova-compute[75083]: WARNING nova.compute.manager [req-82351bbd-5a91-4305-90a8-0d8ad029b25f req-a8a45980-47df-495d-9a75-9a8884eaeb1f service nova] [instance: eb805ebe-1cbb-4cb9-93c6-b6c0a1ae5f9d] Received unexpected event network-vif-plugged-e58bdd4f-988b-40e7-867b-25c7c306f96f for instance with vm_state deleted and task_state None.
Nov 29 05:58:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:58:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-e0aa9712-3ff4-47c1-abb7-a3f00f0245b5 req-836f96f6-bbc7-40e0-b1f2-feb9a0e672e5 service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Received event network-changed-1331cb58-30d1-4578-9a05-6a70116d925b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:58:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-e0aa9712-3ff4-47c1-abb7-a3f00f0245b5 req-836f96f6-bbc7-40e0-b1f2-feb9a0e672e5 service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Refreshing instance network info cache due to event network-changed-1331cb58-30d1-4578-9a05-6a70116d925b. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:58:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e0aa9712-3ff4-47c1-abb7-a3f00f0245b5 req-836f96f6-bbc7-40e0-b1f2-feb9a0e672e5 service nova] Acquiring lock "refresh_cache-c1baf96b-be32-42f1-85a8-9b2321226199" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:58:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e0aa9712-3ff4-47c1-abb7-a3f00f0245b5 req-836f96f6-bbc7-40e0-b1f2-feb9a0e672e5 service nova] Acquired lock "refresh_cache-c1baf96b-be32-42f1-85a8-9b2321226199" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:58:55 user nova-compute[75083]: DEBUG nova.network.neutron [req-e0aa9712-3ff4-47c1-abb7-a3f00f0245b5 req-836f96f6-bbc7-40e0-b1f2-feb9a0e672e5 service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Refreshing network info cache for port 1331cb58-30d1-4578-9a05-6a70116d925b {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:58:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:58:56 user nova-compute[75083]: DEBUG nova.network.neutron [req-e0aa9712-3ff4-47c1-abb7-a3f00f0245b5 req-836f96f6-bbc7-40e0-b1f2-feb9a0e672e5 service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Updated VIF entry in instance network info cache for port 1331cb58-30d1-4578-9a05-6a70116d925b. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:58:56 user nova-compute[75083]: DEBUG nova.network.neutron [req-e0aa9712-3ff4-47c1-abb7-a3f00f0245b5 req-836f96f6-bbc7-40e0-b1f2-feb9a0e672e5 service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Updating instance_info_cache with network_info: [{"id": "1331cb58-30d1-4578-9a05-6a70116d925b", "address": "fa:16:3e:50:1a:f0", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1331cb58-30", "ovs_interfaceid": "1331cb58-30d1-4578-9a05-6a70116d925b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:58:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e0aa9712-3ff4-47c1-abb7-a3f00f0245b5 req-836f96f6-bbc7-40e0-b1f2-feb9a0e672e5 service nova] Releasing lock "refresh_cache-c1baf96b-be32-42f1-85a8-9b2321226199" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "c1baf96b-be32-42f1-85a8-9b2321226199" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "c1baf96b-be32-42f1-85a8-9b2321226199" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG nova.objects.instance [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'flavor' on Instance uuid c1baf96b-be32-42f1-85a8-9b2321226199 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "c1baf96b-be32-42f1-85a8-9b2321226199" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "c1baf96b-be32-42f1-85a8-9b2321226199" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "c1baf96b-be32-42f1-85a8-9b2321226199" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:58:58 user nova-compute[75083]: INFO nova.compute.manager [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Attaching volume 64303580-0ac1-4831-9e48-8baa9f572d42 to /dev/vdb
Nov 29 05:58:58 user nova-compute[75083]: DEBUG os_brick.utils [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[989bb455-97fe-4d04-b32b-11d8127436f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09eb6da-1def-464b-b4ac-a4bafae71abd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[52852146-0c04-45e3-b36c-d70aa5e49b16]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[49211607-43eb-4243-a278-d593671aec28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:58:58 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:58:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2801e2f-21f2-435a-bf5b-cfe8b323a346]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG os_brick.utils [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:58:58 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Updating existing volume attachment record: 43f0eafd-7b09-454b-9884-006677abfac5 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:58:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:01 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:59:02 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:59:02 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:59:02 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 05:59:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goIYKUiJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:59:06 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:59:06 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:59:06 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62cf9cf-de9e-430c-bc4c-91bb46723047]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:59:06 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef30d9d-337c-40d3-bf52-3ce0d00432c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42] added
Nov 29 05:59:06 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bbb9a2-2b34-4f71-b020-0824424a4e28]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b037c86-e939-4c9e-b07b-01c0e93ff0c0]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v goIYKUiJ {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v goIYKUiJ" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[70435077-3986-4ddc-9543-129a535d25cc]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'goIYKUiJ'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f758964-a5c7-4934-abd0-71c312272bc3]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d76a49d-9517-4364-a066-1ce419805b7b]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:59:06 user nova-compute[75083]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 05:59:06 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:59:06 user nova-compute[75083]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 05:59:06 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f26cf81-402c-453c-9830-ffe20d59464e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42, portal: 172.16.0.220,3260]
Nov 29 05:59:06 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42, portal: 172.16.0.220,3260] successful.
Nov 29 05:59:06 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2354f513-acec-4e46-b591-41088c2cef15]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbb63d0-bfb7-48d9-a7e6-36f7b146561d]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:59:06 user nova-compute[75083]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 05:59:06 user nova-compute[75083]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 (non-flash)
Nov 29 05:59:06 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:59:06 user nova-compute[75083]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 05:59:06 user nova-compute[75083]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 (non-flash)
Nov 29 05:59:06 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffef203-6190-4295-ba27-aad831698ed2]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: None {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb409505-c9d8-46d3-b7d0-aad486942ccf/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb409505-c9d8-46d3-b7d0-aad486942ccf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb409505-c9d8-46d3-b7d0-aad486942ccf/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb409505-c9d8-46d3-b7d0-aad486942ccf/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goIYKUiJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23161626263633835', 'path': '/dev/sdd'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161626263633835', 'path': '/dev/sdd'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG nova.objects.instance [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'flavor' on Instance uuid c1baf96b-be32-42f1-85a8-9b2321226199 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 05:59:07 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:59:07 user nova-compute[75083]:   <source dev="/dev/sdd"/>
Nov 29 05:59:07 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:59:07 user nova-compute[75083]:   <serial>64303580-0ac1-4831-9e48-8baa9f572d42</serial>
Nov 29 05:59:07 user nova-compute[75083]: </disk>
Nov 29 05:59:07 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:59:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] No VIF found with MAC fa:16:3e:50:1a:f0, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:59:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-def83738-a631-4899-87d6-7ae0a2e421d9 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "c1baf96b-be32-42f1-85a8-9b2321226199" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.588s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:59:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:59:10 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:59:10 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:59:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=7683MB free_disk=25.259883880615234GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 05:59:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 161c6455-90ce-4c40-a33e-7f582989135d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:59:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4435ed78-e35f-4859-8a4f-9920815d968a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:59:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a34d9d98-be73-4d52-85f0-83e48f60bc12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:59:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fb8244c4-f2a7-4ad8-a210-0f62c165a4dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:59:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 05f45fef-c8a7-41c1-a571-863307caca6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:59:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance c1baf96b-be32-42f1-85a8-9b2321226199 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:59:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 2778daf0-f727-4185-a404-1793b75ac523 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:59:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 18dc5c9c-8fb3-41c7-a124-4881788b3c48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:59:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance cb409505-c9d8-46d3-b7d0-aad486942ccf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 05:59:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 05:59:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 05:59:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "c1baf96b-be32-42f1-85a8-9b2321226199" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "c1baf96b-be32-42f1-85a8-9b2321226199" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:10 user nova-compute[75083]: DEBUG nova.objects.instance [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'flavor' on Instance uuid c1baf96b-be32-42f1-85a8-9b2321226199 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "c1baf96b-be32-42f1-85a8-9b2321226199" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.566s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "c1baf96b-be32-42f1-85a8-9b2321226199" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "c1baf96b-be32-42f1-85a8-9b2321226199" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:11 user nova-compute[75083]: INFO nova.compute.manager [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Attaching volume 8fb43125-c0b4-4155-8c9f-8b8320923401 to /dev/vdc
Nov 29 05:59:11 user nova-compute[75083]: DEBUG os_brick.utils [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ac2771-586e-499e-aa28-99a543f5e4a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[621b2c61-55e5-4cfa-87d7-b23ca9d851ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[40818c25-3c74-407e-8a12-98bb5099a783]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[130baf02-2c84-4744-bb72-c528d63a2c8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:59:11 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c8aaeb-39e3-430c-82e2-072467ef3595]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG os_brick.utils [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Updating existing volume attachment record: 3210aff6-9f6c-4ef6-9553-632af3d2fac8 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 05:59:11 user nova-compute[75083]: INFO nova.compute.manager [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Rescuing
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquired lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG nova.network.neutron [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG nova.network.neutron [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Updating instance_info_cache with network_info: [{"id": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "address": "fa:16:3e:8d:3b:2a", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f259ece-bc", "ovs_interfaceid": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:59:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Releasing lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lazy-loading 'info_cache' on Instance uuid 161c6455-90ce-4c40-a33e-7f582989135d {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG nova.compute.manager [req-0499eae1-c72b-4f63-bbb5-ce7439d30552 req-e9444d52-3d3d-43c0-8b50-0f8c1afa56b3 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received event network-vif-unplugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0499eae1-c72b-4f63-bbb5-ce7439d30552 req-e9444d52-3d3d-43c0-8b50-0f8c1afa56b3 service nova] Acquiring lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0499eae1-c72b-4f63-bbb5-ce7439d30552 req-e9444d52-3d3d-43c0-8b50-0f8c1afa56b3 service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0499eae1-c72b-4f63-bbb5-ce7439d30552 req-e9444d52-3d3d-43c0-8b50-0f8c1afa56b3 service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG nova.compute.manager [req-0499eae1-c72b-4f63-bbb5-ce7439d30552 req-e9444d52-3d3d-43c0-8b50-0f8c1afa56b3 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] No waiting events found dispatching network-vif-unplugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:59:12 user nova-compute[75083]: WARNING nova.compute.manager [req-0499eae1-c72b-4f63-bbb5-ce7439d30552 req-e9444d52-3d3d-43c0-8b50-0f8c1afa56b3 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received unexpected event network-vif-unplugged-1f259ece-bce2-4aab-925b-26e4f9619fbf for instance with vm_state active and task_state rescuing.
Nov 29 05:59:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:12 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Instance destroyed successfully.
Nov 29 05:59:12 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Attempting rescue
Nov 29 05:59:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75083) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Instance directory exists: not creating {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 05:59:12 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Creating image(s)
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "/opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "/opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "/opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG nova.objects.instance [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4435ed78-e35f-4859-8a4f-9920815d968a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk.rescue {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Updating instance_info_cache with network_info: [{"id": "188d4866-21b0-4a1e-a17a-c0c82e849726", "address": "fa:16:3e:a8:14:4a", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d4866-21", "ovs_interfaceid": "188d4866-21b0-4a1e-a17a-c0c82e849726", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk.rescue" returned: 0 in 0.053s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG nova.objects.instance [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'migration_context' on Instance uuid 4435ed78-e35f-4859-8a4f-9920815d968a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG nova.objects.base [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Object Instance<4435ed78-e35f-4859-8a4f-9920815d968a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Start _get_guest_xml network_info=[{"id": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "address": "fa:16:3e:8d:3b:2a", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "vif_mac": "fa:16:3e:8d:3b:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f259ece-bc", "ovs_interfaceid": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG nova.objects.instance [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'resources' on Instance uuid 4435ed78-e35f-4859-8a4f-9920815d968a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG nova.objects.base [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Object Instance<4435ed78-e35f-4859-8a4f-9920815d968a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:59:12 user nova-compute[75083]: DEBUG nova.objects.instance [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'numa_topology' on Instance uuid 4435ed78-e35f-4859-8a4f-9920815d968a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.objects.base [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Object Instance<4435ed78-e35f-4859-8a4f-9920815d968a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:59:13 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:59:13 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.objects.instance [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4435ed78-e35f-4859-8a4f-9920815d968a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.objects.base [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Object Instance<4435ed78-e35f-4859-8a4f-9920815d968a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:54:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-131916452',display_name='tempest-ServerRescueNegativeTestJSON-server-131916452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-131916452',id=20,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:54:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7833259e5df546ba86139af68fcb7906',ramdisk_id='',reservation_id='r-yjx8q1as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1120078925',owner_user_name='tempest-ServerRescueNegativeTestJSON-1120078925-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:54:35Z,user_data=None,user_id='eb74d3aef4664ff8bdec4110c6867056',uuid=4435ed78-e35f-4859-8a4f-9920815d968a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "address": "fa:16:3e:8d:3b:2a", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "vif_mac": "fa:16:3e:8d:3b:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f259ece-bc", "ovs_interfaceid": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converting VIF {"id": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "address": "fa:16:3e:8d:3b:2a", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "vif_mac": "fa:16:3e:8d:3b:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f259ece-bc", "ovs_interfaceid": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:3b:2a,bridge_name='br-int',has_traffic_filtering=True,id=1f259ece-bce2-4aab-925b-26e4f9619fbf,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f259ece-bc') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.objects.instance [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'pci_devices' on Instance uuid 4435ed78-e35f-4859-8a4f-9920815d968a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.objects.base [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Object Instance<4435ed78-e35f-4859-8a4f-9920815d968a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:59:13 user nova-compute[75083]:   <uuid>4435ed78-e35f-4859-8a4f-9920815d968a</uuid>
Nov 29 05:59:13 user nova-compute[75083]:   <name>instance-00000014</name>
Nov 29 05:59:13 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:59:13 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:59:13 user nova-compute[75083]:   <metadata>
Nov 29 05:59:13 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:59:13 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:59:13 user nova-compute[75083]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-131916452</nova:name>
Nov 29 05:59:13 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:59:13</nova:creationTime>
Nov 29 05:59:13 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:59:13 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:59:13 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:59:13 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:59:13 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:59:13 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:59:13 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:59:13 user nova-compute[75083]:       <nova:owner>
Nov 29 05:59:13 user nova-compute[75083]:         <nova:user uuid="eb74d3aef4664ff8bdec4110c6867056">tempest-ServerRescueNegativeTestJSON-1120078925-project-member</nova:user>
Nov 29 05:59:13 user nova-compute[75083]:         <nova:project uuid="7833259e5df546ba86139af68fcb7906">tempest-ServerRescueNegativeTestJSON-1120078925</nova:project>
Nov 29 05:59:13 user nova-compute[75083]:       </nova:owner>
Nov 29 05:59:13 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:59:13 user nova-compute[75083]:       <nova:ports>
Nov 29 05:59:13 user nova-compute[75083]:         <nova:port uuid="1f259ece-bce2-4aab-925b-26e4f9619fbf">
Nov 29 05:59:13 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 05:59:13 user nova-compute[75083]:         </nova:port>
Nov 29 05:59:13 user nova-compute[75083]:       </nova:ports>
Nov 29 05:59:13 user nova-compute[75083]:     </nova:instance>
Nov 29 05:59:13 user nova-compute[75083]:   </metadata>
Nov 29 05:59:13 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:59:13 user nova-compute[75083]:     <system>
Nov 29 05:59:13 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:59:13 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:59:13 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:59:13 user nova-compute[75083]:       <entry name="serial">4435ed78-e35f-4859-8a4f-9920815d968a</entry>
Nov 29 05:59:13 user nova-compute[75083]:       <entry name="uuid">4435ed78-e35f-4859-8a4f-9920815d968a</entry>
Nov 29 05:59:13 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:59:13 user nova-compute[75083]:     </system>
Nov 29 05:59:13 user nova-compute[75083]:   </sysinfo>
Nov 29 05:59:13 user nova-compute[75083]:   <os>
Nov 29 05:59:13 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:59:13 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:59:13 user nova-compute[75083]:   </os>
Nov 29 05:59:13 user nova-compute[75083]:   <features>
Nov 29 05:59:13 user nova-compute[75083]:     <acpi/>
Nov 29 05:59:13 user nova-compute[75083]:     <apic/>
Nov 29 05:59:13 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:59:13 user nova-compute[75083]:   </features>
Nov 29 05:59:13 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:59:13 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:59:13 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:59:13 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:59:13 user nova-compute[75083]:   </clock>
Nov 29 05:59:13 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:59:13 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:59:13 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:59:13 user nova-compute[75083]:   </cpu>
Nov 29 05:59:13 user nova-compute[75083]:   <devices>
Nov 29 05:59:13 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:59:13 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:59:13 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk.rescue"/>
Nov 29 05:59:13 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:59:13 user nova-compute[75083]:     </disk>
Nov 29 05:59:13 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:59:13 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:59:13 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk"/>
Nov 29 05:59:13 user nova-compute[75083]:       <target dev="vdb" bus="virtio"/>
Nov 29 05:59:13 user nova-compute[75083]:     </disk>
Nov 29 05:59:13 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:59:13 user nova-compute[75083]:       <mac address="fa:16:3e:8d:3b:2a"/>
Nov 29 05:59:13 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:59:13 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:59:13 user nova-compute[75083]:       <target dev="tap1f259ece-bc"/>
Nov 29 05:59:13 user nova-compute[75083]:     </interface>
Nov 29 05:59:13 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:59:13 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/console.log" append="off"/>
Nov 29 05:59:13 user nova-compute[75083]:     </serial>
Nov 29 05:59:13 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:59:13 user nova-compute[75083]:     <video>
Nov 29 05:59:13 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:59:13 user nova-compute[75083]:     </video>
Nov 29 05:59:13 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:59:13 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:59:13 user nova-compute[75083]:     </rng>
Nov 29 05:59:13 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:59:13 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:59:13 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:59:13 user nova-compute[75083]:     </memballoon>
Nov 29 05:59:13 user nova-compute[75083]:   </devices>
Nov 29 05:59:13 user nova-compute[75083]: </domain>
Nov 29 05:59:13 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:59:13 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Instance destroyed successfully.
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:59:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] No VIF found with MAC fa:16:3e:8d:3b:2a, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:59:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:14 user nova-compute[75083]: DEBUG nova.compute.manager [req-1c2829db-c5ed-4f6a-ac0b-3957b6b2ea0e req-7ec9d335-0bd7-47e8-84d0-4485e84c59d5 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received event network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:59:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-1c2829db-c5ed-4f6a-ac0b-3957b6b2ea0e req-7ec9d335-0bd7-47e8-84d0-4485e84c59d5 service nova] Acquiring lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-1c2829db-c5ed-4f6a-ac0b-3957b6b2ea0e req-7ec9d335-0bd7-47e8-84d0-4485e84c59d5 service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-1c2829db-c5ed-4f6a-ac0b-3957b6b2ea0e req-7ec9d335-0bd7-47e8-84d0-4485e84c59d5 service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:14 user nova-compute[75083]: DEBUG nova.compute.manager [req-1c2829db-c5ed-4f6a-ac0b-3957b6b2ea0e req-7ec9d335-0bd7-47e8-84d0-4485e84c59d5 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] No waiting events found dispatching network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:59:14 user nova-compute[75083]: WARNING nova.compute.manager [req-1c2829db-c5ed-4f6a-ac0b-3957b6b2ea0e req-7ec9d335-0bd7-47e8-84d0-4485e84c59d5 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received unexpected event network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf for instance with vm_state active and task_state rescuing.
Nov 29 05:59:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "2778daf0-f727-4185-a404-1793b75ac523" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "2778daf0-f727-4185-a404-1793b75ac523" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "2778daf0-f727-4185-a404-1793b75ac523-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "2778daf0-f727-4185-a404-1793b75ac523-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "2778daf0-f727-4185-a404-1793b75ac523-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:15 user nova-compute[75083]: INFO nova.compute.manager [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Terminating instance
Nov 29 05:59:15 user nova-compute[75083]: DEBUG nova.compute.manager [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:59:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG nova.compute.manager [req-b2e6cce7-87cf-4058-a8b7-5ead017da6cb req-235464c0-2ec9-43a3-ba4e-51f9562c923e service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received event network-vif-unplugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b2e6cce7-87cf-4058-a8b7-5ead017da6cb req-235464c0-2ec9-43a3-ba4e-51f9562c923e service nova] Acquiring lock "2778daf0-f727-4185-a404-1793b75ac523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b2e6cce7-87cf-4058-a8b7-5ead017da6cb req-235464c0-2ec9-43a3-ba4e-51f9562c923e service nova] Lock "2778daf0-f727-4185-a404-1793b75ac523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b2e6cce7-87cf-4058-a8b7-5ead017da6cb req-235464c0-2ec9-43a3-ba4e-51f9562c923e service nova] Lock "2778daf0-f727-4185-a404-1793b75ac523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG nova.compute.manager [req-b2e6cce7-87cf-4058-a8b7-5ead017da6cb req-235464c0-2ec9-43a3-ba4e-51f9562c923e service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] No waiting events found dispatching network-vif-unplugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG nova.compute.manager [req-b2e6cce7-87cf-4058-a8b7-5ead017da6cb req-235464c0-2ec9-43a3-ba4e-51f9562c923e service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received event network-vif-unplugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG nova.compute.manager [req-6b4228b6-87f2-4994-879c-b9ee2c0afa1b req-c37aff18-553c-489b-b17d-b4f2eb93337d service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received event network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6b4228b6-87f2-4994-879c-b9ee2c0afa1b req-c37aff18-553c-489b-b17d-b4f2eb93337d service nova] Acquiring lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6b4228b6-87f2-4994-879c-b9ee2c0afa1b req-c37aff18-553c-489b-b17d-b4f2eb93337d service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6b4228b6-87f2-4994-879c-b9ee2c0afa1b req-c37aff18-553c-489b-b17d-b4f2eb93337d service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG nova.compute.manager [req-6b4228b6-87f2-4994-879c-b9ee2c0afa1b req-c37aff18-553c-489b-b17d-b4f2eb93337d service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] No waiting events found dispatching network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:59:16 user nova-compute[75083]: WARNING nova.compute.manager [req-6b4228b6-87f2-4994-879c-b9ee2c0afa1b req-c37aff18-553c-489b-b17d-b4f2eb93337d service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received unexpected event network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf for instance with vm_state active and task_state rescuing.
Nov 29 05:59:16 user nova-compute[75083]: DEBUG nova.compute.manager [req-6b4228b6-87f2-4994-879c-b9ee2c0afa1b req-c37aff18-553c-489b-b17d-b4f2eb93337d service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received event network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6b4228b6-87f2-4994-879c-b9ee2c0afa1b req-c37aff18-553c-489b-b17d-b4f2eb93337d service nova] Acquiring lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6b4228b6-87f2-4994-879c-b9ee2c0afa1b req-c37aff18-553c-489b-b17d-b4f2eb93337d service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6b4228b6-87f2-4994-879c-b9ee2c0afa1b req-c37aff18-553c-489b-b17d-b4f2eb93337d service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG nova.compute.manager [req-6b4228b6-87f2-4994-879c-b9ee2c0afa1b req-c37aff18-553c-489b-b17d-b4f2eb93337d service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] No waiting events found dispatching network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:59:16 user nova-compute[75083]: WARNING nova.compute.manager [req-6b4228b6-87f2-4994-879c-b9ee2c0afa1b req-c37aff18-553c-489b-b17d-b4f2eb93337d service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received unexpected event network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf for instance with vm_state active and task_state rescuing.
Nov 29 05:59:16 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Instance destroyed successfully.
Nov 29 05:59:16 user nova-compute[75083]: DEBUG nova.objects.instance [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lazy-loading 'resources' on Instance uuid 2778daf0-f727-4185-a404-1793b75ac523 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T05:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-496298622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-496298622',id=19,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtQ1vuaaWUxtG/9G1YJRDY4MUN2av+CuZbcDT4uGJgXHg4z4ZIrmTihKhSMv3O5tWX5AEk0FPMj1glQqi3+hqk5VH/afqDYN9j0lutfv7odS3an+4n1UEM6ZjECj8n+og==',key_name='tempest-keypair-1008779938',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:57:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1c63c54083f4a0eba38539e7c196d61',ramdisk_id='',reservation_id='r-c9eon0oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-961204558',owner_user_name='tempest-AttachVolumeShelveTestJSON-961204558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:57:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4e6b7adfb1b469ab5c6c3f26633272a',uuid=2778daf0-f727-4185-a404-1793b75ac523,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converting VIF {"id": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "address": "fa:16:3e:81:89:b6", "network": {"id": "03360516-b90f-4dd8-a675-05903d2d70fd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-185016754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c63c54083f4a0eba38539e7c196d61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ddd3c7-1b", "ovs_interfaceid": "f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:89:b6,bridge_name='br-int',has_traffic_filtering=True,id=f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ddd3c7-1b') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG os_vif [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:89:b6,bridge_name='br-int',has_traffic_filtering=True,id=f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ddd3c7-1b') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5ddd3c7-1b, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0afa9741-0046-4912-9ae6-c02465f326b9) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:16 user nova-compute[75083]: INFO os_vif [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:89:b6,bridge_name='br-int',has_traffic_filtering=True,id=f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9,network=Network(03360516-b90f-4dd8-a675-05903d2d70fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ddd3c7-1b')
Nov 29 05:59:16 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Deleting instance files /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523_del
Nov 29 05:59:16 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Deletion of /opt/stack/data/nova/instances/2778daf0-f727-4185-a404-1793b75ac523_del complete
Nov 29 05:59:16 user nova-compute[75083]: INFO nova.compute.manager [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 05:59:16 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 2778daf0-f727-4185-a404-1793b75ac523] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 05:59:16 user nova-compute[75083]: DEBUG nova.compute.manager [None req-43bc7bd8-bf44-4cf1-9084-b59d4148205d tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:59:17 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:59:17 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Took 1.12 seconds to deallocate network for instance.
Nov 29 05:59:17 user nova-compute[75083]: DEBUG nova.compute.manager [req-0def141f-f6a9-40d2-a970-9587458ec846 req-77e7bac2-1c40-4b4d-ba65-acf3f9603ddd service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received event network-vif-deleted-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:59:17 user nova-compute[75083]: INFO nova.compute.manager [req-0def141f-f6a9-40d2-a970-9587458ec846 req-77e7bac2-1c40-4b4d-ba65-acf3f9603ddd service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Neutron deleted interface f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9; detaching it from the instance and deleting it from the info cache
Nov 29 05:59:17 user nova-compute[75083]: DEBUG nova.network.neutron [req-0def141f-f6a9-40d2-a970-9587458ec846 req-77e7bac2-1c40-4b4d-ba65-acf3f9603ddd service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:59:17 user nova-compute[75083]: DEBUG nova.compute.manager [req-0def141f-f6a9-40d2-a970-9587458ec846 req-77e7bac2-1c40-4b4d-ba65-acf3f9603ddd service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Detach interface failed, port_id=f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9, reason: Instance 2778daf0-f727-4185-a404-1793b75ac523 could not be found. {{(pid=75083) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 05:59:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-62aa469a-3481-45d8-8b40-69c65c8cbbb7 req-7cd02716-8ca6-4030-8a6e-3dac1d10edc2 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received event network-vif-plugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:59:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-62aa469a-3481-45d8-8b40-69c65c8cbbb7 req-7cd02716-8ca6-4030-8a6e-3dac1d10edc2 service nova] Acquiring lock "2778daf0-f727-4185-a404-1793b75ac523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-62aa469a-3481-45d8-8b40-69c65c8cbbb7 req-7cd02716-8ca6-4030-8a6e-3dac1d10edc2 service nova] Lock "2778daf0-f727-4185-a404-1793b75ac523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-62aa469a-3481-45d8-8b40-69c65c8cbbb7 req-7cd02716-8ca6-4030-8a6e-3dac1d10edc2 service nova] Lock "2778daf0-f727-4185-a404-1793b75ac523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-62aa469a-3481-45d8-8b40-69c65c8cbbb7 req-7cd02716-8ca6-4030-8a6e-3dac1d10edc2 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] No waiting events found dispatching network-vif-plugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:59:18 user nova-compute[75083]: WARNING nova.compute.manager [req-62aa469a-3481-45d8-8b40-69c65c8cbbb7 req-7cd02716-8ca6-4030-8a6e-3dac1d10edc2 service nova] [instance: 2778daf0-f727-4185-a404-1793b75ac523] Received unexpected event network-vif-plugged-f5ddd3c7-1b61-4237-a3c8-655dff9b5bb9 for instance with vm_state deleted and task_state None.
Nov 29 05:59:18 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:59:18 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:59:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:18 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Deleted allocations for instance 2778daf0-f727-4185-a404-1793b75ac523
Nov 29 05:59:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-66935e05-5959-4646-8913-0b71c0dd5a16 tempest-AttachVolumeShelveTestJSON-961204558 tempest-AttachVolumeShelveTestJSON-961204558-project-member] Lock "2778daf0-f727-4185-a404-1793b75ac523" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.618s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUQOYwMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:59:19 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:59:19 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:59:19 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[35376d0d-470c-444a-ba7e-9120e7c8cfaa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:59:19 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d26643-fdcd-4d71-8a59-15eb3f74060b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401] added
Nov 29 05:59:19 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e566e066-e758-47fa-9009-18b9576e7cec]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5814ce-d85a-4c47-8775-87cffa75112c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eUQOYwMr {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eUQOYwMr" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae7dd08-0e5c-41b2-9b91-cf86cc792068]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eUQOYwMr'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ccbfb9-13d8-4e7b-9b46-f71ff606e53c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d17e04-4ed1-4f92-b940-a5587c900b94]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:59:19 user nova-compute[75083]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 05:59:19 user nova-compute[75083]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 (non-flash)
Nov 29 05:59:19 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:59:19 user nova-compute[75083]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 05:59:19 user nova-compute[75083]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 (non-flash)
Nov 29 05:59:19 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9460ec27-c19a-4025-8ca6-555390ede7b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401, portal: 172.16.0.220,3260]
Nov 29 05:59:19 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401, portal: 172.16.0.220,3260] successful.
Nov 29 05:59:19 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc07e55-a748-4129-a491-b0ca4140b61e]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f93733f-b022-4597-ba6e-46a545912a3c]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:59:19 user nova-compute[75083]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 05:59:19 user nova-compute[75083]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 (non-flash)
Nov 29 05:59:19 user nova-compute[75083]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)
Nov 29 05:59:19 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:59:19 user nova-compute[75083]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 05:59:19 user nova-compute[75083]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 (non-flash)
Nov 29 05:59:19 user nova-compute[75083]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)
Nov 29 05:59:19 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ae1d98-6e35-4d28-9af8-d4968916f5fa]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:19 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: None {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:59:20 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:59:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUQOYwMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:59:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:59:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23335383163333062', 'path': '/dev/sde'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:59:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335383163333062', 'path': '/dev/sde'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:59:20 user nova-compute[75083]: DEBUG nova.objects.instance [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'flavor' on Instance uuid c1baf96b-be32-42f1-85a8-9b2321226199 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:59:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 05:59:20 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:59:20 user nova-compute[75083]:   <source dev="/dev/sde"/>
Nov 29 05:59:20 user nova-compute[75083]:   <target dev="vdc" bus="virtio"/>
Nov 29 05:59:20 user nova-compute[75083]:   <serial>8fb43125-c0b4-4155-8c9f-8b8320923401</serial>
Nov 29 05:59:20 user nova-compute[75083]: </disk>
Nov 29 05:59:20 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 05:59:21 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:59:21 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:59:21 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:59:21 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] No VIF found with MAC fa:16:3e:50:1a:f0, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:59:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0056df35-c607-4f8a-a59c-fbcc2acd4d80 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "c1baf96b-be32-42f1-85a8-9b2321226199" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.213s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "c1baf96b-be32-42f1-85a8-9b2321226199" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "c1baf96b-be32-42f1-85a8-9b2321226199" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:22 user nova-compute[75083]: INFO nova.compute.manager [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Detaching volume 64303580-0ac1-4831-9e48-8baa9f572d42
Nov 29 05:59:22 user nova-compute[75083]: INFO nova.virt.block_device [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Attempting to driver detach volume 64303580-0ac1-4831-9e48-8baa9f572d42 from mountpoint /dev/vdb
Nov 29 05:59:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Attempting to detach device vdb from instance c1baf96b-be32-42f1-85a8-9b2321226199 from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 05:59:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:59:22 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:59:22 user nova-compute[75083]:   <source dev="/dev/sdd"/>
Nov 29 05:59:22 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:59:22 user nova-compute[75083]:   <serial>64303580-0ac1-4831-9e48-8baa9f572d42</serial>
Nov 29 05:59:22 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 05:59:22 user nova-compute[75083]: </disk>
Nov 29 05:59:22 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:59:22 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Successfully detached device vdb from instance c1baf96b-be32-42f1-85a8-9b2321226199 from the persistent domain config.
Nov 29 05:59:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c1baf96b-be32-42f1-85a8-9b2321226199 from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 05:59:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:59:22 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:59:22 user nova-compute[75083]:   <source dev="/dev/sdd"/>
Nov 29 05:59:22 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 05:59:22 user nova-compute[75083]:   <serial>64303580-0ac1-4831-9e48-8baa9f572d42</serial>
Nov 29 05:59:22 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 05:59:22 user nova-compute[75083]: </disk>
Nov 29 05:59:22 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:59:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c1baf96b-be32-42f1-85a8-9b2321226199 {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 05:59:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 05:59:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:59:38 user nova-compute[75083]: INFO nova.compute.claims [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Claim successful on node user
Nov 29 05:59:39 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:59:39 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:59:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:39 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 05:59:39 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 05:59:39 user nova-compute[75083]: DEBUG nova.network.neutron [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 05:59:39 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 05:59:39 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 05:59:39 user nova-compute[75083]: DEBUG nova.policy [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4145bf5a07ea4d398f1a1e10a976c10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47694ecf400b4d6c952d0c06d0764d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 05:59:39 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 05:59:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 05:59:39 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Creating image(s)
Nov 29 05:59:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "/opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "/opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "/opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:39 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:39 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:39 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:39 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:39 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:39 user nova-compute[75083]: DEBUG nova.network.neutron [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Successfully created port: 4cb2c35d-ef8d-47dd-b985-9d56cd1960bc {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk 1073741824" returned: 0 in 0.128s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.188s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Cannot resize image /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Ensure instance console log exists: /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG nova.network.neutron [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Successfully updated port: 4cb2c35d-ef8d-47dd-b985-9d56cd1960bc {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "refresh_cache-b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquired lock "refresh_cache-b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG nova.network.neutron [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-70492ac9-5de7-4b3f-bebe-abd1e35e4793 req-19694dad-0501-4be2-ab02-5656e001158d service nova] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Received event network-changed-4cb2c35d-ef8d-47dd-b985-9d56cd1960bc {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-70492ac9-5de7-4b3f-bebe-abd1e35e4793 req-19694dad-0501-4be2-ab02-5656e001158d service nova] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Refreshing instance network info cache due to event network-changed-4cb2c35d-ef8d-47dd-b985-9d56cd1960bc. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-70492ac9-5de7-4b3f-bebe-abd1e35e4793 req-19694dad-0501-4be2-ab02-5656e001158d service nova] Acquiring lock "refresh_cache-b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:59:40 user nova-compute[75083]: DEBUG nova.network.neutron [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.network.neutron [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Updating instance_info_cache with network_info: [{"id": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "address": "fa:16:3e:8a:f0:ed", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb2c35d-ef", "ovs_interfaceid": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Releasing lock "refresh_cache-b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Instance network_info: |[{"id": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "address": "fa:16:3e:8a:f0:ed", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb2c35d-ef", "ovs_interfaceid": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-70492ac9-5de7-4b3f-bebe-abd1e35e4793 req-19694dad-0501-4be2-ab02-5656e001158d service nova] Acquired lock "refresh_cache-b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.network.neutron [req-70492ac9-5de7-4b3f-bebe-abd1e35e4793 req-19694dad-0501-4be2-ab02-5656e001158d service nova] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Refreshing network info cache for port 4cb2c35d-ef8d-47dd-b985-9d56cd1960bc {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Start _get_guest_xml network_info=[{"id": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "address": "fa:16:3e:8a:f0:ed", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb2c35d-ef", "ovs_interfaceid": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:59:41 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:59:41 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:59:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1553528728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1553528728',id=28,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47694ecf400b4d6c952d0c06d0764d1b',ramdisk_id='',reservation_id='r-0x1qk8kw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:59:39Z,user_data=None,user_id='4145bf5a07ea4d398f1a1e10a976c10f',uuid=b57a4494-f14e-4cac-8d0b-c0a4416b0bb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "address": "fa:16:3e:8a:f0:ed", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb2c35d-ef", "ovs_interfaceid": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converting VIF {"id": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "address": "fa:16:3e:8a:f0:ed", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb2c35d-ef", "ovs_interfaceid": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:f0:ed,bridge_name='br-int',has_traffic_filtering=True,id=4cb2c35d-ef8d-47dd-b985-9d56cd1960bc,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb2c35d-ef') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.objects.instance [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'pci_devices' on Instance uuid b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:59:41 user nova-compute[75083]:   <uuid>b57a4494-f14e-4cac-8d0b-c0a4416b0bb5</uuid>
Nov 29 05:59:41 user nova-compute[75083]:   <name>instance-0000001c</name>
Nov 29 05:59:41 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 05:59:41 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:59:41 user nova-compute[75083]:   <metadata>
Nov 29 05:59:41 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:59:41 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:59:41 user nova-compute[75083]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1553528728</nova:name>
Nov 29 05:59:41 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:59:41</nova:creationTime>
Nov 29 05:59:41 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 05:59:41 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 05:59:41 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 05:59:41 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:59:41 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:59:41 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:59:41 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:59:41 user nova-compute[75083]:       <nova:owner>
Nov 29 05:59:41 user nova-compute[75083]:         <nova:user uuid="4145bf5a07ea4d398f1a1e10a976c10f">tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member</nova:user>
Nov 29 05:59:41 user nova-compute[75083]:         <nova:project uuid="47694ecf400b4d6c952d0c06d0764d1b">tempest-ServerBootFromVolumeStableRescueTest-1530350051</nova:project>
Nov 29 05:59:41 user nova-compute[75083]:       </nova:owner>
Nov 29 05:59:41 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 05:59:41 user nova-compute[75083]:       <nova:ports>
Nov 29 05:59:41 user nova-compute[75083]:         <nova:port uuid="4cb2c35d-ef8d-47dd-b985-9d56cd1960bc">
Nov 29 05:59:41 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 05:59:41 user nova-compute[75083]:         </nova:port>
Nov 29 05:59:41 user nova-compute[75083]:       </nova:ports>
Nov 29 05:59:41 user nova-compute[75083]:     </nova:instance>
Nov 29 05:59:41 user nova-compute[75083]:   </metadata>
Nov 29 05:59:41 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:59:41 user nova-compute[75083]:     <system>
Nov 29 05:59:41 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:59:41 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:59:41 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:59:41 user nova-compute[75083]:       <entry name="serial">b57a4494-f14e-4cac-8d0b-c0a4416b0bb5</entry>
Nov 29 05:59:41 user nova-compute[75083]:       <entry name="uuid">b57a4494-f14e-4cac-8d0b-c0a4416b0bb5</entry>
Nov 29 05:59:41 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:59:41 user nova-compute[75083]:     </system>
Nov 29 05:59:41 user nova-compute[75083]:   </sysinfo>
Nov 29 05:59:41 user nova-compute[75083]:   <os>
Nov 29 05:59:41 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:59:41 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:59:41 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:59:41 user nova-compute[75083]:   </os>
Nov 29 05:59:41 user nova-compute[75083]:   <features>
Nov 29 05:59:41 user nova-compute[75083]:     <acpi/>
Nov 29 05:59:41 user nova-compute[75083]:     <apic/>
Nov 29 05:59:41 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:59:41 user nova-compute[75083]:   </features>
Nov 29 05:59:41 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:59:41 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:59:41 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:59:41 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:59:41 user nova-compute[75083]:   </clock>
Nov 29 05:59:41 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:59:41 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:59:41 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:59:41 user nova-compute[75083]:   </cpu>
Nov 29 05:59:41 user nova-compute[75083]:   <devices>
Nov 29 05:59:41 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 05:59:41 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 05:59:41 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk"/>
Nov 29 05:59:41 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:59:41 user nova-compute[75083]:     </disk>
Nov 29 05:59:41 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:59:41 user nova-compute[75083]:       <mac address="fa:16:3e:8a:f0:ed"/>
Nov 29 05:59:41 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:59:41 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:59:41 user nova-compute[75083]:       <target dev="tap4cb2c35d-ef"/>
Nov 29 05:59:41 user nova-compute[75083]:     </interface>
Nov 29 05:59:41 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:59:41 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/console.log" append="off"/>
Nov 29 05:59:41 user nova-compute[75083]:     </serial>
Nov 29 05:59:41 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:59:41 user nova-compute[75083]:     <video>
Nov 29 05:59:41 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:59:41 user nova-compute[75083]:     </video>
Nov 29 05:59:41 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:59:41 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:59:41 user nova-compute[75083]:     </rng>
Nov 29 05:59:41 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:59:41 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:59:41 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:59:41 user nova-compute[75083]:     </memballoon>
Nov 29 05:59:41 user nova-compute[75083]:   </devices>
Nov 29 05:59:41 user nova-compute[75083]: </domain>
Nov 29 05:59:41 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:59:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1553528728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1553528728',id=28,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47694ecf400b4d6c952d0c06d0764d1b',ramdisk_id='',reservation_id='r-0x1qk8kw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:59:39Z,user_data=None,user_id='4145bf5a07ea4d398f1a1e10a976c10f',uuid=b57a4494-f14e-4cac-8d0b-c0a4416b0bb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "address": "fa:16:3e:8a:f0:ed", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb2c35d-ef", "ovs_interfaceid": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converting VIF {"id": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "address": "fa:16:3e:8a:f0:ed", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb2c35d-ef", "ovs_interfaceid": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:f0:ed,bridge_name='br-int',has_traffic_filtering=True,id=4cb2c35d-ef8d-47dd-b985-9d56cd1960bc,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb2c35d-ef') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG os_vif [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:f0:ed,bridge_name='br-int',has_traffic_filtering=True,id=4cb2c35d-ef8d-47dd-b985-9d56cd1960bc,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb2c35d-ef') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e6340f6-76da-53d0-a4f7-19c6365c96a6', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cb2c35d-ef, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4cb2c35d-ef, col_values=(('qos', UUID('b72f050b-4a39-4b89-a49e-1fd5b10fb122')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4cb2c35d-ef, col_values=(('external_ids', {'iface-id': '4cb2c35d-ef8d-47dd-b985-9d56cd1960bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:f0:ed', 'vm-uuid': 'b57a4494-f14e-4cac-8d0b-c0a4416b0bb5'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:59:41 user nova-compute[75083]: INFO os_vif [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:f0:ed,bridge_name='br-int',has_traffic_filtering=True,id=4cb2c35d-ef8d-47dd-b985-9d56cd1960bc,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb2c35d-ef')
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] No VIF found with MAC fa:16:3e:8a:f0:ed, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.network.neutron [req-70492ac9-5de7-4b3f-bebe-abd1e35e4793 req-19694dad-0501-4be2-ab02-5656e001158d service nova] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Updated VIF entry in instance network info cache for port 4cb2c35d-ef8d-47dd-b985-9d56cd1960bc. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG nova.network.neutron [req-70492ac9-5de7-4b3f-bebe-abd1e35e4793 req-19694dad-0501-4be2-ab02-5656e001158d service nova] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Updating instance_info_cache with network_info: [{"id": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "address": "fa:16:3e:8a:f0:ed", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb2c35d-ef", "ovs_interfaceid": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:59:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-70492ac9-5de7-4b3f-bebe-abd1e35e4793 req-19694dad-0501-4be2-ab02-5656e001158d service nova] Releasing lock "refresh_cache-b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:59:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-08a9f073-ccd6-49ec-954f-6eed8e0cdff6 req-aa93d8fb-11b9-49ab-9d31-d75936f6b998 service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Received event network-changed-188d4866-21b0-4a1e-a17a-c0c82e849726 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:59:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-08a9f073-ccd6-49ec-954f-6eed8e0cdff6 req-aa93d8fb-11b9-49ab-9d31-d75936f6b998 service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Refreshing instance network info cache due to event network-changed-188d4866-21b0-4a1e-a17a-c0c82e849726. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:59:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-08a9f073-ccd6-49ec-954f-6eed8e0cdff6 req-aa93d8fb-11b9-49ab-9d31-d75936f6b998 service nova] Acquiring lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:59:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-08a9f073-ccd6-49ec-954f-6eed8e0cdff6 req-aa93d8fb-11b9-49ab-9d31-d75936f6b998 service nova] Acquired lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:59:42 user nova-compute[75083]: DEBUG nova.network.neutron [req-08a9f073-ccd6-49ec-954f-6eed8e0cdff6 req-aa93d8fb-11b9-49ab-9d31-d75936f6b998 service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Refreshing network info cache for port 188d4866-21b0-4a1e-a17a-c0c82e849726 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:59:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:42 user nova-compute[75083]: DEBUG nova.network.neutron [req-08a9f073-ccd6-49ec-954f-6eed8e0cdff6 req-aa93d8fb-11b9-49ab-9d31-d75936f6b998 service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Updated VIF entry in instance network info cache for port 188d4866-21b0-4a1e-a17a-c0c82e849726. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:59:42 user nova-compute[75083]: DEBUG nova.network.neutron [req-08a9f073-ccd6-49ec-954f-6eed8e0cdff6 req-aa93d8fb-11b9-49ab-9d31-d75936f6b998 service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Updating instance_info_cache with network_info: [{"id": "188d4866-21b0-4a1e-a17a-c0c82e849726", "address": "fa:16:3e:a8:14:4a", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d4866-21", "ovs_interfaceid": "188d4866-21b0-4a1e-a17a-c0c82e849726", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:59:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-08a9f073-ccd6-49ec-954f-6eed8e0cdff6 req-aa93d8fb-11b9-49ab-9d31-d75936f6b998 service nova] Releasing lock "refresh_cache-161c6455-90ce-4c40-a33e-7f582989135d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:59:43 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c1baf96b-be32-42f1-85a8-9b2321226199 is timed out.
Nov 29 05:59:43 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Successfully detached device vdb from instance c1baf96b-be32-42f1-85a8-9b2321226199 from the live domain config.
Nov 29 05:59:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goIYKUiJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:59:43 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:59:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[570654d2-bc1b-4342-81b7-d44d1fd0fa67]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:59:43 user nova-compute[75083]: No targets found.
Nov 29 05:59:43 user nova-compute[75083]: iSNS:
Nov 29 05:59:43 user nova-compute[75083]: No targets found.
Nov 29 05:59:43 user nova-compute[75083]: STATIC:
Nov 29 05:59:43 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42
Nov 29 05:59:43 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:59:43 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:59:43 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1
Nov 29 05:59:43 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:59:43 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:59:43 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401
Nov 29 05:59:43 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:59:43 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:59:43 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4
Nov 29 05:59:43 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:59:43 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:59:43 user nova-compute[75083]: FIRMWARE:
Nov 29 05:59:43 user nova-compute[75083]: No targets found.
Nov 29 05:59:43 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:59:43 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:59:43 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[be74ceeb-a96e-467b-9726-c27a2b172ed5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5460fad6-5be1-4813-a313-34bc724e15b0]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:59:43 user nova-compute[75083]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 05:59:43 user nova-compute[75083]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 (non-flash)
Nov 29 05:59:43 user nova-compute[75083]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)
Nov 29 05:59:43 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:59:43 user nova-compute[75083]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 05:59:43 user nova-compute[75083]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 (non-flash)
Nov 29 05:59:43 user nova-compute[75083]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)
Nov 29 05:59:43 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0dc7ba5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42'): ({'sdd'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Removing single pathed devices sdd {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a77ff6-207f-431f-8c3b-e16995f70dda]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ff5ea7-1342-4e1c-ad14-b83f26cee8a6]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Flushing IO for device /dev/sdd {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef018cd-69e3-42f2-ba82-e4e6ee2c263b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[94599ad9-820e-4656-b1dc-637e95582fcc]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] SCSI volumes sdd have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[723674a3-7ddd-467b-9420-7437e44ad26c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a06d3fc-3537-44d8-8d09-89697c641663]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42, portal: 172.16.0.220,3260]
Nov 29 05:59:43 user nova-compute[75083]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42, portal: 172.16.0.220,3260] successful.
Nov 29 05:59:43 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64303580-0ac1-4831-9e48-8baa9f572d42 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30185cc-e6ab-4b2c-922d-841e3156c26b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] <== disconnect_volume: return (368ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG nova.compute.manager [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Stashing vm_state: active {{(pid=75083) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:43 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 05:59:43 user nova-compute[75083]: INFO nova.compute.claims [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Claim successful on node user
Nov 29 05:59:43 user nova-compute[75083]: INFO nova.compute.resource_tracker [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Updating resource usage from migration 49e09399-1a55-4d89-8ea2-7b2c618edfcd
Nov 29 05:59:44 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:59:44 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:59:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.488s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:44 user nova-compute[75083]: INFO nova.compute.manager [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Migrating
Nov 29 05:59:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:59:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquired lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:59:44 user nova-compute[75083]: DEBUG nova.network.neutron [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:59:44 user nova-compute[75083]: DEBUG nova.compute.manager [req-24439a34-dfc9-4d70-81f5-763a2ba5ee85 req-666a55f1-7ff0-4da8-a45e-f555f4621046 service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Received event network-changed-5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:59:44 user nova-compute[75083]: DEBUG nova.compute.manager [req-24439a34-dfc9-4d70-81f5-763a2ba5ee85 req-666a55f1-7ff0-4da8-a45e-f555f4621046 service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Refreshing instance network info cache due to event network-changed-5c054e6a-71b8-4b15-8153-356638de21d7. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 05:59:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-24439a34-dfc9-4d70-81f5-763a2ba5ee85 req-666a55f1-7ff0-4da8-a45e-f555f4621046 service nova] Acquiring lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:59:44 user nova-compute[75083]: DEBUG nova.objects.instance [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'flavor' on Instance uuid c1baf96b-be32-42f1-85a8-9b2321226199 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:59:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d07a8195-0262-4470-8c6e-1d1734788469 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "c1baf96b-be32-42f1-85a8-9b2321226199" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.905s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:44 user nova-compute[75083]: DEBUG nova.network.neutron [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Updating instance_info_cache with network_info: [{"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:59:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Releasing lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:59:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-24439a34-dfc9-4d70-81f5-763a2ba5ee85 req-666a55f1-7ff0-4da8-a45e-f555f4621046 service nova] Acquired lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:59:44 user nova-compute[75083]: DEBUG nova.network.neutron [req-24439a34-dfc9-4d70-81f5-763a2ba5ee85 req-666a55f1-7ff0-4da8-a45e-f555f4621046 service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Refreshing network info cache for port 5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 05:59:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Starting migrate_disk_and_power_off {{(pid=75083) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 05:59:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-6f603e04-a373-42b6-8140-f885ef3a7dcd req-11a43500-2ac6-4ea3-b7aa-e49752d85a96 service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Received event network-vif-unplugged-5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6f603e04-a373-42b6-8140-f885ef3a7dcd req-11a43500-2ac6-4ea3-b7aa-e49752d85a96 service nova] Acquiring lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6f603e04-a373-42b6-8140-f885ef3a7dcd req-11a43500-2ac6-4ea3-b7aa-e49752d85a96 service nova] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6f603e04-a373-42b6-8140-f885ef3a7dcd req-11a43500-2ac6-4ea3-b7aa-e49752d85a96 service nova] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-6f603e04-a373-42b6-8140-f885ef3a7dcd req-11a43500-2ac6-4ea3-b7aa-e49752d85a96 service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] No waiting events found dispatching network-vif-unplugged-5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:59:45 user nova-compute[75083]: WARNING nova.compute.manager [req-6f603e04-a373-42b6-8140-f885ef3a7dcd req-11a43500-2ac6-4ea3-b7aa-e49752d85a96 service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Received unexpected event network-vif-unplugged-5c054e6a-71b8-4b15-8153-356638de21d7 for instance with vm_state active and task_state resize_migrating.
Nov 29 05:59:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 05:59:45 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Instance spawned successfully.
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 05:59:45 user nova-compute[75083]: INFO nova.compute.manager [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 05:59:45 user nova-compute[75083]: INFO nova.compute.manager [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Took 6.44 seconds to build instance.
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8c4522c4-78af-4faf-9019-fae2df82f01c tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.538s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "c1baf96b-be32-42f1-85a8-9b2321226199" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "c1baf96b-be32-42f1-85a8-9b2321226199" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:45 user nova-compute[75083]: INFO nova.compute.manager [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Detaching volume 8fb43125-c0b4-4155-8c9f-8b8320923401
Nov 29 05:59:45 user nova-compute[75083]: INFO nova.virt.block_device [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Attempting to driver detach volume 8fb43125-c0b4-4155-8c9f-8b8320923401 from mountpoint /dev/vdc
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Attempting to detach device vdc from instance c1baf96b-be32-42f1-85a8-9b2321226199 from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:59:45 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:59:45 user nova-compute[75083]:   <source dev="/dev/sde"/>
Nov 29 05:59:45 user nova-compute[75083]:   <target dev="vdc" bus="virtio"/>
Nov 29 05:59:45 user nova-compute[75083]:   <serial>8fb43125-c0b4-4155-8c9f-8b8320923401</serial>
Nov 29 05:59:45 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 05:59:45 user nova-compute[75083]: </disk>
Nov 29 05:59:45 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:59:45 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Successfully detached device vdc from instance c1baf96b-be32-42f1-85a8-9b2321226199 from the persistent domain config.
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c1baf96b-be32-42f1-85a8-9b2321226199 from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 05:59:45 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:59:45 user nova-compute[75083]:   <source dev="/dev/sde"/>
Nov 29 05:59:45 user nova-compute[75083]:   <target dev="vdc" bus="virtio"/>
Nov 29 05:59:45 user nova-compute[75083]:   <serial>8fb43125-c0b4-4155-8c9f-8b8320923401</serial>
Nov 29 05:59:45 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 05:59:45 user nova-compute[75083]: </disk>
Nov 29 05:59:45 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.network.neutron [req-24439a34-dfc9-4d70-81f5-763a2ba5ee85 req-666a55f1-7ff0-4da8-a45e-f555f4621046 service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Updated VIF entry in instance network info cache for port 5c054e6a-71b8-4b15-8153-356638de21d7. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.network.neutron [req-24439a34-dfc9-4d70-81f5-763a2ba5ee85 req-666a55f1-7ff0-4da8-a45e-f555f4621046 service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Updating instance_info_cache with network_info: [{"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-24439a34-dfc9-4d70-81f5-763a2ba5ee85 req-666a55f1-7ff0-4da8-a45e-f555f4621046 service nova] Releasing lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-24439a34-dfc9-4d70-81f5-763a2ba5ee85 req-666a55f1-7ff0-4da8-a45e-f555f4621046 service nova] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Received event network-vif-plugged-4cb2c35d-ef8d-47dd-b985-9d56cd1960bc {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-24439a34-dfc9-4d70-81f5-763a2ba5ee85 req-666a55f1-7ff0-4da8-a45e-f555f4621046 service nova] Acquiring lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-24439a34-dfc9-4d70-81f5-763a2ba5ee85 req-666a55f1-7ff0-4da8-a45e-f555f4621046 service nova] Lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-24439a34-dfc9-4d70-81f5-763a2ba5ee85 req-666a55f1-7ff0-4da8-a45e-f555f4621046 service nova] Lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-24439a34-dfc9-4d70-81f5-763a2ba5ee85 req-666a55f1-7ff0-4da8-a45e-f555f4621046 service nova] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] No waiting events found dispatching network-vif-plugged-4cb2c35d-ef8d-47dd-b985-9d56cd1960bc {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:59:45 user nova-compute[75083]: WARNING nova.compute.manager [req-24439a34-dfc9-4d70-81f5-763a2ba5ee85 req-666a55f1-7ff0-4da8-a45e-f555f4621046 service nova] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Received unexpected event network-vif-plugged-4cb2c35d-ef8d-47dd-b985-9d56cd1960bc for instance with vm_state building and task_state spawning.
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-24439a34-dfc9-4d70-81f5-763a2ba5ee85 req-666a55f1-7ff0-4da8-a45e-f555f4621046 service nova] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Received event network-vif-plugged-4cb2c35d-ef8d-47dd-b985-9d56cd1960bc {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-24439a34-dfc9-4d70-81f5-763a2ba5ee85 req-666a55f1-7ff0-4da8-a45e-f555f4621046 service nova] Acquiring lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-24439a34-dfc9-4d70-81f5-763a2ba5ee85 req-666a55f1-7ff0-4da8-a45e-f555f4621046 service nova] Lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-24439a34-dfc9-4d70-81f5-763a2ba5ee85 req-666a55f1-7ff0-4da8-a45e-f555f4621046 service nova] Lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-24439a34-dfc9-4d70-81f5-763a2ba5ee85 req-666a55f1-7ff0-4da8-a45e-f555f4621046 service nova] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] No waiting events found dispatching network-vif-plugged-4cb2c35d-ef8d-47dd-b985-9d56cd1960bc {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:59:45 user nova-compute[75083]: WARNING nova.compute.manager [req-24439a34-dfc9-4d70-81f5-763a2ba5ee85 req-666a55f1-7ff0-4da8-a45e-f555f4621046 service nova] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Received unexpected event network-vif-plugged-4cb2c35d-ef8d-47dd-b985-9d56cd1960bc for instance with vm_state building and task_state spawning.
Nov 29 05:59:45 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Instance destroyed successfully.
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1662636095',display_name='tempest-ServerActionsTestOtherA-server-1662636095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1662636095',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/QARryHVy9tL0HspVgAb5d+hXfz/yMgw4/juPCBWiK9jONO+/KTLCL7Bj2On8DfV4bHN063zv9H1zJ2YV2YRCRWmcFlsfDLpgZRojBg+ehebykt/upaC2Fb+0QP3Sb0w==',key_name='tempest-keypair-908590560',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:58:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='95d0f3dd09bf436498e67d7bfdd904bf',ramdisk_id='',reservation_id='r-5gd7ljor',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2114836332',owner_user_name='tempest-ServerActionsTestOtherA-2114836332-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:59:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbd7f863ad7c4229957c4b08601b5003',uuid=18dc5c9c-8fb3-41c7-a124-4881788b3c48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1824387480-network", "vif_mac": "fa:16:3e:34:e7:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converting VIF {"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1824387480-network", "vif_mac": "fa:16:3e:34:e7:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:e7:fa,bridge_name='br-int',has_traffic_filtering=True,id=5c054e6a-71b8-4b15-8153-356638de21d7,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c054e6a-71') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_vif [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:e7:fa,bridge_name='br-int',has_traffic_filtering=True,id=5c054e6a-71b8-4b15-8153-356638de21d7,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c054e6a-71') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c054e6a-71, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69ca0104-1311-436e-aad7-82ffa45b3ba3) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:59:45 user nova-compute[75083]: INFO os_vif [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:e7:fa,bridge_name='br-int',has_traffic_filtering=True,id=5c054e6a-71b8-4b15-8153-356638de21d7,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c054e6a-71')
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VBpGufml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:59:45 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaef362-e1bc-4e9e-ba73-3710e32206aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:59:45 user nova-compute[75083]: No targets found.
Nov 29 05:59:45 user nova-compute[75083]: iSNS:
Nov 29 05:59:45 user nova-compute[75083]: No targets found.
Nov 29 05:59:45 user nova-compute[75083]: STATIC:
Nov 29 05:59:45 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1
Nov 29 05:59:45 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:59:45 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:59:45 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401
Nov 29 05:59:45 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:59:45 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:59:45 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4
Nov 29 05:59:45 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:59:45 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:59:45 user nova-compute[75083]: FIRMWARE:
Nov 29 05:59:45 user nova-compute[75083]: No targets found.
Nov 29 05:59:45 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:59:45 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:59:45 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6742725-4774-4b8c-9220-131b0a6e5f4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[033d80e5-f114-4ece-a663-4d4fbc0cf0af]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:59:45 user nova-compute[75083]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 05:59:45 user nova-compute[75083]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)
Nov 29 05:59:45 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:59:45 user nova-compute[75083]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 05:59:45 user nova-compute[75083]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)
Nov 29 05:59:45 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b87adb40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4'): ({'sdc'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Removing single pathed devices sdc {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61c0530-e334-4330-9811-78cfc9e694cb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d9591e-ff7d-4cda-920f-01f13293957a]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Flushing IO for device /dev/sdc {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9b91e1-82b9-40a7-a209-a581c322c9a0]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e50a92-bdc8-4b12-842a-dc71695e12a2]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3020fbac', '/dev/disk/by-id/scsi-1SCST_BIO3020fbac-1a3d8ddb7ade52d5', '/dev/disk/by-id/scsi-23161336438646462') {{(pid=86165) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa85677-d6e3-4264-a9ec-a4f2dbcf1fe6]: (4, None) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cea68ab-c311-4d3c-8250-ea784c5f8fde]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f59813-cf68-497e-acbd-aaa820ef1453]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4, portal: 172.16.0.220,3260]
Nov 29 05:59:45 user nova-compute[75083]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4, portal: 172.16.0.220,3260] successful.
Nov 29 05:59:45 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c1baf96b-be32-42f1-85a8-9b2321226199 {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c67540-36ac-45ff-bc3e-6f5de1a5b2c2]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:59:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] <== disconnect_volume: return (347ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:59:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:59:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 05:59:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG nova.network.neutron [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Port 5c054e6a-71b8-4b15-8153-356638de21d7 binding to destination host user is already ACTIVE {{(pid=75083) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG nova.compute.manager [req-8e2802f7-e4a8-4b88-9802-cdc8d0b132b5 req-36a21a8a-a7c5-4b7d-bc61-73a4c22b0ad4 service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Received event network-vif-plugged-5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8e2802f7-e4a8-4b88-9802-cdc8d0b132b5 req-36a21a8a-a7c5-4b7d-bc61-73a4c22b0ad4 service nova] Acquiring lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8e2802f7-e4a8-4b88-9802-cdc8d0b132b5 req-36a21a8a-a7c5-4b7d-bc61-73a4c22b0ad4 service nova] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8e2802f7-e4a8-4b88-9802-cdc8d0b132b5 req-36a21a8a-a7c5-4b7d-bc61-73a4c22b0ad4 service nova] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG nova.compute.manager [req-8e2802f7-e4a8-4b88-9802-cdc8d0b132b5 req-36a21a8a-a7c5-4b7d-bc61-73a4c22b0ad4 service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] No waiting events found dispatching network-vif-plugged-5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:59:47 user nova-compute[75083]: WARNING nova.compute.manager [req-8e2802f7-e4a8-4b88-9802-cdc8d0b132b5 req-36a21a8a-a7c5-4b7d-bc61-73a4c22b0ad4 service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Received unexpected event network-vif-plugged-5c054e6a-71b8-4b15-8153-356638de21d7 for instance with vm_state active and task_state resize_migrated.
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquired lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG nova.network.neutron [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG nova.network.neutron [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Updating instance_info_cache with network_info: [{"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Releasing lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG os_brick.utils [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d34d285-67b1-4a50-9811-ba9053c61d5f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51776c7-637e-4308-acc7-77bdb667d772]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18d694d-f9f7-4fe2-a99a-26b1ba91f993]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d697d098-98d2-414c-9627-b37256085132]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 05:59:47 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 05:59:47 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f827c517-41a5-4cf1-82d7-cdd3f1920cd4]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 05:59:47 user nova-compute[75083]: DEBUG os_brick.utils [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:59:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:55 user nova-compute[75083]: INFO nova.compute.manager [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Terminating instance
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-bcc76db9-edb8-4aa3-a70c-0ee693ef2bf2 req-01a8b5de-61a0-4d53-9cfb-a89a9e1d6dc8 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received event network-vif-unplugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bcc76db9-edb8-4aa3-a70c-0ee693ef2bf2 req-01a8b5de-61a0-4d53-9cfb-a89a9e1d6dc8 service nova] Acquiring lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bcc76db9-edb8-4aa3-a70c-0ee693ef2bf2 req-01a8b5de-61a0-4d53-9cfb-a89a9e1d6dc8 service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bcc76db9-edb8-4aa3-a70c-0ee693ef2bf2 req-01a8b5de-61a0-4d53-9cfb-a89a9e1d6dc8 service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-bcc76db9-edb8-4aa3-a70c-0ee693ef2bf2 req-01a8b5de-61a0-4d53-9cfb-a89a9e1d6dc8 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] No waiting events found dispatching network-vif-unplugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-bcc76db9-edb8-4aa3-a70c-0ee693ef2bf2 req-01a8b5de-61a0-4d53-9cfb-a89a9e1d6dc8 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received event network-vif-unplugged-388c9969-42dc-4e34-8fb8-c2399687751d for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Starting finish_migration {{(pid=75083) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Instance directory exists: not creating {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 05:59:55 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Creating image(s)
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Did not create local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Ensure instance console log exists: /opt/stack/data/nova/instances/18dc5c9c-8fb3-41c7-a124-4881788b3c48/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Start _get_guest_xml network_info=[{"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1824387480-network", "vif_mac": "fa:16:3e:34:e7:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '4591004e-d38e-4723-8345-12fcbc0f9279', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VBpGufml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '18dc5c9c-8fb3-41c7-a124-4881788b3c48', 'attached_at': '2023-11-29T05:59:55.000000', 'detached_at': '', 'volume_id': 'dd16d88f-6e45-4545-9260-ba380f6262e4', 'serial': 'dd16d88f-6e45-4545-9260-ba380f6262e4'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 05:59:55 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:59:55 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VBpGufml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:59:55 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:59:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:59:55 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:59:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:59:55 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[db834901-3836-456c-92cc-dc1060bada8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 05:59:55 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb82c075-8b73-4f2f-b59d-64b87ef03975]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4] added
Nov 29 05:59:55 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c10cba7-7029-41a6-93a0-f0a51f53a04b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82d9729-e30d-40af-94d2-1c305130768b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VBpGufml {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:55 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Instance destroyed successfully.
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.objects.instance [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lazy-loading 'resources' on Instance uuid fb8244c4-f2a7-4ad8-a210-0f62c165a4dc {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VBpGufml" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab4f3b7-9bb5-43b0-924d-40b2cf0899db]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VBpGufml'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:51:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1765064185',display_name='tempest-ServerActionsTestOtherB-server-1765064185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1765064185',id=15,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKfQt22BKdk3qqBMkdZDrlzUPc5OzBSJvBUhpD5lx0G7UqWh0HRdHS4+8i15ioAIjPFv14fiTBp00VBH9cOAzOvFWtO61YBHreoMNXT+V9qZ3bdKSP6OX3ggUHyDT/bOg==',key_name='tempest-keypair-1198752933',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:57:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41fbbebd414945beb2130f46013125d8',ramdisk_id='',reservation_id='r-349fa5rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1953829293',owner_user_name='tempest-ServerActionsTestOtherB-1953829293-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:57:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7f8a0e94feb47bb875ab4d7f1f2a2a1',uuid=fb8244c4-f2a7-4ad8-a210-0f62c165a4dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Converting VIF {"id": "388c9969-42dc-4e34-8fb8-c2399687751d", "address": "fa:16:3e:8c:af:fc", "network": {"id": "9c307a57-720d-419a-9a35-d3b85085b900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-940601225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41fbbebd414945beb2130f46013125d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388c9969-42", "ovs_interfaceid": "388c9969-42dc-4e34-8fb8-c2399687751d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG os_vif [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[257e4ef2-55d0-42c7-8b08-4c11b7c5d599]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap388c9969-42, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf0c061e-45bd-479b-8360-a681e8d44cb0) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:55 user nova-compute[75083]: INFO os_vif [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:af:fc,bridge_name='br-int',has_traffic_filtering=True,id=388c9969-42dc-4e34-8fb8-c2399687751d,network=Network(9c307a57-720d-419a-9a35-d3b85085b900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388c9969-42')
Nov 29 05:59:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNxDFkJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 05:59:55 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 05:59:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[475e0dcd-90b9-489e-ae79-9ffc7c27a93b]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:59:55 user nova-compute[75083]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)
Nov 29 05:59:55 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:59:55 user nova-compute[75083]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)
Nov 29 05:59:55 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:59:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[109478bf-9ce5-4da1-91ad-e2cf843c1f36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4, portal: 172.16.0.220,3260]
Nov 29 05:59:56 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4, portal: 172.16.0.220,3260] successful.
Nov 29 05:59:56 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[51caa25c-7ed3-4dce-bf02-a7c2ab4d83e8]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[176ddd89-c846-4269-9b58-452af4012adc]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:59:56 user nova-compute[75083]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)
Nov 29 05:59:56 user nova-compute[75083]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 05:59:56 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:59:56 user nova-compute[75083]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)
Nov 29 05:59:56 user nova-compute[75083]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 05:59:56 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[99059574-8ad0-4423-ace0-b3abc3309ee7]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 05:59:56 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VBpGufml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23161336438646462', 'path': '/dev/sdc'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161336438646462', 'path': '/dev/sdc'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.154s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8625f97-a291-4b23-8601-38c45d0c72da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 05:59:57 user nova-compute[75083]: No targets found.
Nov 29 05:59:57 user nova-compute[75083]: iSNS:
Nov 29 05:59:57 user nova-compute[75083]: No targets found.
Nov 29 05:59:57 user nova-compute[75083]: STATIC:
Nov 29 05:59:57 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1
Nov 29 05:59:57 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:59:57 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:59:57 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401
Nov 29 05:59:57 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:59:57 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:59:57 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4
Nov 29 05:59:57 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 05:59:57 user nova-compute[75083]:                 Iface Name: default
Nov 29 05:59:57 user nova-compute[75083]: FIRMWARE:
Nov 29 05:59:57 user nova-compute[75083]: No targets found.
Nov 29 05:59:57 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 05:59:57 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 05:59:57 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1662636095',display_name='tempest-ServerActionsTestOtherA-server-1662636095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1662636095',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/QARryHVy9tL0HspVgAb5d+hXfz/yMgw4/juPCBWiK9jONO+/KTLCL7Bj2On8DfV4bHN063zv9H1zJ2YV2YRCRWmcFlsfDLpgZRojBg+ehebykt/upaC2Fb+0QP3Sb0w==',key_name='tempest-keypair-908590560',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:58:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='95d0f3dd09bf436498e67d7bfdd904bf',ramdisk_id='',reservation_id='r-5gd7ljor',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2114836332',owner_user_name='tempest-ServerActionsTestOtherA-2114836332-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:59:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbd7f863ad7c4229957c4b08601b5003',uuid=18dc5c9c-8fb3-41c7-a124-4881788b3c48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1824387480-network", "vif_mac": "fa:16:3e:34:e7:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converting VIF {"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1824387480-network", "vif_mac": "fa:16:3e:34:e7:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:e7:fa,bridge_name='br-int',has_traffic_filtering=True,id=5c054e6a-71b8-4b15-8153-356638de21d7,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c054e6a-71') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] End _get_guest_xml xml=<domain type="kvm">
Nov 29 05:59:57 user nova-compute[75083]:   <uuid>18dc5c9c-8fb3-41c7-a124-4881788b3c48</uuid>
Nov 29 05:59:57 user nova-compute[75083]:   <name>instance-0000001a</name>
Nov 29 05:59:57 user nova-compute[75083]:   <memory>2097152</memory>
Nov 29 05:59:57 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 05:59:57 user nova-compute[75083]:   <metadata>
Nov 29 05:59:57 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 05:59:57 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 05:59:57 user nova-compute[75083]:       <nova:name>tempest-ServerActionsTestOtherA-server-1662636095</nova:name>
Nov 29 05:59:57 user nova-compute[75083]:       <nova:creationTime>2023-11-29 05:59:55</nova:creationTime>
Nov 29 05:59:57 user nova-compute[75083]:       <nova:flavor name="m1.small">
Nov 29 05:59:57 user nova-compute[75083]:         <nova:memory>2048</nova:memory>
Nov 29 05:59:57 user nova-compute[75083]:         <nova:disk>20</nova:disk>
Nov 29 05:59:57 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 05:59:57 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 05:59:57 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 05:59:57 user nova-compute[75083]:       </nova:flavor>
Nov 29 05:59:57 user nova-compute[75083]:       <nova:owner>
Nov 29 05:59:57 user nova-compute[75083]:         <nova:user uuid="cbd7f863ad7c4229957c4b08601b5003">tempest-ServerActionsTestOtherA-2114836332-project-member</nova:user>
Nov 29 05:59:57 user nova-compute[75083]:         <nova:project uuid="95d0f3dd09bf436498e67d7bfdd904bf">tempest-ServerActionsTestOtherA-2114836332</nova:project>
Nov 29 05:59:57 user nova-compute[75083]:       </nova:owner>
Nov 29 05:59:57 user nova-compute[75083]:       <nova:ports>
Nov 29 05:59:57 user nova-compute[75083]:         <nova:port uuid="5c054e6a-71b8-4b15-8153-356638de21d7">
Nov 29 05:59:57 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 05:59:57 user nova-compute[75083]:         </nova:port>
Nov 29 05:59:57 user nova-compute[75083]:       </nova:ports>
Nov 29 05:59:57 user nova-compute[75083]:     </nova:instance>
Nov 29 05:59:57 user nova-compute[75083]:   </metadata>
Nov 29 05:59:57 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 05:59:57 user nova-compute[75083]:     <system>
Nov 29 05:59:57 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 05:59:57 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 05:59:57 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 05:59:57 user nova-compute[75083]:       <entry name="serial">18dc5c9c-8fb3-41c7-a124-4881788b3c48</entry>
Nov 29 05:59:57 user nova-compute[75083]:       <entry name="uuid">18dc5c9c-8fb3-41c7-a124-4881788b3c48</entry>
Nov 29 05:59:57 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 05:59:57 user nova-compute[75083]:     </system>
Nov 29 05:59:57 user nova-compute[75083]:   </sysinfo>
Nov 29 05:59:57 user nova-compute[75083]:   <os>
Nov 29 05:59:57 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 05:59:57 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 05:59:57 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 05:59:57 user nova-compute[75083]:   </os>
Nov 29 05:59:57 user nova-compute[75083]:   <features>
Nov 29 05:59:57 user nova-compute[75083]:     <acpi/>
Nov 29 05:59:57 user nova-compute[75083]:     <apic/>
Nov 29 05:59:57 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 05:59:57 user nova-compute[75083]:   </features>
Nov 29 05:59:57 user nova-compute[75083]:   <clock offset="utc">
Nov 29 05:59:57 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 05:59:57 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 05:59:57 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 05:59:57 user nova-compute[75083]:   </clock>
Nov 29 05:59:57 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 05:59:57 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 05:59:57 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 05:59:57 user nova-compute[75083]:   </cpu>
Nov 29 05:59:57 user nova-compute[75083]:   <devices>
Nov 29 05:59:57 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 05:59:57 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 05:59:57 user nova-compute[75083]:       <source dev="/dev/sdc"/>
Nov 29 05:59:57 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 05:59:57 user nova-compute[75083]:       <serial>dd16d88f-6e45-4545-9260-ba380f6262e4</serial>
Nov 29 05:59:57 user nova-compute[75083]:     </disk>
Nov 29 05:59:57 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 05:59:57 user nova-compute[75083]:       <mac address="fa:16:3e:34:e7:fa"/>
Nov 29 05:59:57 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:59:57 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 05:59:57 user nova-compute[75083]:       <target dev="tap5c054e6a-71"/>
Nov 29 05:59:57 user nova-compute[75083]:     </interface>
Nov 29 05:59:57 user nova-compute[75083]:     <serial type="pty">
Nov 29 05:59:57 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/18dc5c9c-8fb3-41c7-a124-4881788b3c48/console.log" append="off"/>
Nov 29 05:59:57 user nova-compute[75083]:     </serial>
Nov 29 05:59:57 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 05:59:57 user nova-compute[75083]:     <video>
Nov 29 05:59:57 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 05:59:57 user nova-compute[75083]:     </video>
Nov 29 05:59:57 user nova-compute[75083]:     <rng model="virtio">
Nov 29 05:59:57 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 05:59:57 user nova-compute[75083]:     </rng>
Nov 29 05:59:57 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 05:59:57 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 05:59:57 user nova-compute[75083]:       <stats period="10"/>
Nov 29 05:59:57 user nova-compute[75083]:     </memballoon>
Nov 29 05:59:57 user nova-compute[75083]:   </devices>
Nov 29 05:59:57 user nova-compute[75083]: </domain>
Nov 29 05:59:57 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1662636095',display_name='tempest-ServerActionsTestOtherA-server-1662636095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1662636095',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/QARryHVy9tL0HspVgAb5d+hXfz/yMgw4/juPCBWiK9jONO+/KTLCL7Bj2On8DfV4bHN063zv9H1zJ2YV2YRCRWmcFlsfDLpgZRojBg+ehebykt/upaC2Fb+0QP3Sb0w==',key_name='tempest-keypair-908590560',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:58:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='95d0f3dd09bf436498e67d7bfdd904bf',ramdisk_id='',reservation_id='r-5gd7ljor',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2114836332',owner_user_name='tempest-ServerActionsTestOtherA-2114836332-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T05:59:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbd7f863ad7c4229957c4b08601b5003',uuid=18dc5c9c-8fb3-41c7-a124-4881788b3c48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1824387480-network", "vif_mac": "fa:16:3e:34:e7:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converting VIF {"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1824387480-network", "vif_mac": "fa:16:3e:34:e7:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:e7:fa,bridge_name='br-int',has_traffic_filtering=True,id=5c054e6a-71b8-4b15-8153-356638de21d7,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c054e6a-71') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_vif [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:e7:fa,bridge_name='br-int',has_traffic_filtering=True,id=5c054e6a-71b8-4b15-8153-356638de21d7,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c054e6a-71') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e23fc7-489a-48e6-abc5-8226f905618b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef427b46-7126-5f14-a676-0bde9ffaf3fd', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c054e6a-71, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c054e6a-71, col_values=(('qos', UUID('6d39c817-a5e0-4f34-8a3a-e7a01cce78ba')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c054e6a-71, col_values=(('external_ids', {'iface-id': '5c054e6a-71b8-4b15-8153-356638de21d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:e7:fa', 'vm-uuid': '18dc5c9c-8fb3-41c7-a124-4881788b3c48'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:57 user nova-compute[75083]: INFO os_vif [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:e7:fa,bridge_name='br-int',has_traffic_filtering=True,id=5c054e6a-71b8-4b15-8153-356638de21d7,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c054e6a-71')
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd9fd6d-40ca-4bba-8498-71d94c98457c]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:59:57 user nova-compute[75083]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)
Nov 29 05:59:57 user nova-compute[75083]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 05:59:57 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 (non-flash)
Nov 29 05:59:57 user nova-compute[75083]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)
Nov 29 05:59:57 user nova-compute[75083]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 05:59:57 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b8483130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a829ae-02e6-4ee7-b117-42c1167889db]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fd522e-e744-4564-a9c1-16a8ae85adc7]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] No VIF found with MAC fa:16:3e:34:e7:fa, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b2183d-1fd4-4eee-97d0-df600fbf4e65]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8300b446-cc90-4fa5-afa1-5c0a46cd2622]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[13511346-6890-46ab-aefe-660f9cefb651]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.040s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd9f4b9-584b-4c4c-bf64-475decde5a82]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260]
Nov 29 05:59:57 user nova-compute[75083]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1, portal: 172.16.0.220,3260] successful.
Nov 29 05:59:57 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1112c6-7998-4bf8-b679-c13dddd615a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa538612-290b-451d-a0f8-bb4370982aab]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] <== disconnect_volume: return (1454ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 05:59:57 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Deleting instance files /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc_del
Nov 29 05:59:57 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Deletion of /opt/stack/data/nova/instances/fb8244c4-f2a7-4ad8-a210-0f62c165a4dc_del complete
Nov 29 05:59:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-c9bcd616-db55-40c5-9b74-f5418539d187 req-a149de64-8669-4729-90ba-1481c8e61a2d service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received event network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c9bcd616-db55-40c5-9b74-f5418539d187 req-a149de64-8669-4729-90ba-1481c8e61a2d service nova] Acquiring lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c9bcd616-db55-40c5-9b74-f5418539d187 req-a149de64-8669-4729-90ba-1481c8e61a2d service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c9bcd616-db55-40c5-9b74-f5418539d187 req-a149de64-8669-4729-90ba-1481c8e61a2d service nova] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-c9bcd616-db55-40c5-9b74-f5418539d187 req-a149de64-8669-4729-90ba-1481c8e61a2d service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] No waiting events found dispatching network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:59:57 user nova-compute[75083]: WARNING nova.compute.manager [req-c9bcd616-db55-40c5-9b74-f5418539d187 req-a149de64-8669-4729-90ba-1481c8e61a2d service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received unexpected event network-vif-plugged-388c9969-42dc-4e34-8fb8-c2399687751d for instance with vm_state active and task_state deleting.
Nov 29 05:59:57 user nova-compute[75083]: INFO nova.compute.manager [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Took 2.41 seconds to destroy the instance on the hypervisor.
Nov 29 05:59:57 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 05:59:57 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 05:59:58 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 05:59:58 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Took 0.88 seconds to deallocate network for instance.
Nov 29 05:59:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:58 user nova-compute[75083]: DEBUG nova.compute.manager [req-6c568e81-5b45-4f37-8a00-20cfd50271f6 req-514c01ac-4c82-4928-a20b-34b7621a7957 service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Received event network-vif-plugged-5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:59:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6c568e81-5b45-4f37-8a00-20cfd50271f6 req-514c01ac-4c82-4928-a20b-34b7621a7957 service nova] Acquiring lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6c568e81-5b45-4f37-8a00-20cfd50271f6 req-514c01ac-4c82-4928-a20b-34b7621a7957 service nova] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6c568e81-5b45-4f37-8a00-20cfd50271f6 req-514c01ac-4c82-4928-a20b-34b7621a7957 service nova] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:58 user nova-compute[75083]: DEBUG nova.compute.manager [req-6c568e81-5b45-4f37-8a00-20cfd50271f6 req-514c01ac-4c82-4928-a20b-34b7621a7957 service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] No waiting events found dispatching network-vif-plugged-5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 05:59:58 user nova-compute[75083]: WARNING nova.compute.manager [req-6c568e81-5b45-4f37-8a00-20cfd50271f6 req-514c01ac-4c82-4928-a20b-34b7621a7957 service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Received unexpected event network-vif-plugged-5c054e6a-71b8-4b15-8153-356638de21d7 for instance with vm_state active and task_state resize_finish.
Nov 29 05:59:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Acquiring lock "cb409505-c9d8-46d3-b7d0-aad486942ccf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "cb409505-c9d8-46d3-b7d0-aad486942ccf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Acquiring lock "cb409505-c9d8-46d3-b7d0-aad486942ccf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "cb409505-c9d8-46d3-b7d0-aad486942ccf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "cb409505-c9d8-46d3-b7d0-aad486942ccf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 05:59:59 user nova-compute[75083]: INFO nova.compute.manager [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Terminating instance
Nov 29 05:59:59 user nova-compute[75083]: DEBUG nova.compute.manager [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG nova.compute.manager [req-25344ee4-5483-4a83-81df-408f75a60b68 req-1b7cce24-afcf-4164-be19-dcc19e7292c7 service nova] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Received event network-vif-deleted-388c9969-42dc-4e34-8fb8-c2399687751d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 05:59:59 user nova-compute[75083]: INFO nova.compute.manager [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] [instance: fb8244c4-f2a7-4ad8-a210-0f62c165a4dc] Took 1.18 seconds to detach 1 volumes for instance.
Nov 29 05:59:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 05:59:59 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Instance destroyed successfully.
Nov 29 05:59:59 user nova-compute[75083]: DEBUG nova.objects.instance [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lazy-loading 'resources' on Instance uuid cb409505-c9d8-46d3-b7d0-aad486942ccf {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-230799648',display_name='tempest-ServersNegativeTestJSON-server-230799648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-230799648',id=27,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:58:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b42598c48c05439f8059b4b8bf30b9dd',ramdisk_id='',reservation_id='r-wbove0zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1931576508',owner_user_name='tempest-ServersNegativeTestJSON-1931576508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:58:16Z,user_data=None,user_id='1e3cf798ed354d3ba55c0ff609e22d7f',uuid=cb409505-c9d8-46d3-b7d0-aad486942ccf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97768cc7-9bc1-4d5e-bea3-8855bfbe6121", "address": "fa:16:3e:64:c3:1d", "network": {"id": "f41035e0-21bb-472a-959b-099a854e4629", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-994952120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b42598c48c05439f8059b4b8bf30b9dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97768cc7-9b", "ovs_interfaceid": "97768cc7-9bc1-4d5e-bea3-8855bfbe6121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Converting VIF {"id": "97768cc7-9bc1-4d5e-bea3-8855bfbe6121", "address": "fa:16:3e:64:c3:1d", "network": {"id": "f41035e0-21bb-472a-959b-099a854e4629", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-994952120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b42598c48c05439f8059b4b8bf30b9dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97768cc7-9b", "ovs_interfaceid": "97768cc7-9bc1-4d5e-bea3-8855bfbe6121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:c3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97768cc7-9bc1-4d5e-bea3-8855bfbe6121,network=Network(f41035e0-21bb-472a-959b-099a854e4629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97768cc7-9b') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG os_vif [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:c3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97768cc7-9bc1-4d5e-bea3-8855bfbe6121,network=Network(f41035e0-21bb-472a-959b-099a854e4629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97768cc7-9b') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97768cc7-9b, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8494facd-19a2-4e74-acd8-8d0e2783c29b) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 05:59:59 user nova-compute[75083]: INFO os_vif [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:c3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97768cc7-9bc1-4d5e-bea3-8855bfbe6121,network=Network(f41035e0-21bb-472a-959b-099a854e4629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97768cc7-9b')
Nov 29 05:59:59 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Deleting instance files /opt/stack/data/nova/instances/cb409505-c9d8-46d3-b7d0-aad486942ccf_del
Nov 29 05:59:59 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Deletion of /opt/stack/data/nova/instances/cb409505-c9d8-46d3-b7d0-aad486942ccf_del complete
Nov 29 05:59:59 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 05:59:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:00 user nova-compute[75083]: INFO nova.compute.manager [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 06:00:00 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:00:00 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Deleted allocations for instance fb8244c4-f2a7-4ad8-a210-0f62c165a4dc
Nov 29 06:00:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8bcf0351-29fd-4ae9-9a11-6b5acae9b97c tempest-ServerActionsTestOtherB-1953829293 tempest-ServerActionsTestOtherB-1953829293-project-member] Lock "fb8244c4-f2a7-4ad8-a210-0f62c165a4dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.056s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:00:00 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Took 0.47 seconds to deallocate network for instance.
Nov 29 06:00:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG nova.compute.manager [req-481a3809-15a2-484e-a7ba-b8f4f1495011 req-1d643c06-490d-42a1-a09a-39b0034bfbae service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Received event network-vif-plugged-5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-481a3809-15a2-484e-a7ba-b8f4f1495011 req-1d643c06-490d-42a1-a09a-39b0034bfbae service nova] Acquiring lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-481a3809-15a2-484e-a7ba-b8f4f1495011 req-1d643c06-490d-42a1-a09a-39b0034bfbae service nova] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-481a3809-15a2-484e-a7ba-b8f4f1495011 req-1d643c06-490d-42a1-a09a-39b0034bfbae service nova] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG nova.compute.manager [req-481a3809-15a2-484e-a7ba-b8f4f1495011 req-1d643c06-490d-42a1-a09a-39b0034bfbae service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] No waiting events found dispatching network-vif-plugged-5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:00:00 user nova-compute[75083]: WARNING nova.compute.manager [req-481a3809-15a2-484e-a7ba-b8f4f1495011 req-1d643c06-490d-42a1-a09a-39b0034bfbae service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Received unexpected event network-vif-plugged-5c054e6a-71b8-4b15-8153-356638de21d7 for instance with vm_state active and task_state resize_finish.
Nov 29 06:00:00 user nova-compute[75083]: DEBUG nova.compute.manager [req-481a3809-15a2-484e-a7ba-b8f4f1495011 req-1d643c06-490d-42a1-a09a-39b0034bfbae service nova] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Received event network-vif-unplugged-97768cc7-9bc1-4d5e-bea3-8855bfbe6121 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-481a3809-15a2-484e-a7ba-b8f4f1495011 req-1d643c06-490d-42a1-a09a-39b0034bfbae service nova] Acquiring lock "cb409505-c9d8-46d3-b7d0-aad486942ccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-481a3809-15a2-484e-a7ba-b8f4f1495011 req-1d643c06-490d-42a1-a09a-39b0034bfbae service nova] Lock "cb409505-c9d8-46d3-b7d0-aad486942ccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-481a3809-15a2-484e-a7ba-b8f4f1495011 req-1d643c06-490d-42a1-a09a-39b0034bfbae service nova] Lock "cb409505-c9d8-46d3-b7d0-aad486942ccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG nova.compute.manager [req-481a3809-15a2-484e-a7ba-b8f4f1495011 req-1d643c06-490d-42a1-a09a-39b0034bfbae service nova] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] No waiting events found dispatching network-vif-unplugged-97768cc7-9bc1-4d5e-bea3-8855bfbe6121 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:00:00 user nova-compute[75083]: WARNING nova.compute.manager [req-481a3809-15a2-484e-a7ba-b8f4f1495011 req-1d643c06-490d-42a1-a09a-39b0034bfbae service nova] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Received unexpected event network-vif-unplugged-97768cc7-9bc1-4d5e-bea3-8855bfbe6121 for instance with vm_state deleted and task_state None.
Nov 29 06:00:00 user nova-compute[75083]: DEBUG nova.compute.manager [req-481a3809-15a2-484e-a7ba-b8f4f1495011 req-1d643c06-490d-42a1-a09a-39b0034bfbae service nova] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Received event network-vif-plugged-97768cc7-9bc1-4d5e-bea3-8855bfbe6121 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-481a3809-15a2-484e-a7ba-b8f4f1495011 req-1d643c06-490d-42a1-a09a-39b0034bfbae service nova] Acquiring lock "cb409505-c9d8-46d3-b7d0-aad486942ccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-481a3809-15a2-484e-a7ba-b8f4f1495011 req-1d643c06-490d-42a1-a09a-39b0034bfbae service nova] Lock "cb409505-c9d8-46d3-b7d0-aad486942ccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-481a3809-15a2-484e-a7ba-b8f4f1495011 req-1d643c06-490d-42a1-a09a-39b0034bfbae service nova] Lock "cb409505-c9d8-46d3-b7d0-aad486942ccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG nova.compute.manager [req-481a3809-15a2-484e-a7ba-b8f4f1495011 req-1d643c06-490d-42a1-a09a-39b0034bfbae service nova] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] No waiting events found dispatching network-vif-plugged-97768cc7-9bc1-4d5e-bea3-8855bfbe6121 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:00:00 user nova-compute[75083]: WARNING nova.compute.manager [req-481a3809-15a2-484e-a7ba-b8f4f1495011 req-1d643c06-490d-42a1-a09a-39b0034bfbae service nova] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Received unexpected event network-vif-plugged-97768cc7-9bc1-4d5e-bea3-8855bfbe6121 for instance with vm_state deleted and task_state None.
Nov 29 06:00:00 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:00:00 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Instance running successfully.
Nov 29 06:00:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Failed to set time: agent not configured {{(pid=75083) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 06:00:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a2d04c48-9ddf-4a58-a6d3-53438843487e tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] finish_migration finished successfully. {{(pid=75083) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 06:00:00 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Deleted allocations for instance cb409505-c9d8-46d3-b7d0-aad486942ccf
Nov 29 06:00:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0c1f17e2-1e00-4613-8c18-f365aa91fccc tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "cb409505-c9d8-46d3-b7d0-aad486942ccf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.868s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:01 user nova-compute[75083]: DEBUG nova.compute.manager [req-acdd867b-d101-4ea2-b518-448a2030dbd6 req-44e63e4b-5434-457d-87c4-08d68e85f388 service nova] [instance: cb409505-c9d8-46d3-b7d0-aad486942ccf] Received event network-vif-deleted-97768cc7-9bc1-4d5e-bea3-8855bfbe6121 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:00:02 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:00:04 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:00:04 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:00:04 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:00:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:05 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:00:05 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance c1baf96b-be32-42f1-85a8-9b2321226199 is timed out.
Nov 29 06:00:05 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Successfully detached device vdc from instance c1baf96b-be32-42f1-85a8-9b2321226199 from the live domain config.
Nov 29 06:00:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:00:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUQOYwMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:00:05 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:00:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:00:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:00:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9591eb-3002-4706-bd94-8b4a59cbc579]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:00:06 user nova-compute[75083]: No targets found.
Nov 29 06:00:06 user nova-compute[75083]: iSNS:
Nov 29 06:00:06 user nova-compute[75083]: No targets found.
Nov 29 06:00:06 user nova-compute[75083]: STATIC:
Nov 29 06:00:06 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401
Nov 29 06:00:06 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:00:06 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:00:06 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4
Nov 29 06:00:06 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:00:06 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:00:06 user nova-compute[75083]: FIRMWARE:
Nov 29 06:00:06 user nova-compute[75083]: No targets found.
Nov 29 06:00:06 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:00:06 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:00:06 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df6437c-b310-4f2c-9009-35978b587ea0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfd3168-41f9-44e3-a77c-fb5f313bef4c]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)
Nov 29 06:00:06 user nova-compute[75083]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:00:06 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 (non-flash)
Nov 29 06:00:06 user nova-compute[75083]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:00:06 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b82dda20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401'): ({'sde'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Removing single pathed devices sde {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aba0ff7-7036-42e1-b16c-f5fe31d1f0ae]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1814319a-030e-48d7-a37b-2bc00efdf49d]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Flushing IO for device /dev/sde {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab5389f-0fc2-4e17-90e9-05720bbe35f4]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e21f6e-23e4-4437-8760-75823bff9ae4]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] SCSI volumes sde have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb1d356-aa44-46d3-9931-c0aebd3b5d30]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ef9eab-ef69-4498-a16f-22acf8ef1517]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401, portal: 172.16.0.220,3260]
Nov 29 06:00:06 user nova-compute[75083]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401, portal: 172.16.0.220,3260] successful.
Nov 29 06:00:06 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb43125-c0b4-4155-8c9f-8b8320923401 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8de2b7-9493-445b-b883-2211be44cf3a]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] <== disconnect_volume: return (294ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:00:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:07 user nova-compute[75083]: DEBUG nova.objects.instance [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'flavor' on Instance uuid c1baf96b-be32-42f1-85a8-9b2321226199 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:00:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-72d4d23e-e2a9-45df-86c8-c0dcdd792337 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "c1baf96b-be32-42f1-85a8-9b2321226199" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.808s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:07 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:00:07 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:00:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:00:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:00:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:00:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "c1baf96b-be32-42f1-85a8-9b2321226199" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "c1baf96b-be32-42f1-85a8-9b2321226199" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "c1baf96b-be32-42f1-85a8-9b2321226199-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "c1baf96b-be32-42f1-85a8-9b2321226199-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "c1baf96b-be32-42f1-85a8-9b2321226199-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:08 user nova-compute[75083]: INFO nova.compute.manager [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Terminating instance
Nov 29 06:00:08 user nova-compute[75083]: DEBUG nova.compute.manager [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG nova.compute.manager [req-6d56b342-b3b5-4afd-a66c-15bfc433a538 req-65597f12-41da-4495-8242-47392d01d6cf service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Received event network-vif-unplugged-1331cb58-30d1-4578-9a05-6a70116d925b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6d56b342-b3b5-4afd-a66c-15bfc433a538 req-65597f12-41da-4495-8242-47392d01d6cf service nova] Acquiring lock "c1baf96b-be32-42f1-85a8-9b2321226199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6d56b342-b3b5-4afd-a66c-15bfc433a538 req-65597f12-41da-4495-8242-47392d01d6cf service nova] Lock "c1baf96b-be32-42f1-85a8-9b2321226199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6d56b342-b3b5-4afd-a66c-15bfc433a538 req-65597f12-41da-4495-8242-47392d01d6cf service nova] Lock "c1baf96b-be32-42f1-85a8-9b2321226199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG nova.compute.manager [req-6d56b342-b3b5-4afd-a66c-15bfc433a538 req-65597f12-41da-4495-8242-47392d01d6cf service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] No waiting events found dispatching network-vif-unplugged-1331cb58-30d1-4578-9a05-6a70116d925b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG nova.compute.manager [req-6d56b342-b3b5-4afd-a66c-15bfc433a538 req-65597f12-41da-4495-8242-47392d01d6cf service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Received event network-vif-unplugged-1331cb58-30d1-4578-9a05-6a70116d925b for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:09 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Instance destroyed successfully.
Nov 29 06:00:09 user nova-compute[75083]: DEBUG nova.objects.instance [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lazy-loading 'resources' on Instance uuid c1baf96b-be32-42f1-85a8-9b2321226199 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:57:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-69525671',display_name='tempest-AttachVolumeTestJSON-server-69525671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-69525671',id=25,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdd7mwKfLnZjGbw3RYJJKQCJsLnI6mEQqeroY/tHA6GJ8pJGdkqdp+y4+lrDHtk10ALLpz5HMQx8fEmNTm7OsnQjfiHr2zLGlYlg0kbJFZ6KUgH7F3y+DqjIm2iou1wLg==',key_name='tempest-keypair-1400711518',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:57:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4c1cb7a503b446f945f12b3b998035b',ramdisk_id='',reservation_id='r-y5j4p270',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1539985865',owner_user_name='tempest-AttachVolumeTestJSON-1539985865-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:57:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f2d92aba5c4069b94b8a5cd8b72a46',uuid=c1baf96b-be32-42f1-85a8-9b2321226199,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1331cb58-30d1-4578-9a05-6a70116d925b", "address": "fa:16:3e:50:1a:f0", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1331cb58-30", "ovs_interfaceid": "1331cb58-30d1-4578-9a05-6a70116d925b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converting VIF {"id": "1331cb58-30d1-4578-9a05-6a70116d925b", "address": "fa:16:3e:50:1a:f0", "network": {"id": "30d7bf08-1441-4959-b4bb-d8c92d5d3396", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-951441084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c1cb7a503b446f945f12b3b998035b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1331cb58-30", "ovs_interfaceid": "1331cb58-30d1-4578-9a05-6a70116d925b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:1a:f0,bridge_name='br-int',has_traffic_filtering=True,id=1331cb58-30d1-4578-9a05-6a70116d925b,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1331cb58-30') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG os_vif [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:1a:f0,bridge_name='br-int',has_traffic_filtering=True,id=1331cb58-30d1-4578-9a05-6a70116d925b,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1331cb58-30') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1331cb58-30, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6964abdf-ab99-4f0e-a11a-daeac27c90d3) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:09 user nova-compute[75083]: INFO os_vif [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:1a:f0,bridge_name='br-int',has_traffic_filtering=True,id=1331cb58-30d1-4578-9a05-6a70116d925b,network=Network(30d7bf08-1441-4959-b4bb-d8c92d5d3396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1331cb58-30')
Nov 29 06:00:09 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Deleting instance files /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199_del
Nov 29 06:00:09 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Deletion of /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199_del complete
Nov 29 06:00:09 user nova-compute[75083]: INFO nova.compute.manager [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 29 06:00:09 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk --force-share --output=json" returned: 1 in 0.184s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk --force-share --output=json' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:00:09 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000019, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/c1baf96b-be32-42f1-85a8-9b2321226199/disk
Nov 29 06:00:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:09 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:00:10 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Took 0.80 seconds to deallocate network for instance.
Nov 29 06:00:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:00:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:00:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:10 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:00:10 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:00:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:10 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Deleted allocations for instance c1baf96b-be32-42f1-85a8-9b2321226199
Nov 29 06:00:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a793dbe7-1d8e-42d9-a60d-4c67523ba6c6 tempest-AttachVolumeTestJSON-1539985865 tempest-AttachVolumeTestJSON-1539985865-project-member] Lock "c1baf96b-be32-42f1-85a8-9b2321226199" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.339s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-13b11876-54bc-4bcc-8b16-de5e94e05f7c req-5042922e-b792-491a-88aa-0282a5511e85 service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Received event network-vif-plugged-1331cb58-30d1-4578-9a05-6a70116d925b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:00:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-13b11876-54bc-4bcc-8b16-de5e94e05f7c req-5042922e-b792-491a-88aa-0282a5511e85 service nova] Acquiring lock "c1baf96b-be32-42f1-85a8-9b2321226199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:00:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-13b11876-54bc-4bcc-8b16-de5e94e05f7c req-5042922e-b792-491a-88aa-0282a5511e85 service nova] Lock "c1baf96b-be32-42f1-85a8-9b2321226199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:00:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-13b11876-54bc-4bcc-8b16-de5e94e05f7c req-5042922e-b792-491a-88aa-0282a5511e85 service nova] Lock "c1baf96b-be32-42f1-85a8-9b2321226199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-13b11876-54bc-4bcc-8b16-de5e94e05f7c req-5042922e-b792-491a-88aa-0282a5511e85 service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] No waiting events found dispatching network-vif-plugged-1331cb58-30d1-4578-9a05-6a70116d925b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:00:10 user nova-compute[75083]: WARNING nova.compute.manager [req-13b11876-54bc-4bcc-8b16-de5e94e05f7c req-5042922e-b792-491a-88aa-0282a5511e85 service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Received unexpected event network-vif-plugged-1331cb58-30d1-4578-9a05-6a70116d925b for instance with vm_state deleted and task_state None.
Nov 29 06:00:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-13b11876-54bc-4bcc-8b16-de5e94e05f7c req-5042922e-b792-491a-88aa-0282a5511e85 service nova] [instance: c1baf96b-be32-42f1-85a8-9b2321226199] Received event network-vif-deleted-1331cb58-30d1-4578-9a05-6a70116d925b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:00:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:00:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:11 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:00:11 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:00:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=7947MB free_disk=25.31011962890625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:00:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:00:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:00:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Applying migration context for instance 18dc5c9c-8fb3-41c7-a124-4881788b3c48 as it has an incoming, in-progress migration 49e09399-1a55-4d89-8ea2-7b2c618edfcd. Migration status is finished {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 06:00:11 user nova-compute[75083]: INFO nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Updating resource usage from migration 49e09399-1a55-4d89-8ea2-7b2c618edfcd
Nov 29 06:00:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 161c6455-90ce-4c40-a33e-7f582989135d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:00:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4435ed78-e35f-4859-8a4f-9920815d968a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:00:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a34d9d98-be73-4d52-85f0-83e48f60bc12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:00:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 05f45fef-c8a7-41c1-a571-863307caca6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:00:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:00:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Migration 49e09399-1a55-4d89-8ea2-7b2c618edfcd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 06:00:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 18dc5c9c-8fb3-41c7-a124-4881788b3c48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:00:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:00:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:00:11 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:00:11 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:00:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:00:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:12 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:00:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:00:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:00:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:00:12 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:00:13 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Updating instance_info_cache with network_info: [{"id": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "address": "fa:16:3e:8d:3b:2a", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f259ece-bc", "ovs_interfaceid": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:00:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:00:13 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:00:13 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:00:13 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:00:13 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:00:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:00:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:00:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:00:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:00:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:00:28 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:00:28 user nova-compute[75083]: INFO nova.compute.claims [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Claim successful on node user
Nov 29 06:00:28 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:00:28 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:00:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:00:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:00:28 user nova-compute[75083]: DEBUG nova.network.neutron [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:00:28 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:00:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:00:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:00:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:00:28 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Creating image(s)
Nov 29 06:00:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:00:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "/opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:00:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "/opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG nova.policy [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4dc42da0ede8433a827629a68e691658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112a98f04dc141dfbb0f7a10fd410cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.194s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk 1073741824" returned: 0 in 0.050s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG nova.network.neutron [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Successfully created port: ec1e3052-9df5-4761-a59e-cd649ad258e9 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Cannot resize image /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Ensure instance console log exists: /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:00:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.network.neutron [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Successfully updated port: ec1e3052-9df5-4761-a59e-cd649ad258e9 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "refresh_cache-a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquired lock "refresh_cache-a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.network.neutron [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.compute.manager [req-2ff3fbb7-b59c-4232-941f-02a3ff82095f req-e02d9c28-7802-4441-8b8c-43746204e449 service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Received event network-changed-ec1e3052-9df5-4761-a59e-cd649ad258e9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.compute.manager [req-2ff3fbb7-b59c-4232-941f-02a3ff82095f req-e02d9c28-7802-4441-8b8c-43746204e449 service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Refreshing instance network info cache due to event network-changed-ec1e3052-9df5-4761-a59e-cd649ad258e9. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2ff3fbb7-b59c-4232-941f-02a3ff82095f req-e02d9c28-7802-4441-8b8c-43746204e449 service nova] Acquiring lock "refresh_cache-a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.network.neutron [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.network.neutron [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Updating instance_info_cache with network_info: [{"id": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "address": "fa:16:3e:ff:41:7d", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1e3052-9d", "ovs_interfaceid": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Releasing lock "refresh_cache-a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.compute.manager [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Instance network_info: |[{"id": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "address": "fa:16:3e:ff:41:7d", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1e3052-9d", "ovs_interfaceid": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2ff3fbb7-b59c-4232-941f-02a3ff82095f req-e02d9c28-7802-4441-8b8c-43746204e449 service nova] Acquired lock "refresh_cache-a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.network.neutron [req-2ff3fbb7-b59c-4232-941f-02a3ff82095f req-e02d9c28-7802-4441-8b8c-43746204e449 service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Refreshing network info cache for port ec1e3052-9df5-4761-a59e-cd649ad258e9 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Start _get_guest_xml network_info=[{"id": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "address": "fa:16:3e:ff:41:7d", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1e3052-9d", "ovs_interfaceid": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:00:30 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:00:30 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-685500313',display_name='tempest-AttachVolumeNegativeTest-server-685500313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-685500313',id=29,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRnm+yGLmOjNs1zTT5hxjXBiXKJ1nrKOwSJq0eWkW0eMRFnMPFtY66AF4OUr6dckTzJCJYuU0hxIEN55tky+ZEdO6ZQmV1iZjbC/Xqxx5h/uCcgBXhkfxyIsC7E2xSIVQ==',key_name='tempest-keypair-1215371615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112a98f04dc141dfbb0f7a10fd410cae',ramdisk_id='',reservation_id='r-thao6ppp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1387142425',owner_user_name='tempest-AttachVolumeNegativeTest-1387142425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dc42da0ede8433a827629a68e691658',uuid=a6e1c2d7-1181-4d9f-99eb-d401d5f73b25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "address": "fa:16:3e:ff:41:7d", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1e3052-9d", "ovs_interfaceid": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converting VIF {"id": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "address": "fa:16:3e:ff:41:7d", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1e3052-9d", "ovs_interfaceid": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:41:7d,bridge_name='br-int',has_traffic_filtering=True,id=ec1e3052-9df5-4761-a59e-cd649ad258e9,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec1e3052-9d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.objects.instance [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lazy-loading 'pci_devices' on Instance uuid a6e1c2d7-1181-4d9f-99eb-d401d5f73b25 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:00:30 user nova-compute[75083]:   <uuid>a6e1c2d7-1181-4d9f-99eb-d401d5f73b25</uuid>
Nov 29 06:00:30 user nova-compute[75083]:   <name>instance-0000001d</name>
Nov 29 06:00:30 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:00:30 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:00:30 user nova-compute[75083]:   <metadata>
Nov 29 06:00:30 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:00:30 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:00:30 user nova-compute[75083]:       <nova:name>tempest-AttachVolumeNegativeTest-server-685500313</nova:name>
Nov 29 06:00:30 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:00:30</nova:creationTime>
Nov 29 06:00:30 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:00:30 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:00:30 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:00:30 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:00:30 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:00:30 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:00:30 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:00:30 user nova-compute[75083]:       <nova:owner>
Nov 29 06:00:30 user nova-compute[75083]:         <nova:user uuid="4dc42da0ede8433a827629a68e691658">tempest-AttachVolumeNegativeTest-1387142425-project-member</nova:user>
Nov 29 06:00:30 user nova-compute[75083]:         <nova:project uuid="112a98f04dc141dfbb0f7a10fd410cae">tempest-AttachVolumeNegativeTest-1387142425</nova:project>
Nov 29 06:00:30 user nova-compute[75083]:       </nova:owner>
Nov 29 06:00:30 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 06:00:30 user nova-compute[75083]:       <nova:ports>
Nov 29 06:00:30 user nova-compute[75083]:         <nova:port uuid="ec1e3052-9df5-4761-a59e-cd649ad258e9">
Nov 29 06:00:30 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 06:00:30 user nova-compute[75083]:         </nova:port>
Nov 29 06:00:30 user nova-compute[75083]:       </nova:ports>
Nov 29 06:00:30 user nova-compute[75083]:     </nova:instance>
Nov 29 06:00:30 user nova-compute[75083]:   </metadata>
Nov 29 06:00:30 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:00:30 user nova-compute[75083]:     <system>
Nov 29 06:00:30 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:00:30 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:00:30 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:00:30 user nova-compute[75083]:       <entry name="serial">a6e1c2d7-1181-4d9f-99eb-d401d5f73b25</entry>
Nov 29 06:00:30 user nova-compute[75083]:       <entry name="uuid">a6e1c2d7-1181-4d9f-99eb-d401d5f73b25</entry>
Nov 29 06:00:30 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:00:30 user nova-compute[75083]:     </system>
Nov 29 06:00:30 user nova-compute[75083]:   </sysinfo>
Nov 29 06:00:30 user nova-compute[75083]:   <os>
Nov 29 06:00:30 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:00:30 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:00:30 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:00:30 user nova-compute[75083]:   </os>
Nov 29 06:00:30 user nova-compute[75083]:   <features>
Nov 29 06:00:30 user nova-compute[75083]:     <acpi/>
Nov 29 06:00:30 user nova-compute[75083]:     <apic/>
Nov 29 06:00:30 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:00:30 user nova-compute[75083]:   </features>
Nov 29 06:00:30 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:00:30 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:00:30 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:00:30 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:00:30 user nova-compute[75083]:   </clock>
Nov 29 06:00:30 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:00:30 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:00:30 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:00:30 user nova-compute[75083]:   </cpu>
Nov 29 06:00:30 user nova-compute[75083]:   <devices>
Nov 29 06:00:30 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:00:30 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:00:30 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk"/>
Nov 29 06:00:30 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:00:30 user nova-compute[75083]:     </disk>
Nov 29 06:00:30 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:00:30 user nova-compute[75083]:       <mac address="fa:16:3e:ff:41:7d"/>
Nov 29 06:00:30 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:00:30 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:00:30 user nova-compute[75083]:       <target dev="tapec1e3052-9d"/>
Nov 29 06:00:30 user nova-compute[75083]:     </interface>
Nov 29 06:00:30 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:00:30 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/console.log" append="off"/>
Nov 29 06:00:30 user nova-compute[75083]:     </serial>
Nov 29 06:00:30 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:00:30 user nova-compute[75083]:     <video>
Nov 29 06:00:30 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:00:30 user nova-compute[75083]:     </video>
Nov 29 06:00:30 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:00:30 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:00:30 user nova-compute[75083]:     </rng>
Nov 29 06:00:30 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:00:30 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:00:30 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:00:30 user nova-compute[75083]:     </memballoon>
Nov 29 06:00:30 user nova-compute[75083]:   </devices>
Nov 29 06:00:30 user nova-compute[75083]: </domain>
Nov 29 06:00:30 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-685500313',display_name='tempest-AttachVolumeNegativeTest-server-685500313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-685500313',id=29,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRnm+yGLmOjNs1zTT5hxjXBiXKJ1nrKOwSJq0eWkW0eMRFnMPFtY66AF4OUr6dckTzJCJYuU0hxIEN55tky+ZEdO6ZQmV1iZjbC/Xqxx5h/uCcgBXhkfxyIsC7E2xSIVQ==',key_name='tempest-keypair-1215371615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112a98f04dc141dfbb0f7a10fd410cae',ramdisk_id='',reservation_id='r-thao6ppp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1387142425',owner_user_name='tempest-AttachVolumeNegativeTest-1387142425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dc42da0ede8433a827629a68e691658',uuid=a6e1c2d7-1181-4d9f-99eb-d401d5f73b25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "address": "fa:16:3e:ff:41:7d", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1e3052-9d", "ovs_interfaceid": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converting VIF {"id": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "address": "fa:16:3e:ff:41:7d", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1e3052-9d", "ovs_interfaceid": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:41:7d,bridge_name='br-int',has_traffic_filtering=True,id=ec1e3052-9df5-4761-a59e-cd649ad258e9,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec1e3052-9d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG os_vif [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:41:7d,bridge_name='br-int',has_traffic_filtering=True,id=ec1e3052-9df5-4761-a59e-cd649ad258e9,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec1e3052-9d') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1b27f75-1039-567c-886d-99b7f507dd69', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec1e3052-9d, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec1e3052-9d, col_values=(('qos', UUID('b2e87d65-27af-4d1d-941a-e17172ea2f92')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec1e3052-9d, col_values=(('external_ids', {'iface-id': 'ec1e3052-9df5-4761-a59e-cd649ad258e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:41:7d', 'vm-uuid': 'a6e1c2d7-1181-4d9f-99eb-d401d5f73b25'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:30 user nova-compute[75083]: INFO os_vif [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:41:7d,bridge_name='br-int',has_traffic_filtering=True,id=ec1e3052-9df5-4761-a59e-cd649ad258e9,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec1e3052-9d')
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:00:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] No VIF found with MAC fa:16:3e:ff:41:7d, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:00:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:31 user nova-compute[75083]: DEBUG nova.network.neutron [req-2ff3fbb7-b59c-4232-941f-02a3ff82095f req-e02d9c28-7802-4441-8b8c-43746204e449 service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Updated VIF entry in instance network info cache for port ec1e3052-9df5-4761-a59e-cd649ad258e9. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:00:31 user nova-compute[75083]: DEBUG nova.network.neutron [req-2ff3fbb7-b59c-4232-941f-02a3ff82095f req-e02d9c28-7802-4441-8b8c-43746204e449 service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Updating instance_info_cache with network_info: [{"id": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "address": "fa:16:3e:ff:41:7d", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1e3052-9d", "ovs_interfaceid": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:00:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2ff3fbb7-b59c-4232-941f-02a3ff82095f req-e02d9c28-7802-4441-8b8c-43746204e449 service nova] Releasing lock "refresh_cache-a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:00:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:32 user nova-compute[75083]: DEBUG nova.compute.manager [req-e24e78ae-a393-47da-bf38-b4454613d9bc req-822db5f7-a841-4342-9040-3d2386164e27 service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Received event network-vif-plugged-ec1e3052-9df5-4761-a59e-cd649ad258e9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:00:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e24e78ae-a393-47da-bf38-b4454613d9bc req-822db5f7-a841-4342-9040-3d2386164e27 service nova] Acquiring lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:00:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e24e78ae-a393-47da-bf38-b4454613d9bc req-822db5f7-a841-4342-9040-3d2386164e27 service nova] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:00:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e24e78ae-a393-47da-bf38-b4454613d9bc req-822db5f7-a841-4342-9040-3d2386164e27 service nova] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:32 user nova-compute[75083]: DEBUG nova.compute.manager [req-e24e78ae-a393-47da-bf38-b4454613d9bc req-822db5f7-a841-4342-9040-3d2386164e27 service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] No waiting events found dispatching network-vif-plugged-ec1e3052-9df5-4761-a59e-cd649ad258e9 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:00:32 user nova-compute[75083]: WARNING nova.compute.manager [req-e24e78ae-a393-47da-bf38-b4454613d9bc req-822db5f7-a841-4342-9040-3d2386164e27 service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Received unexpected event network-vif-plugged-ec1e3052-9df5-4761-a59e-cd649ad258e9 for instance with vm_state building and task_state spawning.
Nov 29 06:00:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:34 user nova-compute[75083]: DEBUG nova.compute.manager [req-6f113568-1543-40de-924b-6d8ce527470e req-5dfee1d5-73e6-4a9d-9edd-ecaab8fced0d service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Received event network-vif-plugged-ec1e3052-9df5-4761-a59e-cd649ad258e9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:00:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6f113568-1543-40de-924b-6d8ce527470e req-5dfee1d5-73e6-4a9d-9edd-ecaab8fced0d service nova] Acquiring lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:00:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6f113568-1543-40de-924b-6d8ce527470e req-5dfee1d5-73e6-4a9d-9edd-ecaab8fced0d service nova] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:00:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6f113568-1543-40de-924b-6d8ce527470e req-5dfee1d5-73e6-4a9d-9edd-ecaab8fced0d service nova] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:34 user nova-compute[75083]: DEBUG nova.compute.manager [req-6f113568-1543-40de-924b-6d8ce527470e req-5dfee1d5-73e6-4a9d-9edd-ecaab8fced0d service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] No waiting events found dispatching network-vif-plugged-ec1e3052-9df5-4761-a59e-cd649ad258e9 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:00:34 user nova-compute[75083]: WARNING nova.compute.manager [req-6f113568-1543-40de-924b-6d8ce527470e req-5dfee1d5-73e6-4a9d-9edd-ecaab8fced0d service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Received unexpected event network-vif-plugged-ec1e3052-9df5-4761-a59e-cd649ad258e9 for instance with vm_state building and task_state spawning.
Nov 29 06:00:34 user nova-compute[75083]: DEBUG nova.compute.manager [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:00:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:00:34 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Instance spawned successfully.
Nov 29 06:00:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:00:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:00:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:00:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:00:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:00:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:00:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:00:34 user nova-compute[75083]: INFO nova.compute.manager [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 29 06:00:34 user nova-compute[75083]: DEBUG nova.compute.manager [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:00:34 user nova-compute[75083]: INFO nova.compute.manager [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Took 6.46 seconds to build instance.
Nov 29 06:00:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c7731c66-3038-4232-8756-ec4609653dbb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.565s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:00:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:00:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:00:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:02 user nova-compute[75083]: INFO nova.compute.manager [None req-6bf00063-aebb-4b69-84ff-e236513609c0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Unrescuing
Nov 29 06:01:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6bf00063-aebb-4b69-84ff-e236513609c0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:01:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6bf00063-aebb-4b69-84ff-e236513609c0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquired lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:01:02 user nova-compute[75083]: DEBUG nova.network.neutron [None req-6bf00063-aebb-4b69-84ff-e236513609c0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:01:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:02 user nova-compute[75083]: DEBUG nova.network.neutron [None req-6bf00063-aebb-4b69-84ff-e236513609c0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Updating instance_info_cache with network_info: [{"id": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "address": "fa:16:3e:8d:3b:2a", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f259ece-bc", "ovs_interfaceid": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:01:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6bf00063-aebb-4b69-84ff-e236513609c0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Releasing lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:01:02 user nova-compute[75083]: DEBUG nova.objects.instance [None req-6bf00063-aebb-4b69-84ff-e236513609c0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'flavor' on Instance uuid 4435ed78-e35f-4859-8a4f-9920815d968a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:01:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:03 user nova-compute[75083]: DEBUG nova.compute.manager [req-0b78441f-761b-40e9-bb50-1576b7bb4608 req-9cfd175b-5453-49e4-88ff-1f85160da3b9 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received event network-vif-unplugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:01:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0b78441f-761b-40e9-bb50-1576b7bb4608 req-9cfd175b-5453-49e4-88ff-1f85160da3b9 service nova] Acquiring lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:01:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0b78441f-761b-40e9-bb50-1576b7bb4608 req-9cfd175b-5453-49e4-88ff-1f85160da3b9 service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:01:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0b78441f-761b-40e9-bb50-1576b7bb4608 req-9cfd175b-5453-49e4-88ff-1f85160da3b9 service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:01:03 user nova-compute[75083]: DEBUG nova.compute.manager [req-0b78441f-761b-40e9-bb50-1576b7bb4608 req-9cfd175b-5453-49e4-88ff-1f85160da3b9 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] No waiting events found dispatching network-vif-unplugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:01:03 user nova-compute[75083]: WARNING nova.compute.manager [req-0b78441f-761b-40e9-bb50-1576b7bb4608 req-9cfd175b-5453-49e4-88ff-1f85160da3b9 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received unexpected event network-vif-unplugged-1f259ece-bce2-4aab-925b-26e4f9619fbf for instance with vm_state rescued and task_state unrescuing.
Nov 29 06:01:03 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Instance destroyed successfully.
Nov 29 06:01:04 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:01:04 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:01:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:05 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:01:05 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:01:05 user nova-compute[75083]: DEBUG nova.compute.manager [req-8697995f-9e57-45ae-908d-b7e4f0d74395 req-d9abd9f9-5f28-48fe-8e69-ceac79b87408 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received event network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:01:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8697995f-9e57-45ae-908d-b7e4f0d74395 req-d9abd9f9-5f28-48fe-8e69-ceac79b87408 service nova] Acquiring lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:01:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8697995f-9e57-45ae-908d-b7e4f0d74395 req-d9abd9f9-5f28-48fe-8e69-ceac79b87408 service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:01:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8697995f-9e57-45ae-908d-b7e4f0d74395 req-d9abd9f9-5f28-48fe-8e69-ceac79b87408 service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:01:05 user nova-compute[75083]: DEBUG nova.compute.manager [req-8697995f-9e57-45ae-908d-b7e4f0d74395 req-d9abd9f9-5f28-48fe-8e69-ceac79b87408 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] No waiting events found dispatching network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:01:05 user nova-compute[75083]: WARNING nova.compute.manager [req-8697995f-9e57-45ae-908d-b7e4f0d74395 req-d9abd9f9-5f28-48fe-8e69-ceac79b87408 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received unexpected event network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf for instance with vm_state rescued and task_state unrescuing.
Nov 29 06:01:05 user nova-compute[75083]: DEBUG nova.compute.manager [req-8697995f-9e57-45ae-908d-b7e4f0d74395 req-d9abd9f9-5f28-48fe-8e69-ceac79b87408 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received event network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:01:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8697995f-9e57-45ae-908d-b7e4f0d74395 req-d9abd9f9-5f28-48fe-8e69-ceac79b87408 service nova] Acquiring lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:01:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8697995f-9e57-45ae-908d-b7e4f0d74395 req-d9abd9f9-5f28-48fe-8e69-ceac79b87408 service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:01:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8697995f-9e57-45ae-908d-b7e4f0d74395 req-d9abd9f9-5f28-48fe-8e69-ceac79b87408 service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:01:05 user nova-compute[75083]: DEBUG nova.compute.manager [req-8697995f-9e57-45ae-908d-b7e4f0d74395 req-d9abd9f9-5f28-48fe-8e69-ceac79b87408 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] No waiting events found dispatching network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:01:05 user nova-compute[75083]: WARNING nova.compute.manager [req-8697995f-9e57-45ae-908d-b7e4f0d74395 req-d9abd9f9-5f28-48fe-8e69-ceac79b87408 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received unexpected event network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf for instance with vm_state rescued and task_state unrescuing.
Nov 29 06:01:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:07 user nova-compute[75083]: DEBUG nova.compute.manager [None req-6bf00063-aebb-4b69-84ff-e236513609c0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:01:07 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:01:07 user nova-compute[75083]: DEBUG nova.compute.manager [req-6b90625c-22eb-49e9-8f7d-948ff660e99a req-d9fac902-d832-4730-8227-209fb501a5f8 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received event network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:01:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6b90625c-22eb-49e9-8f7d-948ff660e99a req-d9fac902-d832-4730-8227-209fb501a5f8 service nova] Acquiring lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:01:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6b90625c-22eb-49e9-8f7d-948ff660e99a req-d9fac902-d832-4730-8227-209fb501a5f8 service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:01:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6b90625c-22eb-49e9-8f7d-948ff660e99a req-d9fac902-d832-4730-8227-209fb501a5f8 service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:01:07 user nova-compute[75083]: DEBUG nova.compute.manager [req-6b90625c-22eb-49e9-8f7d-948ff660e99a req-d9fac902-d832-4730-8227-209fb501a5f8 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] No waiting events found dispatching network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:01:07 user nova-compute[75083]: WARNING nova.compute.manager [req-6b90625c-22eb-49e9-8f7d-948ff660e99a req-d9fac902-d832-4730-8227-209fb501a5f8 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received unexpected event network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf for instance with vm_state active and task_state None.
Nov 29 06:01:08 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:01:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:01:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:01:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:01:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:01:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:01:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:12 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:01:12 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:01:12 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8079MB free_disk=25.297290802001953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:01:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:01:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:01:12 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Applying migration context for instance 18dc5c9c-8fb3-41c7-a124-4881788b3c48 as it has an incoming, in-progress migration 49e09399-1a55-4d89-8ea2-7b2c618edfcd. Migration status is finished {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 06:01:12 user nova-compute[75083]: INFO nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Updating resource usage from migration 49e09399-1a55-4d89-8ea2-7b2c618edfcd
Nov 29 06:01:12 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 161c6455-90ce-4c40-a33e-7f582989135d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:01:12 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4435ed78-e35f-4859-8a4f-9920815d968a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:01:12 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a34d9d98-be73-4d52-85f0-83e48f60bc12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:01:12 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 05f45fef-c8a7-41c1-a571-863307caca6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:01:12 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:01:12 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Migration 49e09399-1a55-4d89-8ea2-7b2c618edfcd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 06:01:12 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 18dc5c9c-8fb3-41c7-a124-4881788b3c48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:01:12 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a6e1c2d7-1181-4d9f-99eb-d401d5f73b25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:01:12 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:01:12 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:01:12 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:01:12 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:01:12 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:01:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:01:13 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:01:13 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:01:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-a34d9d98-be73-4d52-85f0-83e48f60bc12" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:01:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-a34d9d98-be73-4d52-85f0-83e48f60bc12" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:01:13 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:01:14 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Updating instance_info_cache with network_info: [{"id": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "address": "fa:16:3e:eb:95:6e", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31b37f5-06", "ovs_interfaceid": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:01:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-a34d9d98-be73-4d52-85f0-83e48f60bc12" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:01:14 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:01:14 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:01:14 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:01:14 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:01:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "733f9905-c483-4835-8ec9-953b341950d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:01:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "733f9905-c483-4835-8ec9-953b341950d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:01:16 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:01:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:01:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:01:16 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:01:16 user nova-compute[75083]: INFO nova.compute.claims [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Claim successful on node user
Nov 29 06:01:16 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:01:16 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:01:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:01:16 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:01:17 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:01:17 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:01:17 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:01:17 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:01:17 user nova-compute[75083]: DEBUG nova.policy [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb526efdda0c4ca2ba8e739ecbe9e148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0801cbd66c8457b887d383721d95915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:01:17 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:01:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:01:17 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Creating image(s)
Nov 29 06:01:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "/opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:01:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "/opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:01:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "/opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:01:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "af2f29995b267185b2bf3f7328b3856925fb92a2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:01:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "af2f29995b267185b2bf3f7328b3856925fb92a2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:01:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2.part --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2.part --force-share --output=json" returned: 0 in 0.191s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:17 user nova-compute[75083]: DEBUG nova.virt.images [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] 325c0786-2bab-4ff9-a435-46158e003aee was qcow2, converting to raw {{(pid=75083) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 06:01:17 user nova-compute[75083]: DEBUG nova.privsep.utils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75083) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 06:01:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2.part /opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2.converted {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:17 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Successfully created port: b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2.part /opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2.converted" returned: 0 in 0.366s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2.converted --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "af2f29995b267185b2bf3f7328b3856925fb92a2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.211s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2 --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Successfully updated port: b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2 --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "af2f29995b267185b2bf3f7328b3856925fb92a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "af2f29995b267185b2bf3f7328b3856925fb92a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2 --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-b48361e4-bab7-470f-831f-8c19a4f3dfcb req-25d07264-30e7-4274-8dbd-aff8b2bb8b63 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received event network-changed-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-b48361e4-bab7-470f-831f-8c19a4f3dfcb req-25d07264-30e7-4274-8dbd-aff8b2bb8b63 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Refreshing instance network info cache due to event network-changed-b3126cae-fa19-4a34-b87a-5e97ca70770b. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b48361e4-bab7-470f-831f-8c19a4f3dfcb req-25d07264-30e7-4274-8dbd-aff8b2bb8b63 service nova] Acquiring lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b48361e4-bab7-470f-831f-8c19a4f3dfcb req-25d07264-30e7-4274-8dbd-aff8b2bb8b63 service nova] Acquired lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG nova.network.neutron [req-b48361e4-bab7-470f-831f-8c19a4f3dfcb req-25d07264-30e7-4274-8dbd-aff8b2bb8b63 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Refreshing network info cache for port b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2 --force-share --output=json" returned: 0 in 0.191s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2,backing_fmt=raw /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG nova.network.neutron [req-b48361e4-bab7-470f-831f-8c19a4f3dfcb req-25d07264-30e7-4274-8dbd-aff8b2bb8b63 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2,backing_fmt=raw /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk 1073741824" returned: 0 in 0.054s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "af2f29995b267185b2bf3f7328b3856925fb92a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:01:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2 --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2 --force-share --output=json" returned: 0 in 0.200s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.network.neutron [req-b48361e4-bab7-470f-831f-8c19a4f3dfcb req-25d07264-30e7-4274-8dbd-aff8b2bb8b63 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b48361e4-bab7-470f-831f-8c19a4f3dfcb req-25d07264-30e7-4274-8dbd-aff8b2bb8b63 service nova] Releasing lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquired lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Cannot resize image /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Ensure instance console log exists: /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Updating instance_info_cache with network_info: [{"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Releasing lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Instance network_info: |[{"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Start _get_guest_xml network_info=[{"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T06:01:13Z,direct_url=<?>,disk_format='qcow2',id=325c0786-2bab-4ff9-a435-46158e003aee,min_disk=0,min_ram=0,name='tempest-scenario-img--1388248791',owner='f0801cbd66c8457b887d383721d95915',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T06:01:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '325c0786-2bab-4ff9-a435-46158e003aee'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:01:19 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:01:19 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T06:01:13Z,direct_url=<?>,disk_format='qcow2',id=325c0786-2bab-4ff9-a435-46158e003aee,min_disk=0,min_ram=0,name='tempest-scenario-img--1388248791',owner='f0801cbd66c8457b887d383721d95915',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T06:01:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-534054970',display_name='tempest-TestMinimumBasicScenario-server-534054970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-534054970',id=30,image_ref='325c0786-2bab-4ff9-a435-46158e003aee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEN2s530aGNqCnv3Q2xJE1Vb0iCTwM9AOsamn/qxqdg0D1v7VpXgftDlWrVrqOqOuPZ9gUPuvoZNn/6knJQVreVVsytrn4dDpcRmQOd9fotXylI6tQ+iozlTHfRnex9sQ==',key_name='tempest-TestMinimumBasicScenario-631134433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0801cbd66c8457b887d383721d95915',ramdisk_id='',reservation_id='r-2trkv2ny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='325c0786-2bab-4ff9-a435-46158e003aee',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2019017585',owner_user_name='tempest-TestMinimumBasicScenario-2019017585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:01:17Z,user_data=None,user_id='eb526efdda0c4ca2ba8e739ecbe9e148',uuid=733f9905-c483-4835-8ec9-953b341950d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Converting VIF {"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=b3126cae-fa19-4a34-b87a-5e97ca70770b,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3126cae-fa') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lazy-loading 'pci_devices' on Instance uuid 733f9905-c483-4835-8ec9-953b341950d1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:01:19 user nova-compute[75083]:   <uuid>733f9905-c483-4835-8ec9-953b341950d1</uuid>
Nov 29 06:01:19 user nova-compute[75083]:   <name>instance-0000001e</name>
Nov 29 06:01:19 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:01:19 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:01:19 user nova-compute[75083]:   <metadata>
Nov 29 06:01:19 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:01:19 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:01:19 user nova-compute[75083]:       <nova:name>tempest-TestMinimumBasicScenario-server-534054970</nova:name>
Nov 29 06:01:19 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:01:19</nova:creationTime>
Nov 29 06:01:19 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:01:19 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:01:19 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:01:19 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:01:19 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:01:19 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:01:19 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:01:19 user nova-compute[75083]:       <nova:owner>
Nov 29 06:01:19 user nova-compute[75083]:         <nova:user uuid="eb526efdda0c4ca2ba8e739ecbe9e148">tempest-TestMinimumBasicScenario-2019017585-project-member</nova:user>
Nov 29 06:01:19 user nova-compute[75083]:         <nova:project uuid="f0801cbd66c8457b887d383721d95915">tempest-TestMinimumBasicScenario-2019017585</nova:project>
Nov 29 06:01:19 user nova-compute[75083]:       </nova:owner>
Nov 29 06:01:19 user nova-compute[75083]:       <nova:root type="image" uuid="325c0786-2bab-4ff9-a435-46158e003aee"/>
Nov 29 06:01:19 user nova-compute[75083]:       <nova:ports>
Nov 29 06:01:19 user nova-compute[75083]:         <nova:port uuid="b3126cae-fa19-4a34-b87a-5e97ca70770b">
Nov 29 06:01:19 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 06:01:19 user nova-compute[75083]:         </nova:port>
Nov 29 06:01:19 user nova-compute[75083]:       </nova:ports>
Nov 29 06:01:19 user nova-compute[75083]:     </nova:instance>
Nov 29 06:01:19 user nova-compute[75083]:   </metadata>
Nov 29 06:01:19 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:01:19 user nova-compute[75083]:     <system>
Nov 29 06:01:19 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:01:19 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:01:19 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:01:19 user nova-compute[75083]:       <entry name="serial">733f9905-c483-4835-8ec9-953b341950d1</entry>
Nov 29 06:01:19 user nova-compute[75083]:       <entry name="uuid">733f9905-c483-4835-8ec9-953b341950d1</entry>
Nov 29 06:01:19 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:01:19 user nova-compute[75083]:     </system>
Nov 29 06:01:19 user nova-compute[75083]:   </sysinfo>
Nov 29 06:01:19 user nova-compute[75083]:   <os>
Nov 29 06:01:19 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:01:19 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:01:19 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:01:19 user nova-compute[75083]:   </os>
Nov 29 06:01:19 user nova-compute[75083]:   <features>
Nov 29 06:01:19 user nova-compute[75083]:     <acpi/>
Nov 29 06:01:19 user nova-compute[75083]:     <apic/>
Nov 29 06:01:19 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:01:19 user nova-compute[75083]:   </features>
Nov 29 06:01:19 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:01:19 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:01:19 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:01:19 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:01:19 user nova-compute[75083]:   </clock>
Nov 29 06:01:19 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:01:19 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:01:19 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:01:19 user nova-compute[75083]:   </cpu>
Nov 29 06:01:19 user nova-compute[75083]:   <devices>
Nov 29 06:01:19 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:01:19 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:01:19 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk"/>
Nov 29 06:01:19 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:01:19 user nova-compute[75083]:     </disk>
Nov 29 06:01:19 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:01:19 user nova-compute[75083]:       <mac address="fa:16:3e:16:1e:34"/>
Nov 29 06:01:19 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:01:19 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:01:19 user nova-compute[75083]:       <target dev="tapb3126cae-fa"/>
Nov 29 06:01:19 user nova-compute[75083]:     </interface>
Nov 29 06:01:19 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:01:19 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/console.log" append="off"/>
Nov 29 06:01:19 user nova-compute[75083]:     </serial>
Nov 29 06:01:19 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:01:19 user nova-compute[75083]:     <video>
Nov 29 06:01:19 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:01:19 user nova-compute[75083]:     </video>
Nov 29 06:01:19 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:01:19 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:01:19 user nova-compute[75083]:     </rng>
Nov 29 06:01:19 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:01:19 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:01:19 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:01:19 user nova-compute[75083]:     </memballoon>
Nov 29 06:01:19 user nova-compute[75083]:   </devices>
Nov 29 06:01:19 user nova-compute[75083]: </domain>
Nov 29 06:01:19 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-534054970',display_name='tempest-TestMinimumBasicScenario-server-534054970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-534054970',id=30,image_ref='325c0786-2bab-4ff9-a435-46158e003aee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEN2s530aGNqCnv3Q2xJE1Vb0iCTwM9AOsamn/qxqdg0D1v7VpXgftDlWrVrqOqOuPZ9gUPuvoZNn/6knJQVreVVsytrn4dDpcRmQOd9fotXylI6tQ+iozlTHfRnex9sQ==',key_name='tempest-TestMinimumBasicScenario-631134433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0801cbd66c8457b887d383721d95915',ramdisk_id='',reservation_id='r-2trkv2ny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='325c0786-2bab-4ff9-a435-46158e003aee',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2019017585',owner_user_name='tempest-TestMinimumBasicScenario-2019017585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:01:17Z,user_data=None,user_id='eb526efdda0c4ca2ba8e739ecbe9e148',uuid=733f9905-c483-4835-8ec9-953b341950d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Converting VIF {"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=b3126cae-fa19-4a34-b87a-5e97ca70770b,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3126cae-fa') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG os_vif [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=b3126cae-fa19-4a34-b87a-5e97ca70770b,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3126cae-fa') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '511322df-534b-520f-9661-3e5786dc5ed7', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3126cae-fa, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3126cae-fa, col_values=(('qos', UUID('ee8a3949-1cd7-4546-96d1-c8dd1df0010a')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3126cae-fa, col_values=(('external_ids', {'iface-id': 'b3126cae-fa19-4a34-b87a-5e97ca70770b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:1e:34', 'vm-uuid': '733f9905-c483-4835-8ec9-953b341950d1'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:19 user nova-compute[75083]: INFO os_vif [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=b3126cae-fa19-4a34-b87a-5e97ca70770b,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3126cae-fa')
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:01:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] No VIF found with MAC fa:16:3e:16:1e:34, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:01:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:21 user nova-compute[75083]: DEBUG nova.compute.manager [req-bde9114d-7a6b-4c28-9d3c-daf9986276f7 req-f201ae48-a7db-4250-ba41-04e123af6412 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received event network-vif-plugged-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:01:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bde9114d-7a6b-4c28-9d3c-daf9986276f7 req-f201ae48-a7db-4250-ba41-04e123af6412 service nova] Acquiring lock "733f9905-c483-4835-8ec9-953b341950d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:01:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bde9114d-7a6b-4c28-9d3c-daf9986276f7 req-f201ae48-a7db-4250-ba41-04e123af6412 service nova] Lock "733f9905-c483-4835-8ec9-953b341950d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:01:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bde9114d-7a6b-4c28-9d3c-daf9986276f7 req-f201ae48-a7db-4250-ba41-04e123af6412 service nova] Lock "733f9905-c483-4835-8ec9-953b341950d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:01:21 user nova-compute[75083]: DEBUG nova.compute.manager [req-bde9114d-7a6b-4c28-9d3c-daf9986276f7 req-f201ae48-a7db-4250-ba41-04e123af6412 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] No waiting events found dispatching network-vif-plugged-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:01:21 user nova-compute[75083]: WARNING nova.compute.manager [req-bde9114d-7a6b-4c28-9d3c-daf9986276f7 req-f201ae48-a7db-4250-ba41-04e123af6412 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received unexpected event network-vif-plugged-b3126cae-fa19-4a34-b87a-5e97ca70770b for instance with vm_state building and task_state spawning.
Nov 29 06:01:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:23 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:01:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:01:23 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Instance spawned successfully.
Nov 29 06:01:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:01:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:01:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:01:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:01:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:01:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:01:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:01:23 user nova-compute[75083]: INFO nova.compute.manager [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Took 6.11 seconds to spawn the instance on the hypervisor.
Nov 29 06:01:23 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:01:23 user nova-compute[75083]: INFO nova.compute.manager [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Took 6.88 seconds to build instance.
Nov 29 06:01:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9b820510-6568-4ff9-a925-cfc3b003e553 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "733f9905-c483-4835-8ec9-953b341950d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.214s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:01:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-7f40defe-efc0-4fbd-907d-667004539a29 req-afb42a44-1f56-4113-aa5a-d494be5ab66d service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received event network-vif-plugged-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:01:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7f40defe-efc0-4fbd-907d-667004539a29 req-afb42a44-1f56-4113-aa5a-d494be5ab66d service nova] Acquiring lock "733f9905-c483-4835-8ec9-953b341950d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:01:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7f40defe-efc0-4fbd-907d-667004539a29 req-afb42a44-1f56-4113-aa5a-d494be5ab66d service nova] Lock "733f9905-c483-4835-8ec9-953b341950d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:01:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7f40defe-efc0-4fbd-907d-667004539a29 req-afb42a44-1f56-4113-aa5a-d494be5ab66d service nova] Lock "733f9905-c483-4835-8ec9-953b341950d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:01:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-7f40defe-efc0-4fbd-907d-667004539a29 req-afb42a44-1f56-4113-aa5a-d494be5ab66d service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] No waiting events found dispatching network-vif-plugged-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:01:23 user nova-compute[75083]: WARNING nova.compute.manager [req-7f40defe-efc0-4fbd-907d-667004539a29 req-afb42a44-1f56-4113-aa5a-d494be5ab66d service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received unexpected event network-vif-plugged-b3126cae-fa19-4a34-b87a-5e97ca70770b for instance with vm_state active and task_state None.
Nov 29 06:01:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:30 user nova-compute[75083]: DEBUG nova.compute.manager [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:01:30 user nova-compute[75083]: INFO nova.compute.manager [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] instance snapshotting
Nov 29 06:01:30 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Beginning live snapshot process
Nov 29 06:01:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json -f qcow2 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json -f qcow2 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.187s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7ep_efxk/22075b7a1c77446ab24e3b335d0f0d8a.delta 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7ep_efxk/22075b7a1c77446ab24e3b335d0f0d8a.delta 1073741824" returned: 0 in 0.057s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:30 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 06:01:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 06:01:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 06:01:32 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 06:01:32 user nova-compute[75083]: DEBUG nova.privsep.utils [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75083) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 06:01:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7ep_efxk/22075b7a1c77446ab24e3b335d0f0d8a.delta /opt/stack/data/nova/instances/snapshots/tmp7ep_efxk/22075b7a1c77446ab24e3b335d0f0d8a {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:01:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7ep_efxk/22075b7a1c77446ab24e3b335d0f0d8a.delta /opt/stack/data/nova/instances/snapshots/tmp7ep_efxk/22075b7a1c77446ab24e3b335d0f0d8a" returned: 0 in 0.470s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:01:32 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Snapshot extracted, beginning image upload
Nov 29 06:01:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-71385974-2a9b-44aa-9de0-6be9877431f6 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:01:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-71385974-2a9b-44aa-9de0-6be9877431f6 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.003s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:01:33 user nova-compute[75083]: DEBUG nova.compute.manager [None req-71385974-2a9b-44aa-9de0-6be9877431f6 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Going to confirm migration 2 {{(pid=75083) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 29 06:01:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-71385974-2a9b-44aa-9de0-6be9877431f6 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:01:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-71385974-2a9b-44aa-9de0-6be9877431f6 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquired lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:01:34 user nova-compute[75083]: DEBUG nova.network.neutron [None req-71385974-2a9b-44aa-9de0-6be9877431f6 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:01:34 user nova-compute[75083]: DEBUG nova.objects.instance [None req-71385974-2a9b-44aa-9de0-6be9877431f6 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lazy-loading 'info_cache' on Instance uuid 18dc5c9c-8fb3-41c7-a124-4881788b3c48 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:01:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:34 user nova-compute[75083]: DEBUG nova.network.neutron [None req-71385974-2a9b-44aa-9de0-6be9877431f6 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Updating instance_info_cache with network_info: [{"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:01:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-71385974-2a9b-44aa-9de0-6be9877431f6 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Releasing lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:01:34 user nova-compute[75083]: DEBUG nova.objects.instance [None req-71385974-2a9b-44aa-9de0-6be9877431f6 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lazy-loading 'migration_context' on Instance uuid 18dc5c9c-8fb3-41c7-a124-4881788b3c48 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:01:34 user nova-compute[75083]: DEBUG nova.objects.base [None req-71385974-2a9b-44aa-9de0-6be9877431f6 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Object Instance<18dc5c9c-8fb3-41c7-a124-4881788b3c48> lazy-loaded attributes: info_cache,migration_context {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 06:01:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-71385974-2a9b-44aa-9de0-6be9877431f6 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:01:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-71385974-2a9b-44aa-9de0-6be9877431f6 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:01:35 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-71385974-2a9b-44aa-9de0-6be9877431f6 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:01:35 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-71385974-2a9b-44aa-9de0-6be9877431f6 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:01:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-71385974-2a9b-44aa-9de0-6be9877431f6 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.446s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:01:35 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-71385974-2a9b-44aa-9de0-6be9877431f6 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Deleted allocation for migration 49e09399-1a55-4d89-8ea2-7b2c618edfcd
Nov 29 06:01:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-71385974-2a9b-44aa-9de0-6be9877431f6 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.490s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:01:35 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Snapshot image upload complete
Nov 29 06:01:35 user nova-compute[75083]: INFO nova.compute.manager [None req-96c4f028-b0f1-4af7-8fac-1c0bd5e62508 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Took 5.68 seconds to snapshot the instance on the hypervisor.
Nov 29 06:01:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:01:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:04 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:02:04 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:02:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:02:05 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:02:05 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:02:06 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:02:08 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:02:08 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75083) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 06:02:09 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:02:09 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:02:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:09 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:02:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:02:13 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:02:13 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=7908MB free_disk=25.15581512451172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 161c6455-90ce-4c40-a33e-7f582989135d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4435ed78-e35f-4859-8a4f-9920815d968a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a34d9d98-be73-4d52-85f0-83e48f60bc12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 05f45fef-c8a7-41c1-a571-863307caca6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 18dc5c9c-8fb3-41c7-a124-4881788b3c48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a6e1c2d7-1181-4d9f-99eb-d401d5f73b25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 733f9905-c483-4835-8ec9-953b341950d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing inventories for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Updating ProviderTree inventory for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Updating inventory in ProviderTree for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing aggregate associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, aggregates: None {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing trait associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, traits: HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.630s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] There are 0 instances to clean {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 06:02:13 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:02:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:15 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:02:15 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:02:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-05f45fef-c8a7-41c1-a571-863307caca6a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:02:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-05f45fef-c8a7-41c1-a571-863307caca6a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:02:15 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:02:16 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Updating instance_info_cache with network_info: [{"id": "27a46712-1675-4c3d-83bd-9131f899b487", "address": "fa:16:3e:a8:58:c9", "network": {"id": "f41035e0-21bb-472a-959b-099a854e4629", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-994952120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b42598c48c05439f8059b4b8bf30b9dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a46712-16", "ovs_interfaceid": "27a46712-1675-4c3d-83bd-9131f899b487", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:02:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-05f45fef-c8a7-41c1-a571-863307caca6a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:02:16 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:02:16 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:02:16 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:02:16 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:02:19 user nova-compute[75083]: DEBUG nova.compute.manager [req-5ce0e847-da7b-4a9a-8fa0-a5bc15546eec req-3d2feea1-5dec-486f-b7ef-9e95ee69f85a service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Received event network-changed-ec1e3052-9df5-4761-a59e-cd649ad258e9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:02:19 user nova-compute[75083]: DEBUG nova.compute.manager [req-5ce0e847-da7b-4a9a-8fa0-a5bc15546eec req-3d2feea1-5dec-486f-b7ef-9e95ee69f85a service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Refreshing instance network info cache due to event network-changed-ec1e3052-9df5-4761-a59e-cd649ad258e9. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:02:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5ce0e847-da7b-4a9a-8fa0-a5bc15546eec req-3d2feea1-5dec-486f-b7ef-9e95ee69f85a service nova] Acquiring lock "refresh_cache-a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:02:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5ce0e847-da7b-4a9a-8fa0-a5bc15546eec req-3d2feea1-5dec-486f-b7ef-9e95ee69f85a service nova] Acquired lock "refresh_cache-a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:02:19 user nova-compute[75083]: DEBUG nova.network.neutron [req-5ce0e847-da7b-4a9a-8fa0-a5bc15546eec req-3d2feea1-5dec-486f-b7ef-9e95ee69f85a service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Refreshing network info cache for port ec1e3052-9df5-4761-a59e-cd649ad258e9 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:02:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:19 user nova-compute[75083]: DEBUG nova.network.neutron [req-5ce0e847-da7b-4a9a-8fa0-a5bc15546eec req-3d2feea1-5dec-486f-b7ef-9e95ee69f85a service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Updated VIF entry in instance network info cache for port ec1e3052-9df5-4761-a59e-cd649ad258e9. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:02:19 user nova-compute[75083]: DEBUG nova.network.neutron [req-5ce0e847-da7b-4a9a-8fa0-a5bc15546eec req-3d2feea1-5dec-486f-b7ef-9e95ee69f85a service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Updating instance_info_cache with network_info: [{"id": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "address": "fa:16:3e:ff:41:7d", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1e3052-9d", "ovs_interfaceid": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:02:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5ce0e847-da7b-4a9a-8fa0-a5bc15546eec req-3d2feea1-5dec-486f-b7ef-9e95ee69f85a service nova] Releasing lock "refresh_cache-a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:02:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:21 user nova-compute[75083]: DEBUG nova.objects.instance [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lazy-loading 'flavor' on Instance uuid a6e1c2d7-1181-4d9f-99eb-d401d5f73b25 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:22 user nova-compute[75083]: INFO nova.compute.manager [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Attaching volume 67ce4130-2536-4b45-8b5e-e4c94ad16542 to /dev/vdb
Nov 29 06:02:22 user nova-compute[75083]: DEBUG os_brick.utils [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f033248-920a-42c8-bd09-38f678fec276]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db92568-a2ab-4cdf-b229-a07eae1b57d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc481393-2c40-489e-a0b6-2461c59ce552]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[807550f8-4bcb-4015-94a0-488839523bde]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:02:22 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:02:22 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[252be0e1-61e9-4238-9dff-0d101821e51d]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG os_brick.utils [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:02:22 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Updating existing volume attachment record: 2d58c06d-43f9-4a7b-bade-bda628754f51 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:02:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLzbWoDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:02:29 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:02:29 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:02:29 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a2b35e-e2f5-47a0-abb0-c35d1c3d6e39]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:02:29 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84c7d66-d628-4d22-8075-77b2b2e6451c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542] added
Nov 29 06:02:29 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f29d280-4bb0-41b8-afe8-fd4faebaabc7]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[432ee819-1179-4db3-b98a-dd9f099906b2]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dLzbWoDt {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dLzbWoDt" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b64780b-38ec-422b-add1-dfafdde32088]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dLzbWoDt'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[159026c5-82af-4919-a024-afc952504c8b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4a6b19-5b56-4362-acef-744141722301]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:02:29 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:02:29 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3886d8c7-d322-4a14-8cca-52c6ee4100da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542, portal: 172.16.0.220,3260]
Nov 29 06:02:29 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542, portal: 172.16.0.220,3260] successful.
Nov 29 06:02:29 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7969e92d-ac6f-482c-a862-b28df385499b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23e0994-8eb9-46fc-94bd-29d0dfaae6ce]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:02:29 user nova-compute[75083]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:02:29 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:02:29 user nova-compute[75083]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:02:29 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bb04f9-90fe-45a9-b697-b3b06bb32fc6]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:02:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLzbWoDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:02:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:02:30 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26463333064343266', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:02:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463333064343266', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:02:30 user nova-compute[75083]: DEBUG nova.objects.instance [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lazy-loading 'flavor' on Instance uuid a6e1c2d7-1181-4d9f-99eb-d401d5f73b25 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:02:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 06:02:30 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:02:30 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:02:30 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:02:30 user nova-compute[75083]:   <serial>67ce4130-2536-4b45-8b5e-e4c94ad16542</serial>
Nov 29 06:02:30 user nova-compute[75083]: </disk>
Nov 29 06:02:30 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 06:02:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:02:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:02:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] No VIF found with MAC fa:16:3e:ff:41:7d, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:02:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-24eb4ae1-0c71-4739-891c-904b7b21271c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.502s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:02:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "81060822-ed09-4cfe-83c2-e5301b38bd71" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "81060822-ed09-4cfe-83c2-e5301b38bd71" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:02:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:35 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:02:35 user nova-compute[75083]: INFO nova.compute.claims [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Claim successful on node user
Nov 29 06:02:35 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:02:35 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:02:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:02:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:02:35 user nova-compute[75083]: DEBUG nova.network.neutron [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:02:35 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:02:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:02:35 user nova-compute[75083]: DEBUG nova.policy [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4dc42da0ede8433a827629a68e691658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112a98f04dc141dfbb0f7a10fd410cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:02:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:02:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:02:35 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Creating image(s)
Nov 29 06:02:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "/opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "/opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "/opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.190s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71/disk 1073741824" returned: 0 in 0.055s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.168s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:36 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 06:02:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:36 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Cannot resize image /opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 06:02:36 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 06:02:36 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Ensure instance console log exists: /opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:02:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:37 user nova-compute[75083]: DEBUG nova.network.neutron [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Successfully created port: 89b1aa1d-d184-456e-9abf-235e1b72201f {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:02:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Acquiring lock "60f356b4-fa3d-4115-b868-f7b470ce7c87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Lock "60f356b4-fa3d-4115-b868-f7b470ce7c87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:37 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:02:37 user nova-compute[75083]: DEBUG nova.network.neutron [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Successfully updated port: 89b1aa1d-d184-456e-9abf-235e1b72201f {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:02:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "refresh_cache-81060822-ed09-4cfe-83c2-e5301b38bd71" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:02:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquired lock "refresh_cache-81060822-ed09-4cfe-83c2-e5301b38bd71" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:02:37 user nova-compute[75083]: DEBUG nova.network.neutron [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:02:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:37 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:02:37 user nova-compute[75083]: INFO nova.compute.claims [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Claim successful on node user
Nov 29 06:02:37 user nova-compute[75083]: DEBUG nova.compute.manager [req-bf24713d-60ec-4ee0-9621-a216af58b63c req-0b60cadd-93e9-4c55-9703-f211f44e8439 service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Received event network-changed-89b1aa1d-d184-456e-9abf-235e1b72201f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:02:37 user nova-compute[75083]: DEBUG nova.compute.manager [req-bf24713d-60ec-4ee0-9621-a216af58b63c req-0b60cadd-93e9-4c55-9703-f211f44e8439 service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Refreshing instance network info cache due to event network-changed-89b1aa1d-d184-456e-9abf-235e1b72201f. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:02:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bf24713d-60ec-4ee0-9621-a216af58b63c req-0b60cadd-93e9-4c55-9703-f211f44e8439 service nova] Acquiring lock "refresh_cache-81060822-ed09-4cfe-83c2-e5301b38bd71" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:02:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "fea64bdc-491c-46ba-9447-c175df432deb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "fea64bdc-491c-46ba-9447-c175df432deb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:37 user nova-compute[75083]: DEBUG nova.network.neutron [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:02:37 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:02:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.network.neutron [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Updating instance_info_cache with network_info: [{"id": "89b1aa1d-d184-456e-9abf-235e1b72201f", "address": "fa:16:3e:0b:b5:06", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b1aa1d-d1", "ovs_interfaceid": "89b1aa1d-d184-456e-9abf-235e1b72201f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Releasing lock "refresh_cache-81060822-ed09-4cfe-83c2-e5301b38bd71" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Instance network_info: |[{"id": "89b1aa1d-d184-456e-9abf-235e1b72201f", "address": "fa:16:3e:0b:b5:06", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b1aa1d-d1", "ovs_interfaceid": "89b1aa1d-d184-456e-9abf-235e1b72201f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bf24713d-60ec-4ee0-9621-a216af58b63c req-0b60cadd-93e9-4c55-9703-f211f44e8439 service nova] Acquired lock "refresh_cache-81060822-ed09-4cfe-83c2-e5301b38bd71" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.network.neutron [req-bf24713d-60ec-4ee0-9621-a216af58b63c req-0b60cadd-93e9-4c55-9703-f211f44e8439 service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Refreshing network info cache for port 89b1aa1d-d184-456e-9abf-235e1b72201f {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Start _get_guest_xml network_info=[{"id": "89b1aa1d-d184-456e-9abf-235e1b72201f", "address": "fa:16:3e:0b:b5:06", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b1aa1d-d1", "ovs_interfaceid": "89b1aa1d-d184-456e-9abf-235e1b72201f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:02:38 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:02:38 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-199177077',display_name='tempest-AttachVolumeNegativeTest-server-199177077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-199177077',id=31,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUEVv5B+K8M5rUKCiUz4RKLKkcOl4ix0TaJpEtgy72reY7CtqWJynN/39L8UqxIDJjPK/Tw2j69yDUaD8DBx+phizGaVu+ri85XqGO25ekMZu91NNX4bD24vTbkOAy8sw==',key_name='tempest-keypair-786764528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112a98f04dc141dfbb0f7a10fd410cae',ramdisk_id='',reservation_id='r-7z70okgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1387142425',owner_user_name='tempest-AttachVolumeNegativeTest-1387142425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dc42da0ede8433a827629a68e691658',uuid=81060822-ed09-4cfe-83c2-e5301b38bd71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89b1aa1d-d184-456e-9abf-235e1b72201f", "address": "fa:16:3e:0b:b5:06", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b1aa1d-d1", "ovs_interfaceid": "89b1aa1d-d184-456e-9abf-235e1b72201f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converting VIF {"id": "89b1aa1d-d184-456e-9abf-235e1b72201f", "address": "fa:16:3e:0b:b5:06", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b1aa1d-d1", "ovs_interfaceid": "89b1aa1d-d184-456e-9abf-235e1b72201f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b5:06,bridge_name='br-int',has_traffic_filtering=True,id=89b1aa1d-d184-456e-9abf-235e1b72201f,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b1aa1d-d1') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.objects.instance [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lazy-loading 'pci_devices' on Instance uuid 81060822-ed09-4cfe-83c2-e5301b38bd71 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:02:38 user nova-compute[75083]:   <uuid>81060822-ed09-4cfe-83c2-e5301b38bd71</uuid>
Nov 29 06:02:38 user nova-compute[75083]:   <name>instance-0000001f</name>
Nov 29 06:02:38 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:02:38 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:02:38 user nova-compute[75083]:   <metadata>
Nov 29 06:02:38 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:02:38 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:02:38 user nova-compute[75083]:       <nova:name>tempest-AttachVolumeNegativeTest-server-199177077</nova:name>
Nov 29 06:02:38 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:02:38</nova:creationTime>
Nov 29 06:02:38 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:02:38 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:02:38 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:02:38 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:02:38 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:02:38 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:02:38 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:02:38 user nova-compute[75083]:       <nova:owner>
Nov 29 06:02:38 user nova-compute[75083]:         <nova:user uuid="4dc42da0ede8433a827629a68e691658">tempest-AttachVolumeNegativeTest-1387142425-project-member</nova:user>
Nov 29 06:02:38 user nova-compute[75083]:         <nova:project uuid="112a98f04dc141dfbb0f7a10fd410cae">tempest-AttachVolumeNegativeTest-1387142425</nova:project>
Nov 29 06:02:38 user nova-compute[75083]:       </nova:owner>
Nov 29 06:02:38 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 06:02:38 user nova-compute[75083]:       <nova:ports>
Nov 29 06:02:38 user nova-compute[75083]:         <nova:port uuid="89b1aa1d-d184-456e-9abf-235e1b72201f">
Nov 29 06:02:38 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 06:02:38 user nova-compute[75083]:         </nova:port>
Nov 29 06:02:38 user nova-compute[75083]:       </nova:ports>
Nov 29 06:02:38 user nova-compute[75083]:     </nova:instance>
Nov 29 06:02:38 user nova-compute[75083]:   </metadata>
Nov 29 06:02:38 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:02:38 user nova-compute[75083]:     <system>
Nov 29 06:02:38 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:02:38 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:02:38 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:02:38 user nova-compute[75083]:       <entry name="serial">81060822-ed09-4cfe-83c2-e5301b38bd71</entry>
Nov 29 06:02:38 user nova-compute[75083]:       <entry name="uuid">81060822-ed09-4cfe-83c2-e5301b38bd71</entry>
Nov 29 06:02:38 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:02:38 user nova-compute[75083]:     </system>
Nov 29 06:02:38 user nova-compute[75083]:   </sysinfo>
Nov 29 06:02:38 user nova-compute[75083]:   <os>
Nov 29 06:02:38 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:02:38 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:02:38 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:02:38 user nova-compute[75083]:   </os>
Nov 29 06:02:38 user nova-compute[75083]:   <features>
Nov 29 06:02:38 user nova-compute[75083]:     <acpi/>
Nov 29 06:02:38 user nova-compute[75083]:     <apic/>
Nov 29 06:02:38 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:02:38 user nova-compute[75083]:   </features>
Nov 29 06:02:38 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:02:38 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:02:38 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:02:38 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:02:38 user nova-compute[75083]:   </clock>
Nov 29 06:02:38 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:02:38 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:02:38 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:02:38 user nova-compute[75083]:   </cpu>
Nov 29 06:02:38 user nova-compute[75083]:   <devices>
Nov 29 06:02:38 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:02:38 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:02:38 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71/disk"/>
Nov 29 06:02:38 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:02:38 user nova-compute[75083]:     </disk>
Nov 29 06:02:38 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:02:38 user nova-compute[75083]:       <mac address="fa:16:3e:0b:b5:06"/>
Nov 29 06:02:38 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:02:38 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:02:38 user nova-compute[75083]:       <target dev="tap89b1aa1d-d1"/>
Nov 29 06:02:38 user nova-compute[75083]:     </interface>
Nov 29 06:02:38 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:02:38 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71/console.log" append="off"/>
Nov 29 06:02:38 user nova-compute[75083]:     </serial>
Nov 29 06:02:38 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:02:38 user nova-compute[75083]:     <video>
Nov 29 06:02:38 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:02:38 user nova-compute[75083]:     </video>
Nov 29 06:02:38 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:02:38 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:02:38 user nova-compute[75083]:     </rng>
Nov 29 06:02:38 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:02:38 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:02:38 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:02:38 user nova-compute[75083]:     </memballoon>
Nov 29 06:02:38 user nova-compute[75083]:   </devices>
Nov 29 06:02:38 user nova-compute[75083]: </domain>
Nov 29 06:02:38 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-199177077',display_name='tempest-AttachVolumeNegativeTest-server-199177077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-199177077',id=31,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUEVv5B+K8M5rUKCiUz4RKLKkcOl4ix0TaJpEtgy72reY7CtqWJynN/39L8UqxIDJjPK/Tw2j69yDUaD8DBx+phizGaVu+ri85XqGO25ekMZu91NNX4bD24vTbkOAy8sw==',key_name='tempest-keypair-786764528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112a98f04dc141dfbb0f7a10fd410cae',ramdisk_id='',reservation_id='r-7z70okgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1387142425',owner_user_name='tempest-AttachVolumeNegativeTest-1387142425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dc42da0ede8433a827629a68e691658',uuid=81060822-ed09-4cfe-83c2-e5301b38bd71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89b1aa1d-d184-456e-9abf-235e1b72201f", "address": "fa:16:3e:0b:b5:06", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b1aa1d-d1", "ovs_interfaceid": "89b1aa1d-d184-456e-9abf-235e1b72201f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converting VIF {"id": "89b1aa1d-d184-456e-9abf-235e1b72201f", "address": "fa:16:3e:0b:b5:06", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b1aa1d-d1", "ovs_interfaceid": "89b1aa1d-d184-456e-9abf-235e1b72201f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b5:06,bridge_name='br-int',has_traffic_filtering=True,id=89b1aa1d-d184-456e-9abf-235e1b72201f,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b1aa1d-d1') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG os_vif [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b5:06,bridge_name='br-int',has_traffic_filtering=True,id=89b1aa1d-d184-456e-9abf-235e1b72201f,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b1aa1d-d1') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6a35f94-689a-5636-9dd4-4c9e67337f1b', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89b1aa1d-d1, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89b1aa1d-d1, col_values=(('qos', UUID('b2a4f050-eab9-4839-9573-9c2a4df90201')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89b1aa1d-d1, col_values=(('external_ids', {'iface-id': '89b1aa1d-d184-456e-9abf-235e1b72201f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:b5:06', 'vm-uuid': '81060822-ed09-4cfe-83c2-e5301b38bd71'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.375s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:38 user nova-compute[75083]: INFO os_vif [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b5:06,bridge_name='br-int',has_traffic_filtering=True,id=89b1aa1d-d184-456e-9abf-235e1b72201f,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b1aa1d-d1')
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:02:38 user nova-compute[75083]: INFO nova.compute.claims [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Claim successful on node user
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] No VIF found with MAC fa:16:3e:0b:b5:06, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:02:38 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:02:38 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Creating image(s)
Nov 29 06:02:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Acquiring lock "/opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Lock "/opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Lock "/opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.policy [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '627cfb252f124a61998c0596bf31ce2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f7413e8444428ab7add73fcacd6d03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.network.neutron [req-bf24713d-60ec-4ee0-9621-a216af58b63c req-0b60cadd-93e9-4c55-9703-f211f44e8439 service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Updated VIF entry in instance network info cache for port 89b1aa1d-d184-456e-9abf-235e1b72201f. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.network.neutron [req-bf24713d-60ec-4ee0-9621-a216af58b63c req-0b60cadd-93e9-4c55-9703-f211f44e8439 service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Updating instance_info_cache with network_info: [{"id": "89b1aa1d-d184-456e-9abf-235e1b72201f", "address": "fa:16:3e:0b:b5:06", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b1aa1d-d1", "ovs_interfaceid": "89b1aa1d-d184-456e-9abf-235e1b72201f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bf24713d-60ec-4ee0-9621-a216af58b63c req-0b60cadd-93e9-4c55-9703-f211f44e8439 service nova] Releasing lock "refresh_cache-81060822-ed09-4cfe-83c2-e5301b38bd71" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.191s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:38 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:02:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87/disk 1073741824" returned: 0 in 0.053s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:02:39 user nova-compute[75083]: INFO nova.virt.block_device [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Booting with blank volume at /dev/vda
Nov 29 06:02:39 user nova-compute[75083]: DEBUG nova.policy [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4145bf5a07ea4d398f1a1e10a976c10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47694ecf400b4d6c952d0c06d0764d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:02:39 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:39 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 06:02:39 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:39 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:39 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Cannot resize image /opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 06:02:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 06:02:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Ensure instance console log exists: /opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:02:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:39 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Successfully created port: a93a1617-10a0-4d21-a8c5-5527f662de73 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:02:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:39 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Successfully created port: 1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:02:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-a3fd1929-4d98-40fe-b62b-facdac3ec965 req-a90e0bd1-2323-41bd-a0a2-2b26cecd945e service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Received event network-vif-plugged-89b1aa1d-d184-456e-9abf-235e1b72201f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:02:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a3fd1929-4d98-40fe-b62b-facdac3ec965 req-a90e0bd1-2323-41bd-a0a2-2b26cecd945e service nova] Acquiring lock "81060822-ed09-4cfe-83c2-e5301b38bd71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a3fd1929-4d98-40fe-b62b-facdac3ec965 req-a90e0bd1-2323-41bd-a0a2-2b26cecd945e service nova] Lock "81060822-ed09-4cfe-83c2-e5301b38bd71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a3fd1929-4d98-40fe-b62b-facdac3ec965 req-a90e0bd1-2323-41bd-a0a2-2b26cecd945e service nova] Lock "81060822-ed09-4cfe-83c2-e5301b38bd71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-a3fd1929-4d98-40fe-b62b-facdac3ec965 req-a90e0bd1-2323-41bd-a0a2-2b26cecd945e service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] No waiting events found dispatching network-vif-plugged-89b1aa1d-d184-456e-9abf-235e1b72201f {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:02:40 user nova-compute[75083]: WARNING nova.compute.manager [req-a3fd1929-4d98-40fe-b62b-facdac3ec965 req-a90e0bd1-2323-41bd-a0a2-2b26cecd945e service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Received unexpected event network-vif-plugged-89b1aa1d-d184-456e-9abf-235e1b72201f for instance with vm_state building and task_state spawning.
Nov 29 06:02:40 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Successfully updated port: a93a1617-10a0-4d21-a8c5-5527f662de73 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:02:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Acquiring lock "refresh_cache-60f356b4-fa3d-4115-b868-f7b470ce7c87" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:02:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Acquired lock "refresh_cache-60f356b4-fa3d-4115-b868-f7b470ce7c87" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:02:40 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:02:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-e021ca16-89ea-4e7c-aad8-2002cbdf1e82 req-8b61ae07-b7f8-4ea1-83d4-54a6a3d95957 service nova] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Received event network-changed-a93a1617-10a0-4d21-a8c5-5527f662de73 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:02:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-e021ca16-89ea-4e7c-aad8-2002cbdf1e82 req-8b61ae07-b7f8-4ea1-83d4-54a6a3d95957 service nova] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Refreshing instance network info cache due to event network-changed-a93a1617-10a0-4d21-a8c5-5527f662de73. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:02:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e021ca16-89ea-4e7c-aad8-2002cbdf1e82 req-8b61ae07-b7f8-4ea1-83d4-54a6a3d95957 service nova] Acquiring lock "refresh_cache-60f356b4-fa3d-4115-b868-f7b470ce7c87" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:02:40 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Successfully updated port: 1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquired lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Updating instance_info_cache with network_info: [{"id": "a93a1617-10a0-4d21-a8c5-5527f662de73", "address": "fa:16:3e:47:cd:ac", "network": {"id": "e53c6a58-bbc4-4602-b43f-81e3a477baf4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "338a11d250eb4a7a9ead9ff296e79514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93a1617-10", "ovs_interfaceid": "a93a1617-10a0-4d21-a8c5-5527f662de73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Releasing lock "refresh_cache-60f356b4-fa3d-4115-b868-f7b470ce7c87" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Instance network_info: |[{"id": "a93a1617-10a0-4d21-a8c5-5527f662de73", "address": "fa:16:3e:47:cd:ac", "network": {"id": "e53c6a58-bbc4-4602-b43f-81e3a477baf4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "338a11d250eb4a7a9ead9ff296e79514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93a1617-10", "ovs_interfaceid": "a93a1617-10a0-4d21-a8c5-5527f662de73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e021ca16-89ea-4e7c-aad8-2002cbdf1e82 req-8b61ae07-b7f8-4ea1-83d4-54a6a3d95957 service nova] Acquired lock "refresh_cache-60f356b4-fa3d-4115-b868-f7b470ce7c87" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.network.neutron [req-e021ca16-89ea-4e7c-aad8-2002cbdf1e82 req-8b61ae07-b7f8-4ea1-83d4-54a6a3d95957 service nova] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Refreshing network info cache for port a93a1617-10a0-4d21-a8c5-5527f662de73 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Start _get_guest_xml network_info=[{"id": "a93a1617-10a0-4d21-a8c5-5527f662de73", "address": "fa:16:3e:47:cd:ac", "network": {"id": "e53c6a58-bbc4-4602-b43f-81e3a477baf4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "338a11d250eb4a7a9ead9ff296e79514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93a1617-10", "ovs_interfaceid": "a93a1617-10a0-4d21-a8c5-5527f662de73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:02:41 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:02:41 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:02:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-694878787',display_name='tempest-VolumesNegativeTest-instance-694878787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-694878787',id=32,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1f7413e8444428ab7add73fcacd6d03',ramdisk_id='',reservation_id='r-6vmtbpz3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-29446818',owner_user_name='tempest-VolumesNegativeTest-29446818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:02:38Z,user_data=None,user_id='627cfb252f124a61998c0596bf31ce2d',uuid=60f356b4-fa3d-4115-b868-f7b470ce7c87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a93a1617-10a0-4d21-a8c5-5527f662de73", "address": "fa:16:3e:47:cd:ac", "network": {"id": "e53c6a58-bbc4-4602-b43f-81e3a477baf4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "338a11d250eb4a7a9ead9ff296e79514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93a1617-10", "ovs_interfaceid": "a93a1617-10a0-4d21-a8c5-5527f662de73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Converting VIF {"id": "a93a1617-10a0-4d21-a8c5-5527f662de73", "address": "fa:16:3e:47:cd:ac", "network": {"id": "e53c6a58-bbc4-4602-b43f-81e3a477baf4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "338a11d250eb4a7a9ead9ff296e79514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93a1617-10", "ovs_interfaceid": "a93a1617-10a0-4d21-a8c5-5527f662de73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:cd:ac,bridge_name='br-int',has_traffic_filtering=True,id=a93a1617-10a0-4d21-a8c5-5527f662de73,network=Network(e53c6a58-bbc4-4602-b43f-81e3a477baf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93a1617-10') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Lazy-loading 'pci_devices' on Instance uuid 60f356b4-fa3d-4115-b868-f7b470ce7c87 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:02:41 user nova-compute[75083]:   <uuid>60f356b4-fa3d-4115-b868-f7b470ce7c87</uuid>
Nov 29 06:02:41 user nova-compute[75083]:   <name>instance-00000020</name>
Nov 29 06:02:41 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:02:41 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:02:41 user nova-compute[75083]:   <metadata>
Nov 29 06:02:41 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:02:41 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:02:41 user nova-compute[75083]:       <nova:name>tempest-VolumesNegativeTest-instance-694878787</nova:name>
Nov 29 06:02:41 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:02:41</nova:creationTime>
Nov 29 06:02:41 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:02:41 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:02:41 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:02:41 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:02:41 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:02:41 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:02:41 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:02:41 user nova-compute[75083]:       <nova:owner>
Nov 29 06:02:41 user nova-compute[75083]:         <nova:user uuid="627cfb252f124a61998c0596bf31ce2d">tempest-VolumesNegativeTest-29446818-project-member</nova:user>
Nov 29 06:02:41 user nova-compute[75083]:         <nova:project uuid="b1f7413e8444428ab7add73fcacd6d03">tempest-VolumesNegativeTest-29446818</nova:project>
Nov 29 06:02:41 user nova-compute[75083]:       </nova:owner>
Nov 29 06:02:41 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 06:02:41 user nova-compute[75083]:       <nova:ports>
Nov 29 06:02:41 user nova-compute[75083]:         <nova:port uuid="a93a1617-10a0-4d21-a8c5-5527f662de73">
Nov 29 06:02:41 user nova-compute[75083]:           <nova:ip type="fixed" address="192.168.233.203" ipVersion="4"/>
Nov 29 06:02:41 user nova-compute[75083]:         </nova:port>
Nov 29 06:02:41 user nova-compute[75083]:       </nova:ports>
Nov 29 06:02:41 user nova-compute[75083]:     </nova:instance>
Nov 29 06:02:41 user nova-compute[75083]:   </metadata>
Nov 29 06:02:41 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:02:41 user nova-compute[75083]:     <system>
Nov 29 06:02:41 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:02:41 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:02:41 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:02:41 user nova-compute[75083]:       <entry name="serial">60f356b4-fa3d-4115-b868-f7b470ce7c87</entry>
Nov 29 06:02:41 user nova-compute[75083]:       <entry name="uuid">60f356b4-fa3d-4115-b868-f7b470ce7c87</entry>
Nov 29 06:02:41 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:02:41 user nova-compute[75083]:     </system>
Nov 29 06:02:41 user nova-compute[75083]:   </sysinfo>
Nov 29 06:02:41 user nova-compute[75083]:   <os>
Nov 29 06:02:41 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:02:41 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:02:41 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:02:41 user nova-compute[75083]:   </os>
Nov 29 06:02:41 user nova-compute[75083]:   <features>
Nov 29 06:02:41 user nova-compute[75083]:     <acpi/>
Nov 29 06:02:41 user nova-compute[75083]:     <apic/>
Nov 29 06:02:41 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:02:41 user nova-compute[75083]:   </features>
Nov 29 06:02:41 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:02:41 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:02:41 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:02:41 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:02:41 user nova-compute[75083]:   </clock>
Nov 29 06:02:41 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:02:41 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:02:41 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:02:41 user nova-compute[75083]:   </cpu>
Nov 29 06:02:41 user nova-compute[75083]:   <devices>
Nov 29 06:02:41 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:02:41 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:02:41 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87/disk"/>
Nov 29 06:02:41 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:02:41 user nova-compute[75083]:     </disk>
Nov 29 06:02:41 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:02:41 user nova-compute[75083]:       <mac address="fa:16:3e:47:cd:ac"/>
Nov 29 06:02:41 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:02:41 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:02:41 user nova-compute[75083]:       <target dev="tapa93a1617-10"/>
Nov 29 06:02:41 user nova-compute[75083]:     </interface>
Nov 29 06:02:41 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:02:41 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87/console.log" append="off"/>
Nov 29 06:02:41 user nova-compute[75083]:     </serial>
Nov 29 06:02:41 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:02:41 user nova-compute[75083]:     <video>
Nov 29 06:02:41 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:02:41 user nova-compute[75083]:     </video>
Nov 29 06:02:41 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:02:41 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:02:41 user nova-compute[75083]:     </rng>
Nov 29 06:02:41 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:02:41 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:02:41 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:02:41 user nova-compute[75083]:     </memballoon>
Nov 29 06:02:41 user nova-compute[75083]:   </devices>
Nov 29 06:02:41 user nova-compute[75083]: </domain>
Nov 29 06:02:41 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:02:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-694878787',display_name='tempest-VolumesNegativeTest-instance-694878787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-694878787',id=32,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1f7413e8444428ab7add73fcacd6d03',ramdisk_id='',reservation_id='r-6vmtbpz3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-29446818',owner_user_name='tempest-VolumesNegativeTest-29446818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:02:38Z,user_data=None,user_id='627cfb252f124a61998c0596bf31ce2d',uuid=60f356b4-fa3d-4115-b868-f7b470ce7c87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a93a1617-10a0-4d21-a8c5-5527f662de73", "address": "fa:16:3e:47:cd:ac", "network": {"id": "e53c6a58-bbc4-4602-b43f-81e3a477baf4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "338a11d250eb4a7a9ead9ff296e79514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93a1617-10", "ovs_interfaceid": "a93a1617-10a0-4d21-a8c5-5527f662de73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Converting VIF {"id": "a93a1617-10a0-4d21-a8c5-5527f662de73", "address": "fa:16:3e:47:cd:ac", "network": {"id": "e53c6a58-bbc4-4602-b43f-81e3a477baf4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "338a11d250eb4a7a9ead9ff296e79514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93a1617-10", "ovs_interfaceid": "a93a1617-10a0-4d21-a8c5-5527f662de73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:cd:ac,bridge_name='br-int',has_traffic_filtering=True,id=a93a1617-10a0-4d21-a8c5-5527f662de73,network=Network(e53c6a58-bbc4-4602-b43f-81e3a477baf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93a1617-10') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG os_vif [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:cd:ac,bridge_name='br-int',has_traffic_filtering=True,id=a93a1617-10a0-4d21-a8c5-5527f662de73,network=Network(e53c6a58-bbc4-4602-b43f-81e3a477baf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93a1617-10') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf7c0cf1-5136-5925-a074-07fc227eea95', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa93a1617-10, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa93a1617-10, col_values=(('qos', UUID('61c406c0-0d73-40bb-a970-49e8efe443d1')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa93a1617-10, col_values=(('external_ids', {'iface-id': 'a93a1617-10a0-4d21-a8c5-5527f662de73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:cd:ac', 'vm-uuid': '60f356b4-fa3d-4115-b868-f7b470ce7c87'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:41 user nova-compute[75083]: INFO os_vif [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:cd:ac,bridge_name='br-int',has_traffic_filtering=True,id=a93a1617-10a0-4d21-a8c5-5527f662de73,network=Network(e53c6a58-bbc4-4602-b43f-81e3a477baf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93a1617-10')
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] No VIF found with MAC fa:16:3e:47:cd:ac, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Updating instance_info_cache with network_info: [{"id": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "address": "fa:16:3e:e1:f6:16", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feebf60-26", "ovs_interfaceid": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Releasing lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Instance network_info: |[{"id": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "address": "fa:16:3e:e1:f6:16", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feebf60-26", "ovs_interfaceid": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.compute.manager [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:02:41 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Instance spawned successfully.
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:02:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:02:42 user nova-compute[75083]: INFO nova.compute.manager [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 29 06:02:42 user nova-compute[75083]: DEBUG nova.compute.manager [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:02:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-9510e20b-953b-4448-a794-81e283bbbe9d req-7b9289e8-939a-4772-b8a1-29a6773d62de service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Received event network-vif-plugged-89b1aa1d-d184-456e-9abf-235e1b72201f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:02:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9510e20b-953b-4448-a794-81e283bbbe9d req-7b9289e8-939a-4772-b8a1-29a6773d62de service nova] Acquiring lock "81060822-ed09-4cfe-83c2-e5301b38bd71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9510e20b-953b-4448-a794-81e283bbbe9d req-7b9289e8-939a-4772-b8a1-29a6773d62de service nova] Lock "81060822-ed09-4cfe-83c2-e5301b38bd71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9510e20b-953b-4448-a794-81e283bbbe9d req-7b9289e8-939a-4772-b8a1-29a6773d62de service nova] Lock "81060822-ed09-4cfe-83c2-e5301b38bd71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-9510e20b-953b-4448-a794-81e283bbbe9d req-7b9289e8-939a-4772-b8a1-29a6773d62de service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] No waiting events found dispatching network-vif-plugged-89b1aa1d-d184-456e-9abf-235e1b72201f {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:02:42 user nova-compute[75083]: WARNING nova.compute.manager [req-9510e20b-953b-4448-a794-81e283bbbe9d req-7b9289e8-939a-4772-b8a1-29a6773d62de service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Received unexpected event network-vif-plugged-89b1aa1d-d184-456e-9abf-235e1b72201f for instance with vm_state building and task_state spawning.
Nov 29 06:02:42 user nova-compute[75083]: DEBUG nova.network.neutron [req-e021ca16-89ea-4e7c-aad8-2002cbdf1e82 req-8b61ae07-b7f8-4ea1-83d4-54a6a3d95957 service nova] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Updated VIF entry in instance network info cache for port a93a1617-10a0-4d21-a8c5-5527f662de73. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:02:42 user nova-compute[75083]: DEBUG nova.network.neutron [req-e021ca16-89ea-4e7c-aad8-2002cbdf1e82 req-8b61ae07-b7f8-4ea1-83d4-54a6a3d95957 service nova] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Updating instance_info_cache with network_info: [{"id": "a93a1617-10a0-4d21-a8c5-5527f662de73", "address": "fa:16:3e:47:cd:ac", "network": {"id": "e53c6a58-bbc4-4602-b43f-81e3a477baf4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "338a11d250eb4a7a9ead9ff296e79514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93a1617-10", "ovs_interfaceid": "a93a1617-10a0-4d21-a8c5-5527f662de73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:02:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e021ca16-89ea-4e7c-aad8-2002cbdf1e82 req-8b61ae07-b7f8-4ea1-83d4-54a6a3d95957 service nova] Releasing lock "refresh_cache-60f356b4-fa3d-4115-b868-f7b470ce7c87" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:02:42 user nova-compute[75083]: INFO nova.compute.manager [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Took 6.81 seconds to build instance.
Nov 29 06:02:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-369d9b0d-394f-4c80-a5a1-0a44d2aa7241 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "81060822-ed09-4cfe-83c2-e5301b38bd71" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.912s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-3d81c7f4-b4f9-4a4b-a8e4-57e9d254a819 req-2aae761a-2c70-45a2-b7f3-58e4c03f1969 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received event network-changed-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:02:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-3d81c7f4-b4f9-4a4b-a8e4-57e9d254a819 req-2aae761a-2c70-45a2-b7f3-58e4c03f1969 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Refreshing instance network info cache due to event network-changed-1feebf60-26a4-4a1b-8978-cf8ea1bcf912. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:02:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3d81c7f4-b4f9-4a4b-a8e4-57e9d254a819 req-2aae761a-2c70-45a2-b7f3-58e4c03f1969 service nova] Acquiring lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:02:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3d81c7f4-b4f9-4a4b-a8e4-57e9d254a819 req-2aae761a-2c70-45a2-b7f3-58e4c03f1969 service nova] Acquired lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:02:42 user nova-compute[75083]: DEBUG nova.network.neutron [req-3d81c7f4-b4f9-4a4b-a8e4-57e9d254a819 req-2aae761a-2c70-45a2-b7f3-58e4c03f1969 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Refreshing network info cache for port 1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:02:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:43 user nova-compute[75083]: DEBUG nova.network.neutron [req-3d81c7f4-b4f9-4a4b-a8e4-57e9d254a819 req-2aae761a-2c70-45a2-b7f3-58e4c03f1969 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Updated VIF entry in instance network info cache for port 1feebf60-26a4-4a1b-8978-cf8ea1bcf912. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:02:43 user nova-compute[75083]: DEBUG nova.network.neutron [req-3d81c7f4-b4f9-4a4b-a8e4-57e9d254a819 req-2aae761a-2c70-45a2-b7f3-58e4c03f1969 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Updating instance_info_cache with network_info: [{"id": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "address": "fa:16:3e:e1:f6:16", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feebf60-26", "ovs_interfaceid": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:02:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3d81c7f4-b4f9-4a4b-a8e4-57e9d254a819 req-2aae761a-2c70-45a2-b7f3-58e4c03f1969 service nova] Releasing lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG os_brick.utils [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0761697c-d8f9-4744-b25f-32ca388c4d12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e11921-b859-4d8d-9db8-b263239d2dd4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9627e665-eae2-4768-ae79-a23236dbb37e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aeaf548-d898-490a-8f28-505610aa8f37]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:02:44 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad07387-1995-46b4-9c7c-1529d313dbb3]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG os_brick.utils [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Updating existing volume attachment record: a85f3bba-069b-4f78-a024-9a6f31c657a5 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG nova.compute.manager [req-8117ebb4-63e1-44fa-a738-7fb28646b27d req-3fac9ace-9572-45a9-9ee2-491d282c99a4 service nova] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Received event network-vif-plugged-a93a1617-10a0-4d21-a8c5-5527f662de73 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8117ebb4-63e1-44fa-a738-7fb28646b27d req-3fac9ace-9572-45a9-9ee2-491d282c99a4 service nova] Acquiring lock "60f356b4-fa3d-4115-b868-f7b470ce7c87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8117ebb4-63e1-44fa-a738-7fb28646b27d req-3fac9ace-9572-45a9-9ee2-491d282c99a4 service nova] Lock "60f356b4-fa3d-4115-b868-f7b470ce7c87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8117ebb4-63e1-44fa-a738-7fb28646b27d req-3fac9ace-9572-45a9-9ee2-491d282c99a4 service nova] Lock "60f356b4-fa3d-4115-b868-f7b470ce7c87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG nova.compute.manager [req-8117ebb4-63e1-44fa-a738-7fb28646b27d req-3fac9ace-9572-45a9-9ee2-491d282c99a4 service nova] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] No waiting events found dispatching network-vif-plugged-a93a1617-10a0-4d21-a8c5-5527f662de73 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:02:44 user nova-compute[75083]: WARNING nova.compute.manager [req-8117ebb4-63e1-44fa-a738-7fb28646b27d req-3fac9ace-9572-45a9-9ee2-491d282c99a4 service nova] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Received unexpected event network-vif-plugged-a93a1617-10a0-4d21-a8c5-5527f662de73 for instance with vm_state building and task_state spawning.
Nov 29 06:02:44 user nova-compute[75083]: DEBUG nova.compute.manager [req-8117ebb4-63e1-44fa-a738-7fb28646b27d req-3fac9ace-9572-45a9-9ee2-491d282c99a4 service nova] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Received event network-vif-plugged-a93a1617-10a0-4d21-a8c5-5527f662de73 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8117ebb4-63e1-44fa-a738-7fb28646b27d req-3fac9ace-9572-45a9-9ee2-491d282c99a4 service nova] Acquiring lock "60f356b4-fa3d-4115-b868-f7b470ce7c87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8117ebb4-63e1-44fa-a738-7fb28646b27d req-3fac9ace-9572-45a9-9ee2-491d282c99a4 service nova] Lock "60f356b4-fa3d-4115-b868-f7b470ce7c87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8117ebb4-63e1-44fa-a738-7fb28646b27d req-3fac9ace-9572-45a9-9ee2-491d282c99a4 service nova] Lock "60f356b4-fa3d-4115-b868-f7b470ce7c87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:44 user nova-compute[75083]: DEBUG nova.compute.manager [req-8117ebb4-63e1-44fa-a738-7fb28646b27d req-3fac9ace-9572-45a9-9ee2-491d282c99a4 service nova] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] No waiting events found dispatching network-vif-plugged-a93a1617-10a0-4d21-a8c5-5527f662de73 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:02:44 user nova-compute[75083]: WARNING nova.compute.manager [req-8117ebb4-63e1-44fa-a738-7fb28646b27d req-3fac9ace-9572-45a9-9ee2-491d282c99a4 service nova] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Received unexpected event network-vif-plugged-a93a1617-10a0-4d21-a8c5-5527f662de73 for instance with vm_state building and task_state spawning.
Nov 29 06:02:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:02:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:02:45 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Instance spawned successfully.
Nov 29 06:02:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:02:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:02:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:02:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:02:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:02:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:02:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:02:45 user nova-compute[75083]: INFO nova.compute.manager [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Took 6.79 seconds to spawn the instance on the hypervisor.
Nov 29 06:02:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:02:45 user nova-compute[75083]: INFO nova.compute.manager [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Took 7.69 seconds to build instance.
Nov 29 06:02:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9f39279d-96cb-485b-bd1e-dea9b03423f3 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Lock "60f356b4-fa3d-4115-b868-f7b470ce7c87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.797s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:02:52 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Creating image(s)
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Did not create local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Ensure instance console log exists: /opt/stack/data/nova/instances/fea64bdc-491c-46ba-9447-c175df432deb/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Start _get_guest_xml network_info=[{"id": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "address": "fa:16:3e:e1:f6:16", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feebf60-26", "ovs_interfaceid": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'a85f3bba-069b-4f78-a024-9a6f31c657a5', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sujkGoES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fea64bdc-491c-46ba-9447-c175df432deb', 'attached_at': '', 'detached_at': '', 'volume_id': '96aca32e-a3bc-4ea5-bb3a-33ac7beec856', 'serial': '96aca32e-a3bc-4ea5-bb3a-33ac7beec856'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:02:52 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:02:52 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sujkGoES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:02:52 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:02:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:02:52 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:02:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:02:52 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1dd9c9-83e9-4756-b57c-0e9e23b4c4a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:02:52 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c405ab5d-e8e9-4570-a19a-c637303f510f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856] added
Nov 29 06:02:52 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4927f3-4a51-476a-8206-f0e478656a05]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccb3221-2fe7-422a-8174-1dc4db098ce9]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sujkGoES {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sujkGoES" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53b5d43-f4ed-4230-a87a-319c8f6d0f4e]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sujkGoES'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[307c239b-22fc-4f94-a3f0-48b390a1f2a5]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9d6c2f-5af2-4258-a8d8-c079bdefe4e4]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:02:52 user nova-compute[75083]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:02:52 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:02:52 user nova-compute[75083]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:02:52 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:52 user nova-compute[75083]: WARNING nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid 161c6455-90ce-4c40-a33e-7f582989135d {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid 4435ed78-e35f-4859-8a4f-9920815d968a {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid a34d9d98-be73-4d52-85f0-83e48f60bc12 {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid 05f45fef-c8a7-41c1-a571-863307caca6a {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid 18dc5c9c-8fb3-41c7-a124-4881788b3c48 {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid a6e1c2d7-1181-4d9f-99eb-d401d5f73b25 {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid 733f9905-c483-4835-8ec9-953b341950d1 {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid 81060822-ed09-4cfe-83c2-e5301b38bd71 {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid 60f356b4-fa3d-4115-b868-f7b470ce7c87 {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid fea64bdc-491c-46ba-9447-c175df432deb {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "161c6455-90ce-4c40-a33e-7f582989135d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "161c6455-90ce-4c40-a33e-7f582989135d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "4435ed78-e35f-4859-8a4f-9920815d968a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "4435ed78-e35f-4859-8a4f-9920815d968a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "a34d9d98-be73-4d52-85f0-83e48f60bc12" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "05f45fef-c8a7-41c1-a571-863307caca6a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "05f45fef-c8a7-41c1-a571-863307caca6a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "733f9905-c483-4835-8ec9-953b341950d1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "733f9905-c483-4835-8ec9-953b341950d1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "81060822-ed09-4cfe-83c2-e5301b38bd71" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "81060822-ed09-4cfe-83c2-e5301b38bd71" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "60f356b4-fa3d-4115-b868-f7b470ce7c87" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "60f356b4-fa3d-4115-b868-f7b470ce7c87" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "fea64bdc-491c-46ba-9447-c175df432deb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c246abeb-b962-405a-a5db-263299c42718]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "161c6455-90ce-4c40-a33e-7f582989135d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856, portal: 172.16.0.220,3260]
Nov 29 06:02:53 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856, portal: 172.16.0.220,3260] successful.
Nov 29 06:02:53 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "4435ed78-e35f-4859-8a4f-9920815d968a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "733f9905-c483-4835-8ec9-953b341950d1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bda6d5-60a6-4f84-add0-d2892bb6b455]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "81060822-ed09-4cfe-83c2-e5301b38bd71" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "60f356b4-fa3d-4115-b868-f7b470ce7c87" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "05f45fef-c8a7-41c1-a571-863307caca6a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e871254-f81d-4298-81ef-09903be372ba]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:02:53 user nova-compute[75083]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:02:53 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:02:53 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:02:53 user nova-compute[75083]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:02:53 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:02:53 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0698ce-c960-4dcd-ba92-26cfbc2507f0]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:02:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sujkGoES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23831373431383066', 'path': '/dev/sdd'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831373431383066', 'path': '/dev/sdd'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:02:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-147873442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-147873442',id=33,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47694ecf400b4d6c952d0c06d0764d1b',ramdisk_id='',reservation_id='r-0gk2qpfk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:02:39Z,user_data=None,user_id='4145bf5a07ea4d398f1a1e10a976c10f',uuid=fea64bdc-491c-46ba-9447-c175df432deb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "address": "fa:16:3e:e1:f6:16", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feebf60-26", "ovs_interfaceid": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converting VIF {"id": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "address": "fa:16:3e:e1:f6:16", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feebf60-26", "ovs_interfaceid": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f6:16,bridge_name='br-int',has_traffic_filtering=True,id=1feebf60-26a4-4a1b-8978-cf8ea1bcf912,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1feebf60-26') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG nova.objects.instance [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'pci_devices' on Instance uuid fea64bdc-491c-46ba-9447-c175df432deb {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:02:54 user nova-compute[75083]:   <uuid>fea64bdc-491c-46ba-9447-c175df432deb</uuid>
Nov 29 06:02:54 user nova-compute[75083]:   <name>instance-00000021</name>
Nov 29 06:02:54 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:02:54 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:02:54 user nova-compute[75083]:   <metadata>
Nov 29 06:02:54 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:02:54 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:02:54 user nova-compute[75083]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-147873442</nova:name>
Nov 29 06:02:54 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:02:52</nova:creationTime>
Nov 29 06:02:54 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:02:54 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:02:54 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:02:54 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:02:54 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:02:54 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:02:54 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:02:54 user nova-compute[75083]:       <nova:owner>
Nov 29 06:02:54 user nova-compute[75083]:         <nova:user uuid="4145bf5a07ea4d398f1a1e10a976c10f">tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member</nova:user>
Nov 29 06:02:54 user nova-compute[75083]:         <nova:project uuid="47694ecf400b4d6c952d0c06d0764d1b">tempest-ServerBootFromVolumeStableRescueTest-1530350051</nova:project>
Nov 29 06:02:54 user nova-compute[75083]:       </nova:owner>
Nov 29 06:02:54 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 06:02:54 user nova-compute[75083]:       <nova:ports>
Nov 29 06:02:54 user nova-compute[75083]:         <nova:port uuid="1feebf60-26a4-4a1b-8978-cf8ea1bcf912">
Nov 29 06:02:54 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 06:02:54 user nova-compute[75083]:         </nova:port>
Nov 29 06:02:54 user nova-compute[75083]:       </nova:ports>
Nov 29 06:02:54 user nova-compute[75083]:     </nova:instance>
Nov 29 06:02:54 user nova-compute[75083]:   </metadata>
Nov 29 06:02:54 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:02:54 user nova-compute[75083]:     <system>
Nov 29 06:02:54 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:02:54 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:02:54 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:02:54 user nova-compute[75083]:       <entry name="serial">fea64bdc-491c-46ba-9447-c175df432deb</entry>
Nov 29 06:02:54 user nova-compute[75083]:       <entry name="uuid">fea64bdc-491c-46ba-9447-c175df432deb</entry>
Nov 29 06:02:54 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:02:54 user nova-compute[75083]:     </system>
Nov 29 06:02:54 user nova-compute[75083]:   </sysinfo>
Nov 29 06:02:54 user nova-compute[75083]:   <os>
Nov 29 06:02:54 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:02:54 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:02:54 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:02:54 user nova-compute[75083]:   </os>
Nov 29 06:02:54 user nova-compute[75083]:   <features>
Nov 29 06:02:54 user nova-compute[75083]:     <acpi/>
Nov 29 06:02:54 user nova-compute[75083]:     <apic/>
Nov 29 06:02:54 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:02:54 user nova-compute[75083]:   </features>
Nov 29 06:02:54 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:02:54 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:02:54 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:02:54 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:02:54 user nova-compute[75083]:   </clock>
Nov 29 06:02:54 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:02:54 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:02:54 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:02:54 user nova-compute[75083]:   </cpu>
Nov 29 06:02:54 user nova-compute[75083]:   <devices>
Nov 29 06:02:54 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 06:02:54 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:02:54 user nova-compute[75083]:       <source dev="/dev/sdd"/>
Nov 29 06:02:54 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:02:54 user nova-compute[75083]:       <serial>96aca32e-a3bc-4ea5-bb3a-33ac7beec856</serial>
Nov 29 06:02:54 user nova-compute[75083]:     </disk>
Nov 29 06:02:54 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:02:54 user nova-compute[75083]:       <mac address="fa:16:3e:e1:f6:16"/>
Nov 29 06:02:54 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:02:54 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:02:54 user nova-compute[75083]:       <target dev="tap1feebf60-26"/>
Nov 29 06:02:54 user nova-compute[75083]:     </interface>
Nov 29 06:02:54 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:02:54 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/fea64bdc-491c-46ba-9447-c175df432deb/console.log" append="off"/>
Nov 29 06:02:54 user nova-compute[75083]:     </serial>
Nov 29 06:02:54 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:02:54 user nova-compute[75083]:     <video>
Nov 29 06:02:54 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:02:54 user nova-compute[75083]:     </video>
Nov 29 06:02:54 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:02:54 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:02:54 user nova-compute[75083]:     </rng>
Nov 29 06:02:54 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:02:54 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:02:54 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:02:54 user nova-compute[75083]:     </memballoon>
Nov 29 06:02:54 user nova-compute[75083]:   </devices>
Nov 29 06:02:54 user nova-compute[75083]: </domain>
Nov 29 06:02:54 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:02:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-147873442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-147873442',id=33,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47694ecf400b4d6c952d0c06d0764d1b',ramdisk_id='',reservation_id='r-0gk2qpfk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:02:39Z,user_data=None,user_id='4145bf5a07ea4d398f1a1e10a976c10f',uuid=fea64bdc-491c-46ba-9447-c175df432deb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "address": "fa:16:3e:e1:f6:16", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feebf60-26", "ovs_interfaceid": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converting VIF {"id": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "address": "fa:16:3e:e1:f6:16", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feebf60-26", "ovs_interfaceid": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f6:16,bridge_name='br-int',has_traffic_filtering=True,id=1feebf60-26a4-4a1b-8978-cf8ea1bcf912,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1feebf60-26') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG os_vif [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f6:16,bridge_name='br-int',has_traffic_filtering=True,id=1feebf60-26a4-4a1b-8978-cf8ea1bcf912,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1feebf60-26') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67b957c4-c363-5df6-96eb-4c5b07e019a6', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1feebf60-26, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1feebf60-26, col_values=(('qos', UUID('b0139492-4934-4e98-8b1f-7b324728ceec')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1feebf60-26, col_values=(('external_ids', {'iface-id': '1feebf60-26a4-4a1b-8978-cf8ea1bcf912', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:f6:16', 'vm-uuid': 'fea64bdc-491c-46ba-9447-c175df432deb'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:54 user nova-compute[75083]: INFO os_vif [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f6:16,bridge_name='br-int',has_traffic_filtering=True,id=1feebf60-26a4-4a1b-8978-cf8ea1bcf912,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1feebf60-26')
Nov 29 06:02:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:02:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] No VIF found with MAC fa:16:3e:e1:f6:16, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:02:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-f5211252-6d9d-464c-9754-91daaba9e0d1 req-60cdef43-a544-46b5-b33e-a2133ff0bcca service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received event network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:02:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f5211252-6d9d-464c-9754-91daaba9e0d1 req-60cdef43-a544-46b5-b33e-a2133ff0bcca service nova] Acquiring lock "fea64bdc-491c-46ba-9447-c175df432deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f5211252-6d9d-464c-9754-91daaba9e0d1 req-60cdef43-a544-46b5-b33e-a2133ff0bcca service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f5211252-6d9d-464c-9754-91daaba9e0d1 req-60cdef43-a544-46b5-b33e-a2133ff0bcca service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-f5211252-6d9d-464c-9754-91daaba9e0d1 req-60cdef43-a544-46b5-b33e-a2133ff0bcca service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] No waiting events found dispatching network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:02:55 user nova-compute[75083]: WARNING nova.compute.manager [req-f5211252-6d9d-464c-9754-91daaba9e0d1 req-60cdef43-a544-46b5-b33e-a2133ff0bcca service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received unexpected event network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 for instance with vm_state building and task_state spawning.
Nov 29 06:02:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:57 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:02:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:02:57 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Instance spawned successfully.
Nov 29 06:02:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:02:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:02:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:02:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:02:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:02:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:02:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:02:57 user nova-compute[75083]: INFO nova.compute.manager [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 29 06:02:57 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:02:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-689a449a-1de3-4374-b799-8b2a979a33d2 req-f1ffef77-00e5-450b-88e7-a72a37c22b9f service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received event network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:02:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-689a449a-1de3-4374-b799-8b2a979a33d2 req-f1ffef77-00e5-450b-88e7-a72a37c22b9f service nova] Acquiring lock "fea64bdc-491c-46ba-9447-c175df432deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-689a449a-1de3-4374-b799-8b2a979a33d2 req-f1ffef77-00e5-450b-88e7-a72a37c22b9f service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-689a449a-1de3-4374-b799-8b2a979a33d2 req-f1ffef77-00e5-450b-88e7-a72a37c22b9f service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-689a449a-1de3-4374-b799-8b2a979a33d2 req-f1ffef77-00e5-450b-88e7-a72a37c22b9f service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] No waiting events found dispatching network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:02:57 user nova-compute[75083]: WARNING nova.compute.manager [req-689a449a-1de3-4374-b799-8b2a979a33d2 req-f1ffef77-00e5-450b-88e7-a72a37c22b9f service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received unexpected event network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 for instance with vm_state building and task_state spawning.
Nov 29 06:02:57 user nova-compute[75083]: INFO nova.compute.manager [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Took 20.04 seconds to build instance.
Nov 29 06:02:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fb36787c-3cd7-4ac9-8c6e-8fb23df705fe tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "fea64bdc-491c-46ba-9447-c175df432deb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.138s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "fea64bdc-491c-46ba-9447-c175df432deb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.899s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:57 user nova-compute[75083]: INFO nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: fea64bdc-491c-46ba-9447-c175df432deb] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 29 06:02:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "fea64bdc-491c-46ba-9447-c175df432deb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "f1a6ae72-f187-4558-a164-49c436e886ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:58 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:02:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:58 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:02:58 user nova-compute[75083]: INFO nova.compute.claims [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Claim successful on node user
Nov 29 06:02:58 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:02:58 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:02:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:58 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:02:58 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:02:58 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:02:58 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:02:58 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:02:58 user nova-compute[75083]: DEBUG nova.policy [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb74d3aef4664ff8bdec4110c6867056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7833259e5df546ba86139af68fcb7906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:02:59 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Creating image(s)
Nov 29 06:02:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "/opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "/opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.187s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk 1073741824" returned: 0 in 0.053s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Successfully created port: f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Cannot resize image /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Ensure instance console log exists: /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:02:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Successfully updated port: f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquired lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.compute.manager [req-728ed2d8-c767-4a21-a2ac-34250e23112b req-db156a53-f34e-463c-88a9-c1a4b863f6a3 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-changed-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.compute.manager [req-728ed2d8-c767-4a21-a2ac-34250e23112b req-db156a53-f34e-463c-88a9-c1a4b863f6a3 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Refreshing instance network info cache due to event network-changed-f90583fd-5231-46cb-9d2b-3534b01e2587. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-728ed2d8-c767-4a21-a2ac-34250e23112b req-db156a53-f34e-463c-88a9-c1a4b863f6a3 service nova] Acquiring lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Updating instance_info_cache with network_info: [{"id": "f90583fd-5231-46cb-9d2b-3534b01e2587", "address": "fa:16:3e:d7:32:34", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90583fd-52", "ovs_interfaceid": "f90583fd-5231-46cb-9d2b-3534b01e2587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Releasing lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Instance network_info: |[{"id": "f90583fd-5231-46cb-9d2b-3534b01e2587", "address": "fa:16:3e:d7:32:34", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90583fd-52", "ovs_interfaceid": "f90583fd-5231-46cb-9d2b-3534b01e2587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-728ed2d8-c767-4a21-a2ac-34250e23112b req-db156a53-f34e-463c-88a9-c1a4b863f6a3 service nova] Acquired lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.network.neutron [req-728ed2d8-c767-4a21-a2ac-34250e23112b req-db156a53-f34e-463c-88a9-c1a4b863f6a3 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Refreshing network info cache for port f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Start _get_guest_xml network_info=[{"id": "f90583fd-5231-46cb-9d2b-3534b01e2587", "address": "fa:16:3e:d7:32:34", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90583fd-52", "ovs_interfaceid": "f90583fd-5231-46cb-9d2b-3534b01e2587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:03:00 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:03:00 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1004260723',display_name='tempest-ServerRescueNegativeTestJSON-server-1004260723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1004260723',id=34,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIhawOI/53gDum6SY/PSBpY177FAm4dnAbqg4VEZ3EN5udabCTgS3EuhA8Jx9UUHk6GbAtzw7fXtXVsV8VdTHnHKPMSFfkdXUrGjyeJxMAlBjUpmABKze7F5aFFl/ySwg==',key_name='tempest-keypair-92795995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7833259e5df546ba86139af68fcb7906',ramdisk_id='',reservation_id='r-yc7x8yds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1120078925',owner_user_name='tempest-ServerRescueNegativeTestJSON-1120078925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb74d3aef4664ff8bdec4110c6867056',uuid=f1a6ae72-f187-4558-a164-49c436e886ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f90583fd-5231-46cb-9d2b-3534b01e2587", "address": "fa:16:3e:d7:32:34", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90583fd-52", "ovs_interfaceid": "f90583fd-5231-46cb-9d2b-3534b01e2587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converting VIF {"id": "f90583fd-5231-46cb-9d2b-3534b01e2587", "address": "fa:16:3e:d7:32:34", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90583fd-52", "ovs_interfaceid": "f90583fd-5231-46cb-9d2b-3534b01e2587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:32:34,bridge_name='br-int',has_traffic_filtering=True,id=f90583fd-5231-46cb-9d2b-3534b01e2587,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90583fd-52') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'pci_devices' on Instance uuid f1a6ae72-f187-4558-a164-49c436e886ee {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:03:00 user nova-compute[75083]:   <uuid>f1a6ae72-f187-4558-a164-49c436e886ee</uuid>
Nov 29 06:03:00 user nova-compute[75083]:   <name>instance-00000022</name>
Nov 29 06:03:00 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:03:00 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:03:00 user nova-compute[75083]:   <metadata>
Nov 29 06:03:00 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:03:00 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:03:00 user nova-compute[75083]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1004260723</nova:name>
Nov 29 06:03:00 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:03:00</nova:creationTime>
Nov 29 06:03:00 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:03:00 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:03:00 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:03:00 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:03:00 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:03:00 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:03:00 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:03:00 user nova-compute[75083]:       <nova:owner>
Nov 29 06:03:00 user nova-compute[75083]:         <nova:user uuid="eb74d3aef4664ff8bdec4110c6867056">tempest-ServerRescueNegativeTestJSON-1120078925-project-member</nova:user>
Nov 29 06:03:00 user nova-compute[75083]:         <nova:project uuid="7833259e5df546ba86139af68fcb7906">tempest-ServerRescueNegativeTestJSON-1120078925</nova:project>
Nov 29 06:03:00 user nova-compute[75083]:       </nova:owner>
Nov 29 06:03:00 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 06:03:00 user nova-compute[75083]:       <nova:ports>
Nov 29 06:03:00 user nova-compute[75083]:         <nova:port uuid="f90583fd-5231-46cb-9d2b-3534b01e2587">
Nov 29 06:03:00 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 06:03:00 user nova-compute[75083]:         </nova:port>
Nov 29 06:03:00 user nova-compute[75083]:       </nova:ports>
Nov 29 06:03:00 user nova-compute[75083]:     </nova:instance>
Nov 29 06:03:00 user nova-compute[75083]:   </metadata>
Nov 29 06:03:00 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:03:00 user nova-compute[75083]:     <system>
Nov 29 06:03:00 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:03:00 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:03:00 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:03:00 user nova-compute[75083]:       <entry name="serial">f1a6ae72-f187-4558-a164-49c436e886ee</entry>
Nov 29 06:03:00 user nova-compute[75083]:       <entry name="uuid">f1a6ae72-f187-4558-a164-49c436e886ee</entry>
Nov 29 06:03:00 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:03:00 user nova-compute[75083]:     </system>
Nov 29 06:03:00 user nova-compute[75083]:   </sysinfo>
Nov 29 06:03:00 user nova-compute[75083]:   <os>
Nov 29 06:03:00 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:03:00 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:03:00 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:03:00 user nova-compute[75083]:   </os>
Nov 29 06:03:00 user nova-compute[75083]:   <features>
Nov 29 06:03:00 user nova-compute[75083]:     <acpi/>
Nov 29 06:03:00 user nova-compute[75083]:     <apic/>
Nov 29 06:03:00 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:03:00 user nova-compute[75083]:   </features>
Nov 29 06:03:00 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:03:00 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:03:00 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:03:00 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:03:00 user nova-compute[75083]:   </clock>
Nov 29 06:03:00 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:03:00 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:03:00 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:03:00 user nova-compute[75083]:   </cpu>
Nov 29 06:03:00 user nova-compute[75083]:   <devices>
Nov 29 06:03:00 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:03:00 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:03:00 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk"/>
Nov 29 06:03:00 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:03:00 user nova-compute[75083]:     </disk>
Nov 29 06:03:00 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:03:00 user nova-compute[75083]:       <mac address="fa:16:3e:d7:32:34"/>
Nov 29 06:03:00 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:03:00 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:03:00 user nova-compute[75083]:       <target dev="tapf90583fd-52"/>
Nov 29 06:03:00 user nova-compute[75083]:     </interface>
Nov 29 06:03:00 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:03:00 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/console.log" append="off"/>
Nov 29 06:03:00 user nova-compute[75083]:     </serial>
Nov 29 06:03:00 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:03:00 user nova-compute[75083]:     <video>
Nov 29 06:03:00 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:03:00 user nova-compute[75083]:     </video>
Nov 29 06:03:00 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:03:00 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:03:00 user nova-compute[75083]:     </rng>
Nov 29 06:03:00 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:03:00 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:03:00 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:03:00 user nova-compute[75083]:     </memballoon>
Nov 29 06:03:00 user nova-compute[75083]:   </devices>
Nov 29 06:03:00 user nova-compute[75083]: </domain>
Nov 29 06:03:00 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1004260723',display_name='tempest-ServerRescueNegativeTestJSON-server-1004260723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1004260723',id=34,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIhawOI/53gDum6SY/PSBpY177FAm4dnAbqg4VEZ3EN5udabCTgS3EuhA8Jx9UUHk6GbAtzw7fXtXVsV8VdTHnHKPMSFfkdXUrGjyeJxMAlBjUpmABKze7F5aFFl/ySwg==',key_name='tempest-keypair-92795995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7833259e5df546ba86139af68fcb7906',ramdisk_id='',reservation_id='r-yc7x8yds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1120078925',owner_user_name='tempest-ServerRescueNegativeTestJSON-1120078925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb74d3aef4664ff8bdec4110c6867056',uuid=f1a6ae72-f187-4558-a164-49c436e886ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f90583fd-5231-46cb-9d2b-3534b01e2587", "address": "fa:16:3e:d7:32:34", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90583fd-52", "ovs_interfaceid": "f90583fd-5231-46cb-9d2b-3534b01e2587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converting VIF {"id": "f90583fd-5231-46cb-9d2b-3534b01e2587", "address": "fa:16:3e:d7:32:34", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90583fd-52", "ovs_interfaceid": "f90583fd-5231-46cb-9d2b-3534b01e2587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:32:34,bridge_name='br-int',has_traffic_filtering=True,id=f90583fd-5231-46cb-9d2b-3534b01e2587,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90583fd-52') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG os_vif [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:32:34,bridge_name='br-int',has_traffic_filtering=True,id=f90583fd-5231-46cb-9d2b-3534b01e2587,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90583fd-52') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72f0a9f8-6d16-5816-b02a-e4cc03099da3', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf90583fd-52, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf90583fd-52, col_values=(('qos', UUID('e3b79da8-6374-40c0-8d53-029317517c10')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf90583fd-52, col_values=(('external_ids', {'iface-id': 'f90583fd-5231-46cb-9d2b-3534b01e2587', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:32:34', 'vm-uuid': 'f1a6ae72-f187-4558-a164-49c436e886ee'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:00 user nova-compute[75083]: INFO os_vif [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:32:34,bridge_name='br-int',has_traffic_filtering=True,id=f90583fd-5231-46cb-9d2b-3534b01e2587,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90583fd-52')
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] No VIF found with MAC fa:16:3e:d7:32:34, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.network.neutron [req-728ed2d8-c767-4a21-a2ac-34250e23112b req-db156a53-f34e-463c-88a9-c1a4b863f6a3 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Updated VIF entry in instance network info cache for port f90583fd-5231-46cb-9d2b-3534b01e2587. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG nova.network.neutron [req-728ed2d8-c767-4a21-a2ac-34250e23112b req-db156a53-f34e-463c-88a9-c1a4b863f6a3 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Updating instance_info_cache with network_info: [{"id": "f90583fd-5231-46cb-9d2b-3534b01e2587", "address": "fa:16:3e:d7:32:34", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90583fd-52", "ovs_interfaceid": "f90583fd-5231-46cb-9d2b-3534b01e2587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:03:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-728ed2d8-c767-4a21-a2ac-34250e23112b req-db156a53-f34e-463c-88a9-c1a4b863f6a3 service nova] Releasing lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:03:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:02 user nova-compute[75083]: DEBUG nova.compute.manager [req-c3c50997-bf70-4ac7-b171-053fe2270362 req-83b042f3-373a-43b2-86fe-de7217ec3273 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:03:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c3c50997-bf70-4ac7-b171-053fe2270362 req-83b042f3-373a-43b2-86fe-de7217ec3273 service nova] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:03:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c3c50997-bf70-4ac7-b171-053fe2270362 req-83b042f3-373a-43b2-86fe-de7217ec3273 service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:03:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c3c50997-bf70-4ac7-b171-053fe2270362 req-83b042f3-373a-43b2-86fe-de7217ec3273 service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:03:02 user nova-compute[75083]: DEBUG nova.compute.manager [req-c3c50997-bf70-4ac7-b171-053fe2270362 req-83b042f3-373a-43b2-86fe-de7217ec3273 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] No waiting events found dispatching network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:03:02 user nova-compute[75083]: WARNING nova.compute.manager [req-c3c50997-bf70-4ac7-b171-053fe2270362 req-83b042f3-373a-43b2-86fe-de7217ec3273 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received unexpected event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 for instance with vm_state building and task_state spawning.
Nov 29 06:03:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:04 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:03:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:03:04 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Instance spawned successfully.
Nov 29 06:03:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:03:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-493451a5-f2d2-4c50-b983-ccdceef411c2 req-5545e88c-0e87-4877-9e14-6b1ef1d24e1c service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:03:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-493451a5-f2d2-4c50-b983-ccdceef411c2 req-5545e88c-0e87-4877-9e14-6b1ef1d24e1c service nova] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:03:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-493451a5-f2d2-4c50-b983-ccdceef411c2 req-5545e88c-0e87-4877-9e14-6b1ef1d24e1c service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:03:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-493451a5-f2d2-4c50-b983-ccdceef411c2 req-5545e88c-0e87-4877-9e14-6b1ef1d24e1c service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:03:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-493451a5-f2d2-4c50-b983-ccdceef411c2 req-5545e88c-0e87-4877-9e14-6b1ef1d24e1c service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] No waiting events found dispatching network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:03:04 user nova-compute[75083]: WARNING nova.compute.manager [req-493451a5-f2d2-4c50-b983-ccdceef411c2 req-5545e88c-0e87-4877-9e14-6b1ef1d24e1c service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received unexpected event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 for instance with vm_state building and task_state spawning.
Nov 29 06:03:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:03:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:03:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:03:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:03:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:03:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:03:04 user nova-compute[75083]: INFO nova.compute.manager [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 29 06:03:04 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:03:04 user nova-compute[75083]: INFO nova.compute.manager [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Took 6.05 seconds to build instance.
Nov 29 06:03:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9af01b20-21f3-4cf9-89a3-7c822bc3f06a tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "f1a6ae72-f187-4558-a164-49c436e886ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.157s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:03:04 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:03:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:06 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:03:07 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:03:07 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:03:09 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "733f9905-c483-4835-8ec9-953b341950d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "733f9905-c483-4835-8ec9-953b341950d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG nova.objects.instance [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lazy-loading 'flavor' on Instance uuid 733f9905-c483-4835-8ec9-953b341950d1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "733f9905-c483-4835-8ec9-953b341950d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "733f9905-c483-4835-8ec9-953b341950d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "733f9905-c483-4835-8ec9-953b341950d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:03:10 user nova-compute[75083]: INFO nova.compute.manager [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Attaching volume 00976084-3048-4cfe-871e-771d12c8e40f to /dev/vdb
Nov 29 06:03:10 user nova-compute[75083]: DEBUG os_brick.utils [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36ee5d3-5b52-439f-a83b-12788c5850b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e750bb2-41da-4808-82ba-247bf3b4e2ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[410d17ca-f69e-48cc-9ba6-3f8c9bc5f272]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[48eb333c-d6cc-4a15-8d9f-c4f673b3e9da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:03:10 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:03:10 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[76849168-989e-48ca-9b0d-50a38389c155]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG os_brick.utils [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Updating existing volume attachment record: f71ad88b-f24a-4de4-a897-1e1f705a786e {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:03:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:11 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:03:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:03:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:03:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:03:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:03:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:03:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:03:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:03:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:16 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:03:16 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:03:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=7473MB free_disk=25.08562469482422GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:03:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:03:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:03:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 161c6455-90ce-4c40-a33e-7f582989135d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:03:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4435ed78-e35f-4859-8a4f-9920815d968a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:03:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a34d9d98-be73-4d52-85f0-83e48f60bc12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:03:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 05f45fef-c8a7-41c1-a571-863307caca6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:03:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:03:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 18dc5c9c-8fb3-41c7-a124-4881788b3c48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:03:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a6e1c2d7-1181-4d9f-99eb-d401d5f73b25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:03:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 733f9905-c483-4835-8ec9-953b341950d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:03:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 81060822-ed09-4cfe-83c2-e5301b38bd71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:03:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 60f356b4-fa3d-4115-b868-f7b470ce7c87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:03:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fea64bdc-491c-46ba-9447-c175df432deb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:03:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance f1a6ae72-f187-4558-a164-49c436e886ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:03:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:03:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:03:16 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:03:16 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:03:17 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:03:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.647s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqhWlcvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:03:18 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:03:18 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:03:18 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[48137a6b-2d44-4f50-9530-192a7e40494b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:03:18 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6f5b6c-83b4-4e92-a9a3-7a7d88cfc27f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f] added
Nov 29 06:03:18 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98fc2e6-fa0c-424a-a359-57c31d5acdaf]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc847a2-4157-4d56-8b91-12923369f4c2]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqhWlcvM {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqhWlcvM" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d70673-93a3-45d4-8207-6392c5b5fc39]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DqhWlcvM'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1397a533-cd62-435d-9e9e-70a75575f3f8]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3658927-a2ed-42cd-ab26-378f48da71fe]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:03:18 user nova-compute[75083]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:03:18 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:03:18 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:03:18 user nova-compute[75083]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:03:18 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:03:18 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd36bd7b-f47b-409a-956f-c1e356d6544f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f, portal: 172.16.0.220,3260]
Nov 29 06:03:18 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f, portal: 172.16.0.220,3260] successful.
Nov 29 06:03:18 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b972aa-0375-4da6-9ddb-77cb3dc09b52]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21e42a1-94f0-4971-bd3a-eac8d367276d]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:03:18 user nova-compute[75083]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:03:18 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:03:18 user nova-compute[75083]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)
Nov 29 06:03:18 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:03:18 user nova-compute[75083]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:03:18 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:03:18 user nova-compute[75083]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)
Nov 29 06:03:18 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[742ccf1a-8e98-475c-af75-fc5ddb76d652]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: None {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Updating instance_info_cache with network_info: [{"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-18dc5c9c-8fb3-41c7-a124-4881788b3c48" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:03:18 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:03:19 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:03:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqhWlcvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:03:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:03:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23061376466343039', 'path': '/dev/sde'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:03:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061376466343039', 'path': '/dev/sde'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:03:19 user nova-compute[75083]: DEBUG nova.objects.instance [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lazy-loading 'flavor' on Instance uuid 733f9905-c483-4835-8ec9-953b341950d1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:03:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 06:03:19 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:03:19 user nova-compute[75083]:   <source dev="/dev/sde"/>
Nov 29 06:03:19 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:03:19 user nova-compute[75083]:   <serial>00976084-3048-4cfe-871e-771d12c8e40f</serial>
Nov 29 06:03:19 user nova-compute[75083]: </disk>
Nov 29 06:03:19 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 06:03:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:03:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:03:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] No VIF found with MAC fa:16:3e:16:1e:34, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:03:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e36bee81-77c8-48a7-ac81-65c3fde023ab tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "733f9905-c483-4835-8ec9-953b341950d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.851s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:03:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:25 user nova-compute[75083]: INFO nova.compute.manager [None req-8b083165-5a6e-48d5-ac92-56beae2fc4df tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Get console output
Nov 29 06:03:25 user nova-compute[75083]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 29 06:03:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-82e6675e-ba59-4009-994b-8dcff42ba90e req-9ce46586-a8e0-4a86-aaad-2b6b4c8bb7dc service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received event network-changed-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:03:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-82e6675e-ba59-4009-994b-8dcff42ba90e req-9ce46586-a8e0-4a86-aaad-2b6b4c8bb7dc service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Refreshing instance network info cache due to event network-changed-b3126cae-fa19-4a34-b87a-5e97ca70770b. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:03:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-82e6675e-ba59-4009-994b-8dcff42ba90e req-9ce46586-a8e0-4a86-aaad-2b6b4c8bb7dc service nova] Acquiring lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:03:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-82e6675e-ba59-4009-994b-8dcff42ba90e req-9ce46586-a8e0-4a86-aaad-2b6b4c8bb7dc service nova] Acquired lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:03:26 user nova-compute[75083]: DEBUG nova.network.neutron [req-82e6675e-ba59-4009-994b-8dcff42ba90e req-9ce46586-a8e0-4a86-aaad-2b6b4c8bb7dc service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Refreshing network info cache for port b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:03:26 user nova-compute[75083]: DEBUG nova.network.neutron [req-82e6675e-ba59-4009-994b-8dcff42ba90e req-9ce46586-a8e0-4a86-aaad-2b6b4c8bb7dc service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Updated VIF entry in instance network info cache for port b3126cae-fa19-4a34-b87a-5e97ca70770b. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:03:26 user nova-compute[75083]: DEBUG nova.network.neutron [req-82e6675e-ba59-4009-994b-8dcff42ba90e req-9ce46586-a8e0-4a86-aaad-2b6b4c8bb7dc service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Updating instance_info_cache with network_info: [{"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:03:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-82e6675e-ba59-4009-994b-8dcff42ba90e req-9ce46586-a8e0-4a86-aaad-2b6b4c8bb7dc service nova] Releasing lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:03:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-4f6f67e0-4e7d-4b7b-9639-3785fce92e0a req-34007029-5bb8-4531-b490-a1db16a66f69 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received event network-changed-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:03:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-4f6f67e0-4e7d-4b7b-9639-3785fce92e0a req-34007029-5bb8-4531-b490-a1db16a66f69 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Refreshing instance network info cache due to event network-changed-b3126cae-fa19-4a34-b87a-5e97ca70770b. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:03:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4f6f67e0-4e7d-4b7b-9639-3785fce92e0a req-34007029-5bb8-4531-b490-a1db16a66f69 service nova] Acquiring lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:03:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4f6f67e0-4e7d-4b7b-9639-3785fce92e0a req-34007029-5bb8-4531-b490-a1db16a66f69 service nova] Acquired lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:03:28 user nova-compute[75083]: DEBUG nova.network.neutron [req-4f6f67e0-4e7d-4b7b-9639-3785fce92e0a req-34007029-5bb8-4531-b490-a1db16a66f69 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Refreshing network info cache for port b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:03:28 user nova-compute[75083]: DEBUG nova.network.neutron [req-4f6f67e0-4e7d-4b7b-9639-3785fce92e0a req-34007029-5bb8-4531-b490-a1db16a66f69 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Updated VIF entry in instance network info cache for port b3126cae-fa19-4a34-b87a-5e97ca70770b. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:03:28 user nova-compute[75083]: DEBUG nova.network.neutron [req-4f6f67e0-4e7d-4b7b-9639-3785fce92e0a req-34007029-5bb8-4531-b490-a1db16a66f69 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Updating instance_info_cache with network_info: [{"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:03:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4f6f67e0-4e7d-4b7b-9639-3785fce92e0a req-34007029-5bb8-4531-b490-a1db16a66f69 service nova] Releasing lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:03:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "733f9905-c483-4835-8ec9-953b341950d1" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:03:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "733f9905-c483-4835-8ec9-953b341950d1" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:03:32 user nova-compute[75083]: INFO nova.compute.manager [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Rebooting instance
Nov 29 06:03:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:03:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquired lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:03:32 user nova-compute[75083]: DEBUG nova.network.neutron [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:03:33 user nova-compute[75083]: DEBUG nova.network.neutron [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Updating instance_info_cache with network_info: [{"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:03:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Releasing lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:03:33 user nova-compute[75083]: DEBUG nova.compute.manager [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:03:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.compute.manager [req-4f2b13ba-7359-4eb8-bb12-c235d8d84965 req-4c7878b7-dba3-4847-b793-a1208550a1c3 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received event network-vif-unplugged-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4f2b13ba-7359-4eb8-bb12-c235d8d84965 req-4c7878b7-dba3-4847-b793-a1208550a1c3 service nova] Acquiring lock "733f9905-c483-4835-8ec9-953b341950d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4f2b13ba-7359-4eb8-bb12-c235d8d84965 req-4c7878b7-dba3-4847-b793-a1208550a1c3 service nova] Lock "733f9905-c483-4835-8ec9-953b341950d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4f2b13ba-7359-4eb8-bb12-c235d8d84965 req-4c7878b7-dba3-4847-b793-a1208550a1c3 service nova] Lock "733f9905-c483-4835-8ec9-953b341950d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.compute.manager [req-4f2b13ba-7359-4eb8-bb12-c235d8d84965 req-4c7878b7-dba3-4847-b793-a1208550a1c3 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] No waiting events found dispatching network-vif-unplugged-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:03:34 user nova-compute[75083]: WARNING nova.compute.manager [req-4f2b13ba-7359-4eb8-bb12-c235d8d84965 req-4c7878b7-dba3-4847-b793-a1208550a1c3 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received unexpected event network-vif-unplugged-b3126cae-fa19-4a34-b87a-5e97ca70770b for instance with vm_state active and task_state reboot_started_hard.
Nov 29 06:03:34 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Instance destroyed successfully.
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.objects.instance [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lazy-loading 'resources' on Instance uuid 733f9905-c483-4835-8ec9-953b341950d1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-534054970',display_name='tempest-TestMinimumBasicScenario-server-534054970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-534054970',id=30,image_ref='325c0786-2bab-4ff9-a435-46158e003aee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEN2s530aGNqCnv3Q2xJE1Vb0iCTwM9AOsamn/qxqdg0D1v7VpXgftDlWrVrqOqOuPZ9gUPuvoZNn/6knJQVreVVsytrn4dDpcRmQOd9fotXylI6tQ+iozlTHfRnex9sQ==',key_name='tempest-TestMinimumBasicScenario-631134433',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:01:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0801cbd66c8457b887d383721d95915',ramdisk_id='',reservation_id='r-2trkv2ny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='325c0786-2bab-4ff9-a435-46158e003aee',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2019017585',owner_user_name='tempest-TestMinimumBasicScenario-2019017585-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:03:33Z,user_data=None,user_id='eb526efdda0c4ca2ba8e739ecbe9e148',uuid=733f9905-c483-4835-8ec9-953b341950d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Converting VIF {"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=b3126cae-fa19-4a34-b87a-5e97ca70770b,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3126cae-fa') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_vif [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=b3126cae-fa19-4a34-b87a-5e97ca70770b,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3126cae-fa') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3126cae-fa, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee8a3949-1cd7-4546-96d1-c8dd1df0010a) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:34 user nova-compute[75083]: INFO os_vif [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=b3126cae-fa19-4a34-b87a-5e97ca70770b,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3126cae-fa')
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqhWlcvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:03:34 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f6f4df-307b-4c23-8291-e8ce3c23bf0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:03:34 user nova-compute[75083]: No targets found.
Nov 29 06:03:34 user nova-compute[75083]: iSNS:
Nov 29 06:03:34 user nova-compute[75083]: No targets found.
Nov 29 06:03:34 user nova-compute[75083]: STATIC:
Nov 29 06:03:34 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856
Nov 29 06:03:34 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:03:34 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:03:34 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f
Nov 29 06:03:34 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:03:34 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:03:34 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542
Nov 29 06:03:34 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:03:34 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:03:34 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4
Nov 29 06:03:34 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:03:34 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:03:34 user nova-compute[75083]: FIRMWARE:
Nov 29 06:03:34 user nova-compute[75083]: No targets found.
Nov 29 06:03:34 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:03:34 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:03:34 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[64390c0c-3e75-47c8-9692-a7e051b93814]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c729ca4a-d92e-4a40-9fdd-e492fa351eed]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:03:34 user nova-compute[75083]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:03:34 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:03:34 user nova-compute[75083]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)
Nov 29 06:03:34 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:03:34 user nova-compute[75083]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:03:34 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:03:34 user nova-compute[75083]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)
Nov 29 06:03:34 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b8558280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f'): ({'sde'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Removing single pathed devices sde {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc095d0-3a54-48e7-823a-5d50d56dd0d5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe2259f-dca6-40b2-a329-b689513da165]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Flushing IO for device /dev/sde {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b3c901-0cec-478a-89ed-27efc3d578cc]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c412f09-69b7-432d-bf4b-16e652e001d8]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] SCSI volumes sde have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7d03e6-a004-46aa-aa55-87768fed64a4]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b55c12d-380c-4db2-88be-ebe51c46d975]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f, portal: 172.16.0.220,3260]
Nov 29 06:03:34 user nova-compute[75083]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f, portal: 172.16.0.220,3260] successful.
Nov 29 06:03:34 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9417050c-2954-4fe1-b89c-79ed14b7f6a0]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] <== disconnect_volume: return (363ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Start _get_guest_xml network_info=[{"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=325c0786-2bab-4ff9-a435-46158e003aee,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '325c0786-2bab-4ff9-a435-46158e003aee'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'f71ad88b-f24a-4de4-a897-1e1f705a786e', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqhWlcvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '733f9905-c483-4835-8ec9-953b341950d1', 'attached_at': '', 'detached_at': '', 'volume_id': '00976084-3048-4cfe-871e-771d12c8e40f', 'serial': '00976084-3048-4cfe-871e-771d12c8e40f'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:03:34 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:03:34 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=325c0786-2bab-4ff9-a435-46158e003aee,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.objects.instance [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lazy-loading 'vcpu_model' on Instance uuid 733f9905-c483-4835-8ec9-953b341950d1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.objects.base [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Object Instance<733f9905-c483-4835-8ec9-953b341950d1> lazy-loaded attributes: resources,vcpu_model {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqhWlcvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:03:34 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:03:34 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:03:34 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1771d2-7009-4a3f-8088-3dbf1c7cdcc4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:03:34 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[945fa573-4566-4ab4-a6b5-bddbcf77b0ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f] added
Nov 29 06:03:34 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[78964ab2-7abc-45a9-bfe1-c4f4a78ee51f]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8c17a5-ec8c-4210-9c62-ee59b6f90e6a]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqhWlcvM {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqhWlcvM" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae240003-a419-42a1-aa8d-8948651bf684]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DqhWlcvM'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[60147abc-a88c-46e3-9d04-0680163ae585]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1978e915-f0db-4ebe-b751-10a8d8327ecc]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:03:34 user nova-compute[75083]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:03:34 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:03:34 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:03:34 user nova-compute[75083]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:03:34 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:03:34 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dc3865-4a8d-4b9c-92eb-10eac18497db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f, portal: 172.16.0.220,3260]
Nov 29 06:03:34 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f, portal: 172.16.0.220,3260] successful.
Nov 29 06:03:34 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d500177a-2a0a-4d5a-84eb-1430015290c9]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[236765be-736a-4b45-be59-703381b3fc0f]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:03:34 user nova-compute[75083]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:03:34 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:03:34 user nova-compute[75083]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)
Nov 29 06:03:34 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:03:34 user nova-compute[75083]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:03:34 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:03:34 user nova-compute[75083]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)
Nov 29 06:03:34 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:03:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:35 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7056fe9-6ce6-46e2-9ed6-4a30bdf896a1]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:03:35 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:03:35 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqhWlcvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23061376466343039', 'path': '/dev/sde'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061376466343039', 'path': '/dev/sde'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-534054970',display_name='tempest-TestMinimumBasicScenario-server-534054970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-534054970',id=30,image_ref='325c0786-2bab-4ff9-a435-46158e003aee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEN2s530aGNqCnv3Q2xJE1Vb0iCTwM9AOsamn/qxqdg0D1v7VpXgftDlWrVrqOqOuPZ9gUPuvoZNn/6knJQVreVVsytrn4dDpcRmQOd9fotXylI6tQ+iozlTHfRnex9sQ==',key_name='tempest-TestMinimumBasicScenario-631134433',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:01:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0801cbd66c8457b887d383721d95915',ramdisk_id='',reservation_id='r-2trkv2ny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='325c0786-2bab-4ff9-a435-46158e003aee',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2019017585',owner_user_name='tempest-TestMinimumBasicScenario-2019017585-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:03:33Z,user_data=None,user_id='eb526efdda0c4ca2ba8e739ecbe9e148',uuid=733f9905-c483-4835-8ec9-953b341950d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Converting VIF {"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=b3126cae-fa19-4a34-b87a-5e97ca70770b,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3126cae-fa') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG nova.objects.instance [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lazy-loading 'pci_devices' on Instance uuid 733f9905-c483-4835-8ec9-953b341950d1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG nova.objects.base [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Object Instance<733f9905-c483-4835-8ec9-953b341950d1> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:03:36 user nova-compute[75083]:   <uuid>733f9905-c483-4835-8ec9-953b341950d1</uuid>
Nov 29 06:03:36 user nova-compute[75083]:   <name>instance-0000001e</name>
Nov 29 06:03:36 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:03:36 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:03:36 user nova-compute[75083]:   <metadata>
Nov 29 06:03:36 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:03:36 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:03:36 user nova-compute[75083]:       <nova:name>tempest-TestMinimumBasicScenario-server-534054970</nova:name>
Nov 29 06:03:36 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:03:34</nova:creationTime>
Nov 29 06:03:36 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:03:36 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:03:36 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:03:36 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:03:36 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:03:36 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:03:36 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:03:36 user nova-compute[75083]:       <nova:owner>
Nov 29 06:03:36 user nova-compute[75083]:         <nova:user uuid="eb526efdda0c4ca2ba8e739ecbe9e148">tempest-TestMinimumBasicScenario-2019017585-project-member</nova:user>
Nov 29 06:03:36 user nova-compute[75083]:         <nova:project uuid="f0801cbd66c8457b887d383721d95915">tempest-TestMinimumBasicScenario-2019017585</nova:project>
Nov 29 06:03:36 user nova-compute[75083]:       </nova:owner>
Nov 29 06:03:36 user nova-compute[75083]:       <nova:root type="image" uuid="325c0786-2bab-4ff9-a435-46158e003aee"/>
Nov 29 06:03:36 user nova-compute[75083]:       <nova:ports>
Nov 29 06:03:36 user nova-compute[75083]:         <nova:port uuid="b3126cae-fa19-4a34-b87a-5e97ca70770b">
Nov 29 06:03:36 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 06:03:36 user nova-compute[75083]:         </nova:port>
Nov 29 06:03:36 user nova-compute[75083]:       </nova:ports>
Nov 29 06:03:36 user nova-compute[75083]:     </nova:instance>
Nov 29 06:03:36 user nova-compute[75083]:   </metadata>
Nov 29 06:03:36 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:03:36 user nova-compute[75083]:     <system>
Nov 29 06:03:36 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:03:36 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:03:36 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:03:36 user nova-compute[75083]:       <entry name="serial">733f9905-c483-4835-8ec9-953b341950d1</entry>
Nov 29 06:03:36 user nova-compute[75083]:       <entry name="uuid">733f9905-c483-4835-8ec9-953b341950d1</entry>
Nov 29 06:03:36 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:03:36 user nova-compute[75083]:     </system>
Nov 29 06:03:36 user nova-compute[75083]:   </sysinfo>
Nov 29 06:03:36 user nova-compute[75083]:   <os>
Nov 29 06:03:36 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:03:36 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:03:36 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:03:36 user nova-compute[75083]:   </os>
Nov 29 06:03:36 user nova-compute[75083]:   <features>
Nov 29 06:03:36 user nova-compute[75083]:     <acpi/>
Nov 29 06:03:36 user nova-compute[75083]:     <apic/>
Nov 29 06:03:36 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:03:36 user nova-compute[75083]:   </features>
Nov 29 06:03:36 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:03:36 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:03:36 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:03:36 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:03:36 user nova-compute[75083]:   </clock>
Nov 29 06:03:36 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:03:36 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:03:36 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:03:36 user nova-compute[75083]:   </cpu>
Nov 29 06:03:36 user nova-compute[75083]:   <devices>
Nov 29 06:03:36 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:03:36 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:03:36 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk"/>
Nov 29 06:03:36 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:03:36 user nova-compute[75083]:     </disk>
Nov 29 06:03:36 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 06:03:36 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:03:36 user nova-compute[75083]:       <source dev="/dev/sde"/>
Nov 29 06:03:36 user nova-compute[75083]:       <target dev="vdb" bus="virtio"/>
Nov 29 06:03:36 user nova-compute[75083]:       <serial>00976084-3048-4cfe-871e-771d12c8e40f</serial>
Nov 29 06:03:36 user nova-compute[75083]:     </disk>
Nov 29 06:03:36 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:03:36 user nova-compute[75083]:       <mac address="fa:16:3e:16:1e:34"/>
Nov 29 06:03:36 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:03:36 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:03:36 user nova-compute[75083]:       <target dev="tapb3126cae-fa"/>
Nov 29 06:03:36 user nova-compute[75083]:     </interface>
Nov 29 06:03:36 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:03:36 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/console.log" append="off"/>
Nov 29 06:03:36 user nova-compute[75083]:     </serial>
Nov 29 06:03:36 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:03:36 user nova-compute[75083]:     <video>
Nov 29 06:03:36 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:03:36 user nova-compute[75083]:     </video>
Nov 29 06:03:36 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:03:36 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:03:36 user nova-compute[75083]:     </rng>
Nov 29 06:03:36 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:03:36 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:03:36 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:03:36 user nova-compute[75083]:     </memballoon>
Nov 29 06:03:36 user nova-compute[75083]:   </devices>
Nov 29 06:03:36 user nova-compute[75083]: </domain>
Nov 29 06:03:36 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG nova.compute.manager [req-eea6db42-3c28-4f18-b4ea-18c89b781882 req-e4b47538-076e-4e40-834d-de8725edb018 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received event network-vif-plugged-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-eea6db42-3c28-4f18-b4ea-18c89b781882 req-e4b47538-076e-4e40-834d-de8725edb018 service nova] Acquiring lock "733f9905-c483-4835-8ec9-953b341950d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-eea6db42-3c28-4f18-b4ea-18c89b781882 req-e4b47538-076e-4e40-834d-de8725edb018 service nova] Lock "733f9905-c483-4835-8ec9-953b341950d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-eea6db42-3c28-4f18-b4ea-18c89b781882 req-e4b47538-076e-4e40-834d-de8725edb018 service nova] Lock "733f9905-c483-4835-8ec9-953b341950d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG nova.compute.manager [req-eea6db42-3c28-4f18-b4ea-18c89b781882 req-e4b47538-076e-4e40-834d-de8725edb018 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] No waiting events found dispatching network-vif-plugged-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:03:36 user nova-compute[75083]: WARNING nova.compute.manager [req-eea6db42-3c28-4f18-b4ea-18c89b781882 req-e4b47538-076e-4e40-834d-de8725edb018 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received unexpected event network-vif-plugged-b3126cae-fa19-4a34-b87a-5e97ca70770b for instance with vm_state active and task_state reboot_started_hard.
Nov 29 06:03:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG nova.objects.instance [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lazy-loading 'trusted_certs' on Instance uuid 733f9905-c483-4835-8ec9-953b341950d1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG nova.objects.base [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Object Instance<733f9905-c483-4835-8ec9-953b341950d1> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2 --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2 --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Cannot resize image /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG nova.objects.instance [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lazy-loading 'migration_context' on Instance uuid 733f9905-c483-4835-8ec9-953b341950d1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG nova.objects.base [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Object Instance<733f9905-c483-4835-8ec9-953b341950d1> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-534054970',display_name='tempest-TestMinimumBasicScenario-server-534054970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-534054970',id=30,image_ref='325c0786-2bab-4ff9-a435-46158e003aee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEN2s530aGNqCnv3Q2xJE1Vb0iCTwM9AOsamn/qxqdg0D1v7VpXgftDlWrVrqOqOuPZ9gUPuvoZNn/6knJQVreVVsytrn4dDpcRmQOd9fotXylI6tQ+iozlTHfRnex9sQ==',key_name='tempest-TestMinimumBasicScenario-631134433',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:01:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='f0801cbd66c8457b887d383721d95915',ramdisk_id='',reservation_id='r-2trkv2ny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='325c0786-2bab-4ff9-a435-46158e003aee',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2019017585',owner_user_name='tempest-TestMinimumBasicScenario-2019017585-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:03:33Z,user_data=None,user_id='eb526efdda0c4ca2ba8e739ecbe9e148',uuid=733f9905-c483-4835-8ec9-953b341950d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Converting VIF {"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=b3126cae-fa19-4a34-b87a-5e97ca70770b,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3126cae-fa') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG os_vif [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=b3126cae-fa19-4a34-b87a-5e97ca70770b,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3126cae-fa') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '511322df-534b-520f-9661-3e5786dc5ed7', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3126cae-fa, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3126cae-fa, col_values=(('qos', UUID('69229c3f-fa04-4831-a2ff-75076bfd62ff')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3126cae-fa, col_values=(('external_ids', {'iface-id': 'b3126cae-fa19-4a34-b87a-5e97ca70770b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:1e:34', 'vm-uuid': '733f9905-c483-4835-8ec9-953b341950d1'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:03:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:36 user nova-compute[75083]: INFO os_vif [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=b3126cae-fa19-4a34-b87a-5e97ca70770b,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3126cae-fa')
Nov 29 06:03:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-f464c27e-9fb3-49c0-8693-541b063591c8 req-1d0ad532-fdb6-4548-b967-d54d272bcca9 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received event network-vif-plugged-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:03:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f464c27e-9fb3-49c0-8693-541b063591c8 req-1d0ad532-fdb6-4548-b967-d54d272bcca9 service nova] Acquiring lock "733f9905-c483-4835-8ec9-953b341950d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:03:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f464c27e-9fb3-49c0-8693-541b063591c8 req-1d0ad532-fdb6-4548-b967-d54d272bcca9 service nova] Lock "733f9905-c483-4835-8ec9-953b341950d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:03:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f464c27e-9fb3-49c0-8693-541b063591c8 req-1d0ad532-fdb6-4548-b967-d54d272bcca9 service nova] Lock "733f9905-c483-4835-8ec9-953b341950d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:03:38 user nova-compute[75083]: DEBUG nova.compute.manager [req-f464c27e-9fb3-49c0-8693-541b063591c8 req-1d0ad532-fdb6-4548-b967-d54d272bcca9 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] No waiting events found dispatching network-vif-plugged-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:03:38 user nova-compute[75083]: WARNING nova.compute.manager [req-f464c27e-9fb3-49c0-8693-541b063591c8 req-1d0ad532-fdb6-4548-b967-d54d272bcca9 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received unexpected event network-vif-plugged-b3126cae-fa19-4a34-b87a-5e97ca70770b for instance with vm_state active and task_state reboot_started_hard.
Nov 29 06:03:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:40 user nova-compute[75083]: DEBUG nova.compute.manager [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:03:40 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Instance rebooted successfully.
Nov 29 06:03:40 user nova-compute[75083]: DEBUG nova.compute.manager [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:03:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-e45f0a90-08c3-4c84-bc50-4b6d2d8be0e1 req-7d09461a-8fae-4eee-877d-9553464301df service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received event network-vif-plugged-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:03:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e45f0a90-08c3-4c84-bc50-4b6d2d8be0e1 req-7d09461a-8fae-4eee-877d-9553464301df service nova] Acquiring lock "733f9905-c483-4835-8ec9-953b341950d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:03:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e45f0a90-08c3-4c84-bc50-4b6d2d8be0e1 req-7d09461a-8fae-4eee-877d-9553464301df service nova] Lock "733f9905-c483-4835-8ec9-953b341950d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:03:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e45f0a90-08c3-4c84-bc50-4b6d2d8be0e1 req-7d09461a-8fae-4eee-877d-9553464301df service nova] Lock "733f9905-c483-4835-8ec9-953b341950d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:03:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-e45f0a90-08c3-4c84-bc50-4b6d2d8be0e1 req-7d09461a-8fae-4eee-877d-9553464301df service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] No waiting events found dispatching network-vif-plugged-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:03:40 user nova-compute[75083]: WARNING nova.compute.manager [req-e45f0a90-08c3-4c84-bc50-4b6d2d8be0e1 req-7d09461a-8fae-4eee-877d-9553464301df service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received unexpected event network-vif-plugged-b3126cae-fa19-4a34-b87a-5e97ca70770b for instance with vm_state active and task_state reboot_started_hard.
Nov 29 06:03:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-42d017d0-2491-4afa-a515-ddb2ae40a18b tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "733f9905-c483-4835-8ec9-953b341950d1" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.704s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:03:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:03:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:03:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:07 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:04:08 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:04:09 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:04:09 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:04:09 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:04:10 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:04:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:11 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:04:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:04:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:11 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:04:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:04:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:04:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:04:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:16 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:04:16 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:04:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=7470MB free_disk=25.055171966552734GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 161c6455-90ce-4c40-a33e-7f582989135d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4435ed78-e35f-4859-8a4f-9920815d968a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a34d9d98-be73-4d52-85f0-83e48f60bc12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 05f45fef-c8a7-41c1-a571-863307caca6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 18dc5c9c-8fb3-41c7-a124-4881788b3c48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a6e1c2d7-1181-4d9f-99eb-d401d5f73b25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 733f9905-c483-4835-8ec9-953b341950d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 81060822-ed09-4cfe-83c2-e5301b38bd71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 60f356b4-fa3d-4115-b868-f7b470ce7c87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fea64bdc-491c-46ba-9447-c175df432deb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance f1a6ae72-f187-4558-a164-49c436e886ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.513s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:04:17 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:04:17 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:04:17 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 06:04:17 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:04:17 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:04:17 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:04:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:04:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:04:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:04:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:04:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:25 user nova-compute[75083]: INFO nova.compute.manager [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Terminating instance
Nov 29 06:04:25 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-5e0f9c33-1b44-4b63-98e4-e8a6df731030 req-c91beda7-ad0f-449a-83a7-c0ebcb405522 service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Received event network-vif-unplugged-5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e0f9c33-1b44-4b63-98e4-e8a6df731030 req-c91beda7-ad0f-449a-83a7-c0ebcb405522 service nova] Acquiring lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e0f9c33-1b44-4b63-98e4-e8a6df731030 req-c91beda7-ad0f-449a-83a7-c0ebcb405522 service nova] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e0f9c33-1b44-4b63-98e4-e8a6df731030 req-c91beda7-ad0f-449a-83a7-c0ebcb405522 service nova] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-5e0f9c33-1b44-4b63-98e4-e8a6df731030 req-c91beda7-ad0f-449a-83a7-c0ebcb405522 service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] No waiting events found dispatching network-vif-unplugged-5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-5e0f9c33-1b44-4b63-98e4-e8a6df731030 req-c91beda7-ad0f-449a-83a7-c0ebcb405522 service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Received event network-vif-unplugged-5c054e6a-71b8-4b15-8153-356638de21d7 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-5e0f9c33-1b44-4b63-98e4-e8a6df731030 req-c91beda7-ad0f-449a-83a7-c0ebcb405522 service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Received event network-changed-89b1aa1d-d184-456e-9abf-235e1b72201f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-5e0f9c33-1b44-4b63-98e4-e8a6df731030 req-c91beda7-ad0f-449a-83a7-c0ebcb405522 service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Refreshing instance network info cache due to event network-changed-89b1aa1d-d184-456e-9abf-235e1b72201f. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e0f9c33-1b44-4b63-98e4-e8a6df731030 req-c91beda7-ad0f-449a-83a7-c0ebcb405522 service nova] Acquiring lock "refresh_cache-81060822-ed09-4cfe-83c2-e5301b38bd71" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e0f9c33-1b44-4b63-98e4-e8a6df731030 req-c91beda7-ad0f-449a-83a7-c0ebcb405522 service nova] Acquired lock "refresh_cache-81060822-ed09-4cfe-83c2-e5301b38bd71" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG nova.network.neutron [req-5e0f9c33-1b44-4b63-98e4-e8a6df731030 req-c91beda7-ad0f-449a-83a7-c0ebcb405522 service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Refreshing network info cache for port 89b1aa1d-d184-456e-9abf-235e1b72201f {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:26 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Instance destroyed successfully.
Nov 29 06:04:26 user nova-compute[75083]: DEBUG nova.objects.instance [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lazy-loading 'resources' on Instance uuid 18dc5c9c-8fb3-41c7-a124-4881788b3c48 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1662636095',display_name='tempest-ServerActionsTestOtherA-server-1662636095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1662636095',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/QARryHVy9tL0HspVgAb5d+hXfz/yMgw4/juPCBWiK9jONO+/KTLCL7Bj2On8DfV4bHN063zv9H1zJ2YV2YRCRWmcFlsfDLpgZRojBg+ehebykt/upaC2Fb+0QP3Sb0w==',key_name='tempest-keypair-908590560',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:00:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95d0f3dd09bf436498e67d7bfdd904bf',ramdisk_id='',reservation_id='r-5gd7ljor',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2114836332',owner_user_name='tempest-ServerActionsTestOtherA-2114836332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:01:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbd7f863ad7c4229957c4b08601b5003',uuid=18dc5c9c-8fb3-41c7-a124-4881788b3c48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converting VIF {"id": "5c054e6a-71b8-4b15-8153-356638de21d7", "address": "fa:16:3e:34:e7:fa", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c054e6a-71", "ovs_interfaceid": "5c054e6a-71b8-4b15-8153-356638de21d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:e7:fa,bridge_name='br-int',has_traffic_filtering=True,id=5c054e6a-71b8-4b15-8153-356638de21d7,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c054e6a-71') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG os_vif [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:e7:fa,bridge_name='br-int',has_traffic_filtering=True,id=5c054e6a-71b8-4b15-8153-356638de21d7,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c054e6a-71') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c054e6a-71, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d39c817-a5e0-4f34-8a3a-e7a01cce78ba) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "81060822-ed09-4cfe-83c2-e5301b38bd71" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "81060822-ed09-4cfe-83c2-e5301b38bd71" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "81060822-ed09-4cfe-83c2-e5301b38bd71-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "81060822-ed09-4cfe-83c2-e5301b38bd71-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "81060822-ed09-4cfe-83c2-e5301b38bd71-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.004s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:26 user nova-compute[75083]: INFO nova.compute.manager [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Terminating instance
Nov 29 06:04:26 user nova-compute[75083]: INFO os_vif [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:e7:fa,bridge_name='br-int',has_traffic_filtering=True,id=5c054e6a-71b8-4b15-8153-356638de21d7,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c054e6a-71')
Nov 29 06:04:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VBpGufml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:04:26 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:04:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG nova.network.neutron [req-5e0f9c33-1b44-4b63-98e4-e8a6df731030 req-c91beda7-ad0f-449a-83a7-c0ebcb405522 service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Updated VIF entry in instance network info cache for port 89b1aa1d-d184-456e-9abf-235e1b72201f. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG nova.network.neutron [req-5e0f9c33-1b44-4b63-98e4-e8a6df731030 req-c91beda7-ad0f-449a-83a7-c0ebcb405522 service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Updating instance_info_cache with network_info: [{"id": "89b1aa1d-d184-456e-9abf-235e1b72201f", "address": "fa:16:3e:0b:b5:06", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b1aa1d-d1", "ovs_interfaceid": "89b1aa1d-d184-456e-9abf-235e1b72201f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67be9ed-db5d-4891-a641-41ec4e98d959]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:04:26 user nova-compute[75083]: No targets found.
Nov 29 06:04:26 user nova-compute[75083]: iSNS:
Nov 29 06:04:26 user nova-compute[75083]: No targets found.
Nov 29 06:04:26 user nova-compute[75083]: STATIC:
Nov 29 06:04:26 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856
Nov 29 06:04:26 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:04:26 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:04:26 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f
Nov 29 06:04:26 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:04:26 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:04:26 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542
Nov 29 06:04:26 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:04:26 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:04:26 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4
Nov 29 06:04:26 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:04:26 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:04:26 user nova-compute[75083]: FIRMWARE:
Nov 29 06:04:26 user nova-compute[75083]: No targets found.
Nov 29 06:04:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:04:26 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:04:26 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5e0f9c33-1b44-4b63-98e4-e8a6df731030 req-c91beda7-ad0f-449a-83a7-c0ebcb405522 service nova] Releasing lock "refresh_cache-81060822-ed09-4cfe-83c2-e5301b38bd71" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cd44fc-dff4-4f81-863c-265453e91f77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cb852b-57d1-47f5-996d-4a38e01786a5]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:04:26 user nova-compute[75083]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:04:26 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:04:26 user nova-compute[75083]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)
Nov 29 06:04:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 (non-flash)
Nov 29 06:04:26 user nova-compute[75083]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:04:26 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:04:26 user nova-compute[75083]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)
Nov 29 06:04:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b8483010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4'): ({'sdc'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Removing single pathed devices sdc {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dcbf4c-21da-4d11-b3ff-12d6fd541522]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2c1cf2-ca2e-4307-a3d3-937c177a030d]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Flushing IO for device /dev/sdc {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8077f4c-2d79-44b5-9d19-9057b322ad1f]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:04:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a44f949-d57d-42b1-b9fa-6dc8d825b4e4]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e92c262-e331-41c4-8d9d-1adc3d86e4ff]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9891d797-547b-45a8-8103-930df5155310]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4, portal: 172.16.0.220,3260]
Nov 29 06:04:27 user nova-compute[75083]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4, portal: 172.16.0.220,3260] successful.
Nov 29 06:04:27 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd16d88f-6e45-4545-9260-ba380f6262e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[08da5279-2909-4cc0-ba99-02d406f44b61]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] <== disconnect_volume: return (393ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:04:27 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Deleting instance files /opt/stack/data/nova/instances/18dc5c9c-8fb3-41c7-a124-4881788b3c48_del
Nov 29 06:04:27 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Deletion of /opt/stack/data/nova/instances/18dc5c9c-8fb3-41c7-a124-4881788b3c48_del complete
Nov 29 06:04:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG nova.compute.manager [req-3f5bceb2-b8ba-4a25-b680-eb333ecafc1e req-90f6981a-3947-40da-814b-f7b694e06cff service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Received event network-vif-unplugged-89b1aa1d-d184-456e-9abf-235e1b72201f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3f5bceb2-b8ba-4a25-b680-eb333ecafc1e req-90f6981a-3947-40da-814b-f7b694e06cff service nova] Acquiring lock "81060822-ed09-4cfe-83c2-e5301b38bd71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3f5bceb2-b8ba-4a25-b680-eb333ecafc1e req-90f6981a-3947-40da-814b-f7b694e06cff service nova] Lock "81060822-ed09-4cfe-83c2-e5301b38bd71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3f5bceb2-b8ba-4a25-b680-eb333ecafc1e req-90f6981a-3947-40da-814b-f7b694e06cff service nova] Lock "81060822-ed09-4cfe-83c2-e5301b38bd71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG nova.compute.manager [req-3f5bceb2-b8ba-4a25-b680-eb333ecafc1e req-90f6981a-3947-40da-814b-f7b694e06cff service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] No waiting events found dispatching network-vif-unplugged-89b1aa1d-d184-456e-9abf-235e1b72201f {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG nova.compute.manager [req-3f5bceb2-b8ba-4a25-b680-eb333ecafc1e req-90f6981a-3947-40da-814b-f7b694e06cff service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Received event network-vif-unplugged-89b1aa1d-d184-456e-9abf-235e1b72201f for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:27 user nova-compute[75083]: INFO nova.compute.manager [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:04:27 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Instance destroyed successfully.
Nov 29 06:04:27 user nova-compute[75083]: DEBUG nova.objects.instance [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lazy-loading 'resources' on Instance uuid 81060822-ed09-4cfe-83c2-e5301b38bd71 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-199177077',display_name='tempest-AttachVolumeNegativeTest-server-199177077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-199177077',id=31,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUEVv5B+K8M5rUKCiUz4RKLKkcOl4ix0TaJpEtgy72reY7CtqWJynN/39L8UqxIDJjPK/Tw2j69yDUaD8DBx+phizGaVu+ri85XqGO25ekMZu91NNX4bD24vTbkOAy8sw==',key_name='tempest-keypair-786764528',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:02:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='112a98f04dc141dfbb0f7a10fd410cae',ramdisk_id='',reservation_id='r-7z70okgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1387142425',owner_user_name='tempest-AttachVolumeNegativeTest-1387142425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:02:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dc42da0ede8433a827629a68e691658',uuid=81060822-ed09-4cfe-83c2-e5301b38bd71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89b1aa1d-d184-456e-9abf-235e1b72201f", "address": "fa:16:3e:0b:b5:06", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b1aa1d-d1", "ovs_interfaceid": "89b1aa1d-d184-456e-9abf-235e1b72201f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converting VIF {"id": "89b1aa1d-d184-456e-9abf-235e1b72201f", "address": "fa:16:3e:0b:b5:06", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b1aa1d-d1", "ovs_interfaceid": "89b1aa1d-d184-456e-9abf-235e1b72201f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b5:06,bridge_name='br-int',has_traffic_filtering=True,id=89b1aa1d-d184-456e-9abf-235e1b72201f,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b1aa1d-d1') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG os_vif [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b5:06,bridge_name='br-int',has_traffic_filtering=True,id=89b1aa1d-d184-456e-9abf-235e1b72201f,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b1aa1d-d1') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89b1aa1d-d1, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2a4f050-eab9-4839-9573-9c2a4df90201) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:27 user nova-compute[75083]: INFO os_vif [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b5:06,bridge_name='br-int',has_traffic_filtering=True,id=89b1aa1d-d184-456e-9abf-235e1b72201f,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b1aa1d-d1')
Nov 29 06:04:27 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Deleting instance files /opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71_del
Nov 29 06:04:27 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Deletion of /opt/stack/data/nova/instances/81060822-ed09-4cfe-83c2-e5301b38bd71_del complete
Nov 29 06:04:27 user nova-compute[75083]: INFO nova.compute.manager [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Acquiring lock "60f356b4-fa3d-4115-b868-f7b470ce7c87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Lock "60f356b4-fa3d-4115-b868-f7b470ce7c87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Acquiring lock "60f356b4-fa3d-4115-b868-f7b470ce7c87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Lock "60f356b4-fa3d-4115-b868-f7b470ce7c87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Lock "60f356b4-fa3d-4115-b868-f7b470ce7c87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:27 user nova-compute[75083]: INFO nova.compute.manager [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Terminating instance
Nov 29 06:04:27 user nova-compute[75083]: DEBUG nova.compute.manager [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-7c571f6a-a56e-421d-a04d-c182ca34c838 req-f60979ef-b389-4798-a403-92b11080080c service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Received event network-vif-plugged-5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7c571f6a-a56e-421d-a04d-c182ca34c838 req-f60979ef-b389-4798-a403-92b11080080c service nova] Acquiring lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7c571f6a-a56e-421d-a04d-c182ca34c838 req-f60979ef-b389-4798-a403-92b11080080c service nova] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7c571f6a-a56e-421d-a04d-c182ca34c838 req-f60979ef-b389-4798-a403-92b11080080c service nova] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-7c571f6a-a56e-421d-a04d-c182ca34c838 req-f60979ef-b389-4798-a403-92b11080080c service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] No waiting events found dispatching network-vif-plugged-5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:04:28 user nova-compute[75083]: WARNING nova.compute.manager [req-7c571f6a-a56e-421d-a04d-c182ca34c838 req-f60979ef-b389-4798-a403-92b11080080c service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Received unexpected event network-vif-plugged-5c054e6a-71b8-4b15-8153-356638de21d7 for instance with vm_state active and task_state deleting.
Nov 29 06:04:28 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Instance destroyed successfully.
Nov 29 06:04:28 user nova-compute[75083]: DEBUG nova.objects.instance [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Lazy-loading 'resources' on Instance uuid 60f356b4-fa3d-4115-b868-f7b470ce7c87 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:02:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-694878787',display_name='tempest-VolumesNegativeTest-instance-694878787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-694878787',id=32,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:02:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1f7413e8444428ab7add73fcacd6d03',ramdisk_id='',reservation_id='r-6vmtbpz3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-29446818',owner_user_name='tempest-VolumesNegativeTest-29446818-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:02:45Z,user_data=None,user_id='627cfb252f124a61998c0596bf31ce2d',uuid=60f356b4-fa3d-4115-b868-f7b470ce7c87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a93a1617-10a0-4d21-a8c5-5527f662de73", "address": "fa:16:3e:47:cd:ac", "network": {"id": "e53c6a58-bbc4-4602-b43f-81e3a477baf4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "338a11d250eb4a7a9ead9ff296e79514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93a1617-10", "ovs_interfaceid": "a93a1617-10a0-4d21-a8c5-5527f662de73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Converting VIF {"id": "a93a1617-10a0-4d21-a8c5-5527f662de73", "address": "fa:16:3e:47:cd:ac", "network": {"id": "e53c6a58-bbc4-4602-b43f-81e3a477baf4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "338a11d250eb4a7a9ead9ff296e79514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93a1617-10", "ovs_interfaceid": "a93a1617-10a0-4d21-a8c5-5527f662de73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:cd:ac,bridge_name='br-int',has_traffic_filtering=True,id=a93a1617-10a0-4d21-a8c5-5527f662de73,network=Network(e53c6a58-bbc4-4602-b43f-81e3a477baf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93a1617-10') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG os_vif [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:cd:ac,bridge_name='br-int',has_traffic_filtering=True,id=a93a1617-10a0-4d21-a8c5-5527f662de73,network=Network(e53c6a58-bbc4-4602-b43f-81e3a477baf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93a1617-10') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa93a1617-10, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61c406c0-0d73-40bb-a970-49e8efe443d1) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:28 user nova-compute[75083]: INFO os_vif [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:cd:ac,bridge_name='br-int',has_traffic_filtering=True,id=a93a1617-10a0-4d21-a8c5-5527f662de73,network=Network(e53c6a58-bbc4-4602-b43f-81e3a477baf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93a1617-10')
Nov 29 06:04:28 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Deleting instance files /opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87_del
Nov 29 06:04:28 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Deletion of /opt/stack/data/nova/instances/60f356b4-fa3d-4115-b868-f7b470ce7c87_del complete
Nov 29 06:04:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-041f94ba-992f-42c7-8779-a4fff6bd8c63 req-64e4f1d5-4cc0-4300-aa9e-65625705a28b service nova] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Received event network-vif-unplugged-a93a1617-10a0-4d21-a8c5-5527f662de73 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-041f94ba-992f-42c7-8779-a4fff6bd8c63 req-64e4f1d5-4cc0-4300-aa9e-65625705a28b service nova] Acquiring lock "60f356b4-fa3d-4115-b868-f7b470ce7c87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-041f94ba-992f-42c7-8779-a4fff6bd8c63 req-64e4f1d5-4cc0-4300-aa9e-65625705a28b service nova] Lock "60f356b4-fa3d-4115-b868-f7b470ce7c87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-041f94ba-992f-42c7-8779-a4fff6bd8c63 req-64e4f1d5-4cc0-4300-aa9e-65625705a28b service nova] Lock "60f356b4-fa3d-4115-b868-f7b470ce7c87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-041f94ba-992f-42c7-8779-a4fff6bd8c63 req-64e4f1d5-4cc0-4300-aa9e-65625705a28b service nova] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] No waiting events found dispatching network-vif-unplugged-a93a1617-10a0-4d21-a8c5-5527f662de73 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-041f94ba-992f-42c7-8779-a4fff6bd8c63 req-64e4f1d5-4cc0-4300-aa9e-65625705a28b service nova] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Received event network-vif-unplugged-a93a1617-10a0-4d21-a8c5-5527f662de73 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:04:28 user nova-compute[75083]: INFO nova.compute.manager [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 29 06:04:28 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:04:28 user nova-compute[75083]: INFO nova.compute.manager [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Rescuing
Nov 29 06:04:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquired lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG nova.network.neutron [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:04:28 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:04:28 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Took 1.51 seconds to deallocate network for instance.
Nov 29 06:04:29 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:04:29 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Took 1.39 seconds to deallocate network for instance.
Nov 29 06:04:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:29 user nova-compute[75083]: DEBUG nova.compute.manager [req-abbcfcb5-9196-428a-9af3-4348c9a4f88f req-21a3d4ee-4b7f-415e-a911-9db4405eb8e7 service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Received event network-vif-plugged-89b1aa1d-d184-456e-9abf-235e1b72201f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:04:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-abbcfcb5-9196-428a-9af3-4348c9a4f88f req-21a3d4ee-4b7f-415e-a911-9db4405eb8e7 service nova] Acquiring lock "81060822-ed09-4cfe-83c2-e5301b38bd71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-abbcfcb5-9196-428a-9af3-4348c9a4f88f req-21a3d4ee-4b7f-415e-a911-9db4405eb8e7 service nova] Lock "81060822-ed09-4cfe-83c2-e5301b38bd71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-abbcfcb5-9196-428a-9af3-4348c9a4f88f req-21a3d4ee-4b7f-415e-a911-9db4405eb8e7 service nova] Lock "81060822-ed09-4cfe-83c2-e5301b38bd71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:29 user nova-compute[75083]: DEBUG nova.compute.manager [req-abbcfcb5-9196-428a-9af3-4348c9a4f88f req-21a3d4ee-4b7f-415e-a911-9db4405eb8e7 service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] No waiting events found dispatching network-vif-plugged-89b1aa1d-d184-456e-9abf-235e1b72201f {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:04:29 user nova-compute[75083]: WARNING nova.compute.manager [req-abbcfcb5-9196-428a-9af3-4348c9a4f88f req-21a3d4ee-4b7f-415e-a911-9db4405eb8e7 service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Received unexpected event network-vif-plugged-89b1aa1d-d184-456e-9abf-235e1b72201f for instance with vm_state deleted and task_state None.
Nov 29 06:04:29 user nova-compute[75083]: DEBUG nova.network.neutron [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Updating instance_info_cache with network_info: [{"id": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "address": "fa:16:3e:e1:f6:16", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feebf60-26", "ovs_interfaceid": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:04:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Releasing lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:04:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:29 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:04:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:29 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:04:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:29 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Deleted allocations for instance 81060822-ed09-4cfe-83c2-e5301b38bd71
Nov 29 06:04:29 user nova-compute[75083]: INFO nova.compute.manager [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Took 0.87 seconds to detach 1 volumes for instance.
Nov 29 06:04:29 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Deleting volume: dd16d88f-6e45-4545-9260-ba380f6262e4 {{(pid=75083) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 06:04:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-031750b5-ac61-4a13-b7ad-876027ea0185 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "81060822-ed09-4cfe-83c2-e5301b38bd71" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.987s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:29 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:04:30 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Took 1.50 seconds to deallocate network for instance.
Nov 29 06:04:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:30 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:04:30 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:04:30 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Instance destroyed successfully.
Nov 29 06:04:30 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Attempting a stable device rescue
Nov 29 06:04:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.161s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75083) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 06:04:30 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Instance directory exists: not creating {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 06:04:30 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Creating image(s)
Nov 29 06:04:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "/opt/stack/data/nova/instances/fea64bdc-491c-46ba-9447-c175df432deb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "/opt/stack/data/nova/instances/fea64bdc-491c-46ba-9447-c175df432deb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "/opt/stack/data/nova/instances/fea64bdc-491c-46ba-9447-c175df432deb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:30 user nova-compute[75083]: DEBUG nova.objects.instance [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'trusted_certs' on Instance uuid fea64bdc-491c-46ba-9447-c175df432deb {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:04:30 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Deleted allocations for instance 18dc5c9c-8fb3-41c7-a124-4881788b3c48
Nov 29 06:04:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "010ee24463793ef82fe1687e0c696d18d51ac994" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "010ee24463793ef82fe1687e0c696d18d51ac994" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8eaf1e1f-11b6-4a25-b310-8a30642f6779 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "18dc5c9c-8fb3-41c7-a124-4881788b3c48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.461s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010ee24463793ef82fe1687e0c696d18d51ac994.part --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-ca5443bc-8c9f-48f7-8912-005065044a60 req-12872550-5de9-4eb0-a389-19bcd591f2b1 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received event network-vif-unplugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ca5443bc-8c9f-48f7-8912-005065044a60 req-12872550-5de9-4eb0-a389-19bcd591f2b1 service nova] Acquiring lock "fea64bdc-491c-46ba-9447-c175df432deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ca5443bc-8c9f-48f7-8912-005065044a60 req-12872550-5de9-4eb0-a389-19bcd591f2b1 service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ca5443bc-8c9f-48f7-8912-005065044a60 req-12872550-5de9-4eb0-a389-19bcd591f2b1 service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-ca5443bc-8c9f-48f7-8912-005065044a60 req-12872550-5de9-4eb0-a389-19bcd591f2b1 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] No waiting events found dispatching network-vif-unplugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:04:31 user nova-compute[75083]: WARNING nova.compute.manager [req-ca5443bc-8c9f-48f7-8912-005065044a60 req-12872550-5de9-4eb0-a389-19bcd591f2b1 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received unexpected event network-vif-unplugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 for instance with vm_state active and task_state rescuing.
Nov 29 06:04:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-ca5443bc-8c9f-48f7-8912-005065044a60 req-12872550-5de9-4eb0-a389-19bcd591f2b1 service nova] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Received event network-vif-deleted-a93a1617-10a0-4d21-a8c5-5527f662de73 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-ca5443bc-8c9f-48f7-8912-005065044a60 req-12872550-5de9-4eb0-a389-19bcd591f2b1 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received event network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ca5443bc-8c9f-48f7-8912-005065044a60 req-12872550-5de9-4eb0-a389-19bcd591f2b1 service nova] Acquiring lock "fea64bdc-491c-46ba-9447-c175df432deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ca5443bc-8c9f-48f7-8912-005065044a60 req-12872550-5de9-4eb0-a389-19bcd591f2b1 service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ca5443bc-8c9f-48f7-8912-005065044a60 req-12872550-5de9-4eb0-a389-19bcd591f2b1 service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-ca5443bc-8c9f-48f7-8912-005065044a60 req-12872550-5de9-4eb0-a389-19bcd591f2b1 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] No waiting events found dispatching network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:04:31 user nova-compute[75083]: WARNING nova.compute.manager [req-ca5443bc-8c9f-48f7-8912-005065044a60 req-12872550-5de9-4eb0-a389-19bcd591f2b1 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received unexpected event network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 for instance with vm_state active and task_state rescuing.
Nov 29 06:04:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-323f0339-6219-4327-8ace-d35c469055dd req-55bd3d43-cf69-4607-8519-2bac5755d33f service nova] [instance: 18dc5c9c-8fb3-41c7-a124-4881788b3c48] Received event network-vif-deleted-5c054e6a-71b8-4b15-8153-356638de21d7 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-323f0339-6219-4327-8ace-d35c469055dd req-55bd3d43-cf69-4607-8519-2bac5755d33f service nova] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Received event network-vif-plugged-a93a1617-10a0-4d21-a8c5-5527f662de73 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-323f0339-6219-4327-8ace-d35c469055dd req-55bd3d43-cf69-4607-8519-2bac5755d33f service nova] Acquiring lock "60f356b4-fa3d-4115-b868-f7b470ce7c87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-323f0339-6219-4327-8ace-d35c469055dd req-55bd3d43-cf69-4607-8519-2bac5755d33f service nova] Lock "60f356b4-fa3d-4115-b868-f7b470ce7c87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-323f0339-6219-4327-8ace-d35c469055dd req-55bd3d43-cf69-4607-8519-2bac5755d33f service nova] Lock "60f356b4-fa3d-4115-b868-f7b470ce7c87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-323f0339-6219-4327-8ace-d35c469055dd req-55bd3d43-cf69-4607-8519-2bac5755d33f service nova] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] No waiting events found dispatching network-vif-plugged-a93a1617-10a0-4d21-a8c5-5527f662de73 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:04:31 user nova-compute[75083]: WARNING nova.compute.manager [req-323f0339-6219-4327-8ace-d35c469055dd req-55bd3d43-cf69-4607-8519-2bac5755d33f service nova] [instance: 60f356b4-fa3d-4115-b868-f7b470ce7c87] Received unexpected event network-vif-plugged-a93a1617-10a0-4d21-a8c5-5527f662de73 for instance with vm_state deleted and task_state None.
Nov 29 06:04:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-323f0339-6219-4327-8ace-d35c469055dd req-55bd3d43-cf69-4607-8519-2bac5755d33f service nova] [instance: 81060822-ed09-4cfe-83c2-e5301b38bd71] Received event network-vif-deleted-89b1aa1d-d184-456e-9abf-235e1b72201f {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010ee24463793ef82fe1687e0c696d18d51ac994.part --force-share --output=json" returned: 0 in 0.199s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG nova.virt.images [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] 63ccaeb3-08e4-4d2d-9dcf-9bf228c2f7c4 was qcow2, converting to raw {{(pid=75083) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG nova.privsep.utils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75083) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/010ee24463793ef82fe1687e0c696d18d51ac994.part /opt/stack/data/nova/instances/_base/010ee24463793ef82fe1687e0c696d18d51ac994.converted {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:04:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.628s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:32 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Deleted allocations for instance 60f356b4-fa3d-4115-b868-f7b470ce7c87
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7376993d-a6a0-4675-9ff0-4e009215cd25 tempest-VolumesNegativeTest-29446818 tempest-VolumesNegativeTest-29446818-project-member] Lock "60f356b4-fa3d-4115-b868-f7b470ce7c87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.404s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/010ee24463793ef82fe1687e0c696d18d51ac994.part /opt/stack/data/nova/instances/_base/010ee24463793ef82fe1687e0c696d18d51ac994.converted" returned: 0 in 0.718s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010ee24463793ef82fe1687e0c696d18d51ac994.converted --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010ee24463793ef82fe1687e0c696d18d51ac994.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "010ee24463793ef82fe1687e0c696d18d51ac994" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.214s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "010ee24463793ef82fe1687e0c696d18d51ac994" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "010ee24463793ef82fe1687e0c696d18d51ac994" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010ee24463793ef82fe1687e0c696d18d51ac994 --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010ee24463793ef82fe1687e0c696d18d51ac994 --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010ee24463793ef82fe1687e0c696d18d51ac994,backing_fmt=raw /opt/stack/data/nova/instances/fea64bdc-491c-46ba-9447-c175df432deb/disk.rescue {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010ee24463793ef82fe1687e0c696d18d51ac994,backing_fmt=raw /opt/stack/data/nova/instances/fea64bdc-491c-46ba-9447-c175df432deb/disk.rescue" returned: 0 in 0.050s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "010ee24463793ef82fe1687e0c696d18d51ac994" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.objects.instance [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'migration_context' on Instance uuid fea64bdc-491c-46ba-9447-c175df432deb {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.objects.base [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Object Instance<fea64bdc-491c-46ba-9447-c175df432deb> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Start _get_guest_xml network_info=[{"id": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "address": "fa:16:3e:e1:f6:16", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "vif_mac": "fa:16:3e:e1:f6:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feebf60-26", "ovs_interfaceid": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '63ccaeb3-08e4-4d2d-9dcf-9bf228c2f7c4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'a85f3bba-069b-4f78-a024-9a6f31c657a5', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sujkGoES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'fea64bdc-491c-46ba-9447-c175df432deb', 'attached_at': '', 'detached_at': '', 'volume_id': '96aca32e-a3bc-4ea5-bb3a-33ac7beec856', 'serial': '96aca32e-a3bc-4ea5-bb3a-33ac7beec856'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.objects.instance [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'resources' on Instance uuid fea64bdc-491c-46ba-9447-c175df432deb {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.objects.base [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Object Instance<fea64bdc-491c-46ba-9447-c175df432deb> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.objects.instance [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'numa_topology' on Instance uuid fea64bdc-491c-46ba-9447-c175df432deb {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.objects.base [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Object Instance<fea64bdc-491c-46ba-9447-c175df432deb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 06:04:32 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:04:32 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.objects.instance [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'vcpu_model' on Instance uuid fea64bdc-491c-46ba-9447-c175df432deb {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.objects.base [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Object Instance<fea64bdc-491c-46ba-9447-c175df432deb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sujkGoES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:04:32 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:04:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:04:32 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:04:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:04:32 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1031a4-22ae-4a36-9d1c-cbcfdf1b7043]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = sujkGoES\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 06:04:32 user nova-compute[75083]: node.name = iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856
Nov 29 06:04:32 user nova-compute[75083]: node.tpgt = -1
Nov 29 06:04:32 user nova-compute[75083]: node.startup = automatic
Nov 29 06:04:32 user nova-compute[75083]: node.leading_login = No
Nov 29 06:04:32 user nova-compute[75083]: iface.iscsi_ifacename = default
Nov 29 06:04:32 user nova-compute[75083]: iface.net_ifacename = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.ipaddress = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.prefix_len = 0
Nov 29 06:04:32 user nova-compute[75083]: iface.hwaddress = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.transport_name = tcp
Nov 29 06:04:32 user nova-compute[75083]: iface.initiatorname = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.state = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.vlan_id = 0
Nov 29 06:04:32 user nova-compute[75083]: iface.vlan_priority = 0
Nov 29 06:04:32 user nova-compute[75083]: iface.vlan_state = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.iface_num = 0
Nov 29 06:04:32 user nova-compute[75083]: iface.mtu = 0
Nov 29 06:04:32 user nova-compute[75083]: iface.port = 0
Nov 29 06:04:32 user nova-compute[75083]: iface.bootproto = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.subnet_mask = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.gateway = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.dhcp_alt_client_id = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.dhcp_dns = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.dhcp_learn_iqn = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.dhcp_vendor_id_state = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.dhcp_vendor_id = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.dhcp_slp_da = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.fragmentation = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.gratuitous_arp = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.incoming_forwarding = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.tos_state = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.tos = 0
Nov 29 06:04:32 user nova-compute[75083]: iface.ttl = 0
Nov 29 06:04:32 user nova-compute[75083]: iface.delayed_ack = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.tcp_nagle = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.tcp_wsf_state = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.tcp_wsf = 0
Nov 29 06:04:32 user nova-compute[75083]: iface.tcp_timer_scale = 0
Nov 29 06:04:32 user nova-compute[75083]: iface.tcp_timestamp = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.redirect = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.def_task_mgmt_timeout = 0
Nov 29 06:04:32 user nova-compute[75083]: iface.header_digest = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.data_digest = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.immediate_data = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.initial_r2t = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.data_seq_inorder = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.data_pdu_inorder = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.erl = 0
Nov 29 06:04:32 user nova-compute[75083]: iface.max_receive_data_len = 0
Nov 29 06:04:32 user nova-compute[75083]: iface.first_burst_len = 0
Nov 29 06:04:32 user nova-compute[75083]: iface.max_outstanding_r2t = 0
Nov 29 06:04:32 user nova-compute[75083]: iface.max_burst_len = 0
Nov 29 06:04:32 user nova-compute[75083]: iface.chap_auth = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.bidi_chap = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.strict_login_compliance = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.discovery_auth = <empty>
Nov 29 06:04:32 user nova-compute[75083]: iface.discovery_logout = <empty>
Nov 29 06:04:32 user nova-compute[75083]: node.discovery_address = <empty>
Nov 29 06:04:32 user nova-compute[75083]: node.discovery_port = 0
Nov 29 06:04:32 user nova-compute[75083]: node.discovery_type = static
Nov 29 06:04:32 user nova-compute[75083]: node.session.initial_cmdsn = 0
Nov 29 06:04:32 user nova-compute[75083]: node.session.initial_login_retry_max = 8
Nov 29 06:04:32 user nova-compute[75083]: node.session.xmit_thread_priority = -20
Nov 29 06:04:32 user nova-compute[75083]: node.session.cmds_max = 128
Nov 29 06:04:32 user nova-compute[75083]: node.session.queue_depth = 32
Nov 29 06:04:32 user nova-compute[75083]: node.session.nr_sessions = 1
Nov 29 06:04:32 user nova-compute[75083]: node.session.auth.authmethod = CHAP
Nov 29 06:04:32 user nova-compute[75083]: node.session.auth.username = sujkGoES
Nov 29 06:04:32 user nova-compute[75083]: node.session.auth.password = ***
Nov 29 06:04:32 user nova-compute[75083]: node.session.auth.username_in = <empty>
Nov 29 06:04:32 user nova-compute[75083]: node.session.auth.password_in = <empty>
Nov 29 06:04:32 user nova-compute[75083]: node.session.auth.chap_algs = MD5
Nov 29 06:04:32 user nova-compute[75083]: node.session.timeo.replacement_timeout = 120
Nov 29 06:04:32 user nova-compute[75083]: node.session.err_timeo.abort_timeout = 15
Nov 29 06:04:32 user nova-compute[75083]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 06:04:32 user nova-compute[75083]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 06:04:32 user nova-compute[75083]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 06:04:32 user nova-compute[75083]: node.session.iscsi.FastAbort = Yes
Nov 29 06:04:32 user nova-compute[75083]: node.session.iscsi.InitialR2T = No
Nov 29 06:04:32 user nova-compute[75083]: node.session.iscsi.ImmediateData = Yes
Nov 29 06:04:32 user nova-compute[75083]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 06:04:32 user nova-compute[75083]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 06:04:32 user nova-compute[75083]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 06:04:32 user nova-compute[75083]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 06:04:32 user nova-compute[75083]: node.session.iscsi.MaxConnections = 1
Nov 29 06:04:32 user nova-compute[75083]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 06:04:32 user nova-compute[75083]: node.session.iscsi.ERL = 0
Nov 29 06:04:32 user nova-compute[75083]: node.session.scan = manual
Nov 29 06:04:32 user nova-compute[75083]: node.session.reopen_max = 0
Nov 29 06:04:32 user nova-compute[75083]: node.conn[0].address = 172.16.0.220
Nov 29 06:04:32 user nova-compute[75083]: node.conn[0].port = 3260
Nov 29 06:04:32 user nova-compute[75083]: node.conn[0].startup = manual
Nov 29 06:04:32 user nova-compute[75083]: node.conn[0].tcp.window_size = 524288
Nov 29 06:04:32 user nova-compute[75083]: node.conn[0].tcp.type_of_service = 0
Nov 29 06:04:32 user nova-compute[75083]: node.conn[0].timeo.logout_timeout = 15
Nov 29 06:04:32 user nova-compute[75083]: node.conn[0].timeo.login_timeout = 15
Nov 29 06:04:32 user nova-compute[75083]: node.conn[0].timeo.auth_timeout = 45
Nov 29 06:04:32 user nova-compute[75083]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 06:04:32 user nova-compute[75083]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 06:04:32 user nova-compute[75083]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 06:04:32 user nova-compute[75083]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 06:04:32 user nova-compute[75083]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 06:04:32 user nova-compute[75083]: node.conn[0].iscsi.DataDigest = None
Nov 29 06:04:32 user nova-compute[75083]: node.conn[0].iscsi.IFMarker = No
Nov 29 06:04:32 user nova-compute[75083]: node.conn[0].iscsi.OFMarker = No
Nov 29 06:04:32 user nova-compute[75083]: # END RECORD
Nov 29 06:04:32 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be4b740-9898-434e-bfe4-d19a78d27108]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef087e0c-8d87-43f3-9238-97d417b255b1]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sujkGoES {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sujkGoES" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deb1443-bad8-470d-a1fd-5ad8b46f3e20]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sujkGoES'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:04:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.099s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaefdd38-f82e-4208-8275-c1fa8f99be21]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d2bcb1-aeeb-48af-a351-34b38633413e]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:04:33 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:04:33 user nova-compute[75083]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)
Nov 29 06:04:33 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:04:33 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:04:33 user nova-compute[75083]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)
Nov 29 06:04:33 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.230s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] HCTL ('35', '0', '0', 0) found on session 37 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd47060-6514-4608-a424-5f5e98f20d56]: (4, ('0 0 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Searching for a device in session 37 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sujkGoES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.264s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] <== connect_volume: return (265ms) {'type': 'block', 'scsi_wwn': '23831373431383066', 'path': '/dev/sdd'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831373431383066', 'path': '/dev/sdd'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:02:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-147873442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-147873442',id=33,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:02:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47694ecf400b4d6c952d0c06d0764d1b',ramdisk_id='',reservation_id='r-0gk2qpfk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:02:58Z,user_data=None,user_id='4145bf5a07ea4d398f1a1e10a976c10f',uuid=fea64bdc-491c-46ba-9447-c175df432deb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "address": "fa:16:3e:e1:f6:16", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "vif_mac": "fa:16:3e:e1:f6:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feebf60-26", "ovs_interfaceid": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converting VIF {"id": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "address": "fa:16:3e:e1:f6:16", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "vif_mac": "fa:16:3e:e1:f6:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feebf60-26", "ovs_interfaceid": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:f6:16,bridge_name='br-int',has_traffic_filtering=True,id=1feebf60-26a4-4a1b-8978-cf8ea1bcf912,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1feebf60-26') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG nova.objects.instance [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'pci_devices' on Instance uuid fea64bdc-491c-46ba-9447-c175df432deb {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG nova.objects.base [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Object Instance<fea64bdc-491c-46ba-9447-c175df432deb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:04:33 user nova-compute[75083]:   <uuid>fea64bdc-491c-46ba-9447-c175df432deb</uuid>
Nov 29 06:04:33 user nova-compute[75083]:   <name>instance-00000021</name>
Nov 29 06:04:33 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:04:33 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:04:33 user nova-compute[75083]:   <metadata>
Nov 29 06:04:33 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:04:33 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:04:33 user nova-compute[75083]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-147873442</nova:name>
Nov 29 06:04:33 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:04:32</nova:creationTime>
Nov 29 06:04:33 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:04:33 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:04:33 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:04:33 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:04:33 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:04:33 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:04:33 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:04:33 user nova-compute[75083]:       <nova:owner>
Nov 29 06:04:33 user nova-compute[75083]:         <nova:user uuid="4145bf5a07ea4d398f1a1e10a976c10f">tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member</nova:user>
Nov 29 06:04:33 user nova-compute[75083]:         <nova:project uuid="47694ecf400b4d6c952d0c06d0764d1b">tempest-ServerBootFromVolumeStableRescueTest-1530350051</nova:project>
Nov 29 06:04:33 user nova-compute[75083]:       </nova:owner>
Nov 29 06:04:33 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 06:04:33 user nova-compute[75083]:       <nova:ports>
Nov 29 06:04:33 user nova-compute[75083]:         <nova:port uuid="1feebf60-26a4-4a1b-8978-cf8ea1bcf912">
Nov 29 06:04:33 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 06:04:33 user nova-compute[75083]:         </nova:port>
Nov 29 06:04:33 user nova-compute[75083]:       </nova:ports>
Nov 29 06:04:33 user nova-compute[75083]:     </nova:instance>
Nov 29 06:04:33 user nova-compute[75083]:   </metadata>
Nov 29 06:04:33 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:04:33 user nova-compute[75083]:     <system>
Nov 29 06:04:33 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:04:33 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:04:33 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:04:33 user nova-compute[75083]:       <entry name="serial">fea64bdc-491c-46ba-9447-c175df432deb</entry>
Nov 29 06:04:33 user nova-compute[75083]:       <entry name="uuid">fea64bdc-491c-46ba-9447-c175df432deb</entry>
Nov 29 06:04:33 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:04:33 user nova-compute[75083]:     </system>
Nov 29 06:04:33 user nova-compute[75083]:   </sysinfo>
Nov 29 06:04:33 user nova-compute[75083]:   <os>
Nov 29 06:04:33 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:04:33 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:04:33 user nova-compute[75083]:   </os>
Nov 29 06:04:33 user nova-compute[75083]:   <features>
Nov 29 06:04:33 user nova-compute[75083]:     <acpi/>
Nov 29 06:04:33 user nova-compute[75083]:     <apic/>
Nov 29 06:04:33 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:04:33 user nova-compute[75083]:   </features>
Nov 29 06:04:33 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:04:33 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:04:33 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:04:33 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:04:33 user nova-compute[75083]:   </clock>
Nov 29 06:04:33 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:04:33 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:04:33 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:04:33 user nova-compute[75083]:   </cpu>
Nov 29 06:04:33 user nova-compute[75083]:   <devices>
Nov 29 06:04:33 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 06:04:33 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:04:33 user nova-compute[75083]:       <source dev="/dev/sdd"/>
Nov 29 06:04:33 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:04:33 user nova-compute[75083]:       <serial>96aca32e-a3bc-4ea5-bb3a-33ac7beec856</serial>
Nov 29 06:04:33 user nova-compute[75083]:     </disk>
Nov 29 06:04:33 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:04:33 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:04:33 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/fea64bdc-491c-46ba-9447-c175df432deb/disk.rescue"/>
Nov 29 06:04:33 user nova-compute[75083]:       <target dev="vdb" bus="virtio"/>
Nov 29 06:04:33 user nova-compute[75083]:       <boot order="1"/>
Nov 29 06:04:33 user nova-compute[75083]:     </disk>
Nov 29 06:04:33 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:04:33 user nova-compute[75083]:       <mac address="fa:16:3e:e1:f6:16"/>
Nov 29 06:04:33 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:04:33 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:04:33 user nova-compute[75083]:       <target dev="tap1feebf60-26"/>
Nov 29 06:04:33 user nova-compute[75083]:     </interface>
Nov 29 06:04:33 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:04:33 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/fea64bdc-491c-46ba-9447-c175df432deb/console.log" append="off"/>
Nov 29 06:04:33 user nova-compute[75083]:     </serial>
Nov 29 06:04:33 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:04:33 user nova-compute[75083]:     <video>
Nov 29 06:04:33 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:04:33 user nova-compute[75083]:     </video>
Nov 29 06:04:33 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:04:33 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:04:33 user nova-compute[75083]:     </rng>
Nov 29 06:04:33 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:04:33 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:04:33 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:04:33 user nova-compute[75083]:     </memballoon>
Nov 29 06:04:33 user nova-compute[75083]:   </devices>
Nov 29 06:04:33 user nova-compute[75083]: </domain>
Nov 29 06:04:33 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:04:33 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Instance destroyed successfully.
Nov 29 06:04:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] No VIF found with MAC fa:16:3e:e1:f6:16, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:04:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:35 user nova-compute[75083]: DEBUG nova.compute.manager [req-8253daf6-8b9f-4eaf-adea-d4bb1ba2109e req-24c510a3-23d3-400a-a733-d963d8a4ebab service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received event network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:04:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8253daf6-8b9f-4eaf-adea-d4bb1ba2109e req-24c510a3-23d3-400a-a733-d963d8a4ebab service nova] Acquiring lock "fea64bdc-491c-46ba-9447-c175df432deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8253daf6-8b9f-4eaf-adea-d4bb1ba2109e req-24c510a3-23d3-400a-a733-d963d8a4ebab service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8253daf6-8b9f-4eaf-adea-d4bb1ba2109e req-24c510a3-23d3-400a-a733-d963d8a4ebab service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:35 user nova-compute[75083]: DEBUG nova.compute.manager [req-8253daf6-8b9f-4eaf-adea-d4bb1ba2109e req-24c510a3-23d3-400a-a733-d963d8a4ebab service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] No waiting events found dispatching network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:04:35 user nova-compute[75083]: WARNING nova.compute.manager [req-8253daf6-8b9f-4eaf-adea-d4bb1ba2109e req-24c510a3-23d3-400a-a733-d963d8a4ebab service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received unexpected event network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 for instance with vm_state active and task_state rescuing.
Nov 29 06:04:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:37 user nova-compute[75083]: DEBUG nova.compute.manager [req-0629ddcd-b785-4858-aeab-26ceed8de60d req-bd6fd102-121e-4396-8537-543045511528 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received event network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:04:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0629ddcd-b785-4858-aeab-26ceed8de60d req-bd6fd102-121e-4396-8537-543045511528 service nova] Acquiring lock "fea64bdc-491c-46ba-9447-c175df432deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0629ddcd-b785-4858-aeab-26ceed8de60d req-bd6fd102-121e-4396-8537-543045511528 service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0629ddcd-b785-4858-aeab-26ceed8de60d req-bd6fd102-121e-4396-8537-543045511528 service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:37 user nova-compute[75083]: DEBUG nova.compute.manager [req-0629ddcd-b785-4858-aeab-26ceed8de60d req-bd6fd102-121e-4396-8537-543045511528 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] No waiting events found dispatching network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:04:37 user nova-compute[75083]: WARNING nova.compute.manager [req-0629ddcd-b785-4858-aeab-26ceed8de60d req-bd6fd102-121e-4396-8537-543045511528 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received unexpected event network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 for instance with vm_state active and task_state rescuing.
Nov 29 06:04:37 user nova-compute[75083]: DEBUG nova.compute.manager [None req-6768d6c1-b03e-49ef-9afe-7ebe98662a0a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:04:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:04:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:04:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:04:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:04:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG nova.compute.manager [req-d1d6f287-5d4f-45b7-a2fd-143035c9e6ac req-fb0b584d-12ed-48d9-ae14-953417dfe0c5 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-changed-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG nova.compute.manager [req-d1d6f287-5d4f-45b7-a2fd-143035c9e6ac req-fb0b584d-12ed-48d9-ae14-953417dfe0c5 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Refreshing instance network info cache due to event network-changed-f90583fd-5231-46cb-9d2b-3534b01e2587. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d1d6f287-5d4f-45b7-a2fd-143035c9e6ac req-fb0b584d-12ed-48d9-ae14-953417dfe0c5 service nova] Acquiring lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d1d6f287-5d4f-45b7-a2fd-143035c9e6ac req-fb0b584d-12ed-48d9-ae14-953417dfe0c5 service nova] Acquired lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG nova.network.neutron [req-d1d6f287-5d4f-45b7-a2fd-143035c9e6ac req-fb0b584d-12ed-48d9-ae14-953417dfe0c5 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Refreshing network info cache for port f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "f1a6ae72-f187-4558-a164-49c436e886ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG nova.objects.instance [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'flavor' on Instance uuid f1a6ae72-f187-4558-a164-49c436e886ee {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "f1a6ae72-f187-4558-a164-49c436e886ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "f1a6ae72-f187-4558-a164-49c436e886ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:04:49 user nova-compute[75083]: INFO nova.compute.manager [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Attaching volume 04bed82c-c3fa-4f5f-8218-5b22f296642f to /dev/vdb
Nov 29 06:04:49 user nova-compute[75083]: DEBUG os_brick.utils [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG nova.network.neutron [req-d1d6f287-5d4f-45b7-a2fd-143035c9e6ac req-fb0b584d-12ed-48d9-ae14-953417dfe0c5 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Updated VIF entry in instance network info cache for port f90583fd-5231-46cb-9d2b-3534b01e2587. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG nova.network.neutron [req-d1d6f287-5d4f-45b7-a2fd-143035c9e6ac req-fb0b584d-12ed-48d9-ae14-953417dfe0c5 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Updating instance_info_cache with network_info: [{"id": "f90583fd-5231-46cb-9d2b-3534b01e2587", "address": "fa:16:3e:d7:32:34", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90583fd-52", "ovs_interfaceid": "f90583fd-5231-46cb-9d2b-3534b01e2587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[095ffc58-d22e-4b74-a613-686279fc531f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d1d6f287-5d4f-45b7-a2fd-143035c9e6ac req-fb0b584d-12ed-48d9-ae14-953417dfe0c5 service nova] Releasing lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[826158fe-eeb3-4617-9363-e0defa4da9a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c206a55-dd61-4e5f-acd2-255d0be85ae7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1cdf56-9892-4f7f-8350-8b136ae786b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:04:49 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:04:49 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a54d39-79e3-4dc8-bc5a-9ecbf755391b]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG os_brick.utils [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:04:49 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Updating existing volume attachment record: 88f25c39-a160-4ddd-a682-e0abafcf8760 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:04:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrLRFBOk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:04:57 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:04:57 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:04:57 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca2d8dd-7cc5-4509-b9f7-bc0df060dcf9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:04:57 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ab1377-5909-4bef-bc25-56c1b8980ecd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f] added
Nov 29 06:04:57 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04dd889-a400-4856-b1c0-22ac7739f51d]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc90b86-16b9-4b2a-8f6b-57931c5114e3]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MrLRFBOk {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MrLRFBOk" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3d3e20-97af-40a1-9ea5-0040a3578bee]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MrLRFBOk'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa68ee5c-d760-4bdd-a6a8-d5dfa23ba5ca]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6f6243-9627-410d-949b-7b00c454e79d]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:04:57 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:04:57 user nova-compute[75083]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)
Nov 29 06:04:57 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:04:57 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:04:57 user nova-compute[75083]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)
Nov 29 06:04:57 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8721570e-fac1-479e-a479-558ff5e4ea8f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f, portal: 172.16.0.220,3260]
Nov 29 06:04:57 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f, portal: 172.16.0.220,3260] successful.
Nov 29 06:04:57 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6b6aa6-1857-4770-b7c8-1650f633b063]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7955f7-4d8e-4c4e-9824-e903abf58006]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:04:57 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:04:57 user nova-compute[75083]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)
Nov 29 06:04:57 user nova-compute[75083]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)
Nov 29 06:04:57 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:04:57 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:04:57 user nova-compute[75083]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)
Nov 29 06:04:57 user nova-compute[75083]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)
Nov 29 06:04:57 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1789ecb-074d-4a3c-8f73-26601bccbd7c]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:04:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrLRFBOk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:04:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:04:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26235373132396333', 'path': '/dev/sdc'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:04:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235373132396333', 'path': '/dev/sdc'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:04:58 user nova-compute[75083]: DEBUG nova.objects.instance [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'flavor' on Instance uuid f1a6ae72-f187-4558-a164-49c436e886ee {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:04:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 06:04:58 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:04:58 user nova-compute[75083]:   <source dev="/dev/sdc"/>
Nov 29 06:04:58 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:04:58 user nova-compute[75083]:   <serial>04bed82c-c3fa-4f5f-8218-5b22f296642f</serial>
Nov 29 06:04:58 user nova-compute[75083]: </disk>
Nov 29 06:04:58 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 06:04:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:04:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:04:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:04:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] No VIF found with MAC fa:16:3e:d7:32:34, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:04:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-eddefceb-9f0c-4aff-8412-2485bfacd981 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "f1a6ae72-f187-4558-a164-49c436e886ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.492s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:04:59 user nova-compute[75083]: INFO nova.compute.manager [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Rescuing
Nov 29 06:04:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:04:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquired lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:04:59 user nova-compute[75083]: DEBUG nova.network.neutron [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:04:59 user nova-compute[75083]: DEBUG nova.network.neutron [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Updating instance_info_cache with network_info: [{"id": "f90583fd-5231-46cb-9d2b-3534b01e2587", "address": "fa:16:3e:d7:32:34", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90583fd-52", "ovs_interfaceid": "f90583fd-5231-46cb-9d2b-3534b01e2587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:04:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Releasing lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG nova.compute.manager [req-cf40ebb3-b3bf-40b9-9f36-141592cc90e7 req-2e516643-c42f-4aec-9bb9-44302513e31f service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-vif-unplugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-cf40ebb3-b3bf-40b9-9f36-141592cc90e7 req-2e516643-c42f-4aec-9bb9-44302513e31f service nova] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-cf40ebb3-b3bf-40b9-9f36-141592cc90e7 req-2e516643-c42f-4aec-9bb9-44302513e31f service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-cf40ebb3-b3bf-40b9-9f36-141592cc90e7 req-2e516643-c42f-4aec-9bb9-44302513e31f service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG nova.compute.manager [req-cf40ebb3-b3bf-40b9-9f36-141592cc90e7 req-2e516643-c42f-4aec-9bb9-44302513e31f service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] No waiting events found dispatching network-vif-unplugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:05:00 user nova-compute[75083]: WARNING nova.compute.manager [req-cf40ebb3-b3bf-40b9-9f36-141592cc90e7 req-2e516643-c42f-4aec-9bb9-44302513e31f service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received unexpected event network-vif-unplugged-f90583fd-5231-46cb-9d2b-3534b01e2587 for instance with vm_state active and task_state rescuing.
Nov 29 06:05:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:00 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Instance destroyed successfully.
Nov 29 06:05:00 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Attempting rescue
Nov 29 06:05:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75083) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Instance directory exists: not creating {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 06:05:00 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Creating image(s)
Nov 29 06:05:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "/opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "/opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG nova.objects.instance [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'trusted_certs' on Instance uuid f1a6ae72-f187-4558-a164-49c436e886ee {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk.rescue {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk.rescue" returned: 0 in 0.060s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.objects.instance [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'migration_context' on Instance uuid f1a6ae72-f187-4558-a164-49c436e886ee {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.objects.base [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Object Instance<f1a6ae72-f187-4558-a164-49c436e886ee> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Start _get_guest_xml network_info=[{"id": "f90583fd-5231-46cb-9d2b-3534b01e2587", "address": "fa:16:3e:d7:32:34", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "vif_mac": "fa:16:3e:d7:32:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90583fd-52", "ovs_interfaceid": "f90583fd-5231-46cb-9d2b-3534b01e2587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.objects.instance [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'resources' on Instance uuid f1a6ae72-f187-4558-a164-49c436e886ee {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.objects.base [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Object Instance<f1a6ae72-f187-4558-a164-49c436e886ee> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.objects.instance [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'numa_topology' on Instance uuid f1a6ae72-f187-4558-a164-49c436e886ee {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.objects.base [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Object Instance<f1a6ae72-f187-4558-a164-49c436e886ee> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 06:05:01 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:05:01 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.objects.instance [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'vcpu_model' on Instance uuid f1a6ae72-f187-4558-a164-49c436e886ee {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.objects.base [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Object Instance<f1a6ae72-f187-4558-a164-49c436e886ee> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1004260723',display_name='tempest-ServerRescueNegativeTestJSON-server-1004260723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1004260723',id=34,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIhawOI/53gDum6SY/PSBpY177FAm4dnAbqg4VEZ3EN5udabCTgS3EuhA8Jx9UUHk6GbAtzw7fXtXVsV8VdTHnHKPMSFfkdXUrGjyeJxMAlBjUpmABKze7F5aFFl/ySwg==',key_name='tempest-keypair-92795995',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:03:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7833259e5df546ba86139af68fcb7906',ramdisk_id='',reservation_id='r-yc7x8yds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1120078925',owner_user_name='tempest-ServerRescueNegativeTestJSON-1120078925-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:03:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb74d3aef4664ff8bdec4110c6867056',uuid=f1a6ae72-f187-4558-a164-49c436e886ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f90583fd-5231-46cb-9d2b-3534b01e2587", "address": "fa:16:3e:d7:32:34", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "vif_mac": "fa:16:3e:d7:32:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90583fd-52", "ovs_interfaceid": "f90583fd-5231-46cb-9d2b-3534b01e2587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converting VIF {"id": "f90583fd-5231-46cb-9d2b-3534b01e2587", "address": "fa:16:3e:d7:32:34", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "vif_mac": "fa:16:3e:d7:32:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90583fd-52", "ovs_interfaceid": "f90583fd-5231-46cb-9d2b-3534b01e2587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:32:34,bridge_name='br-int',has_traffic_filtering=True,id=f90583fd-5231-46cb-9d2b-3534b01e2587,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90583fd-52') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.objects.instance [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'pci_devices' on Instance uuid f1a6ae72-f187-4558-a164-49c436e886ee {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.objects.base [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Object Instance<f1a6ae72-f187-4558-a164-49c436e886ee> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:05:01 user nova-compute[75083]:   <uuid>f1a6ae72-f187-4558-a164-49c436e886ee</uuid>
Nov 29 06:05:01 user nova-compute[75083]:   <name>instance-00000022</name>
Nov 29 06:05:01 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:05:01 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:05:01 user nova-compute[75083]:   <metadata>
Nov 29 06:05:01 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:05:01 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:05:01 user nova-compute[75083]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1004260723</nova:name>
Nov 29 06:05:01 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:05:01</nova:creationTime>
Nov 29 06:05:01 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:05:01 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:05:01 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:05:01 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:05:01 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:05:01 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:05:01 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:05:01 user nova-compute[75083]:       <nova:owner>
Nov 29 06:05:01 user nova-compute[75083]:         <nova:user uuid="eb74d3aef4664ff8bdec4110c6867056">tempest-ServerRescueNegativeTestJSON-1120078925-project-member</nova:user>
Nov 29 06:05:01 user nova-compute[75083]:         <nova:project uuid="7833259e5df546ba86139af68fcb7906">tempest-ServerRescueNegativeTestJSON-1120078925</nova:project>
Nov 29 06:05:01 user nova-compute[75083]:       </nova:owner>
Nov 29 06:05:01 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 06:05:01 user nova-compute[75083]:       <nova:ports>
Nov 29 06:05:01 user nova-compute[75083]:         <nova:port uuid="f90583fd-5231-46cb-9d2b-3534b01e2587">
Nov 29 06:05:01 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 06:05:01 user nova-compute[75083]:         </nova:port>
Nov 29 06:05:01 user nova-compute[75083]:       </nova:ports>
Nov 29 06:05:01 user nova-compute[75083]:     </nova:instance>
Nov 29 06:05:01 user nova-compute[75083]:   </metadata>
Nov 29 06:05:01 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:05:01 user nova-compute[75083]:     <system>
Nov 29 06:05:01 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:05:01 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:05:01 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:05:01 user nova-compute[75083]:       <entry name="serial">f1a6ae72-f187-4558-a164-49c436e886ee</entry>
Nov 29 06:05:01 user nova-compute[75083]:       <entry name="uuid">f1a6ae72-f187-4558-a164-49c436e886ee</entry>
Nov 29 06:05:01 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:05:01 user nova-compute[75083]:     </system>
Nov 29 06:05:01 user nova-compute[75083]:   </sysinfo>
Nov 29 06:05:01 user nova-compute[75083]:   <os>
Nov 29 06:05:01 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:05:01 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:05:01 user nova-compute[75083]:   </os>
Nov 29 06:05:01 user nova-compute[75083]:   <features>
Nov 29 06:05:01 user nova-compute[75083]:     <acpi/>
Nov 29 06:05:01 user nova-compute[75083]:     <apic/>
Nov 29 06:05:01 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:05:01 user nova-compute[75083]:   </features>
Nov 29 06:05:01 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:05:01 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:05:01 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:05:01 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:05:01 user nova-compute[75083]:   </clock>
Nov 29 06:05:01 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:05:01 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:05:01 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:05:01 user nova-compute[75083]:   </cpu>
Nov 29 06:05:01 user nova-compute[75083]:   <devices>
Nov 29 06:05:01 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:05:01 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:05:01 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk.rescue"/>
Nov 29 06:05:01 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:05:01 user nova-compute[75083]:     </disk>
Nov 29 06:05:01 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:05:01 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:05:01 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk"/>
Nov 29 06:05:01 user nova-compute[75083]:       <target dev="vdb" bus="virtio"/>
Nov 29 06:05:01 user nova-compute[75083]:     </disk>
Nov 29 06:05:01 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:05:01 user nova-compute[75083]:       <mac address="fa:16:3e:d7:32:34"/>
Nov 29 06:05:01 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:05:01 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:05:01 user nova-compute[75083]:       <target dev="tapf90583fd-52"/>
Nov 29 06:05:01 user nova-compute[75083]:     </interface>
Nov 29 06:05:01 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:05:01 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/console.log" append="off"/>
Nov 29 06:05:01 user nova-compute[75083]:     </serial>
Nov 29 06:05:01 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:05:01 user nova-compute[75083]:     <video>
Nov 29 06:05:01 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:05:01 user nova-compute[75083]:     </video>
Nov 29 06:05:01 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:05:01 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:05:01 user nova-compute[75083]:     </rng>
Nov 29 06:05:01 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:05:01 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:05:01 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:05:01 user nova-compute[75083]:     </memballoon>
Nov 29 06:05:01 user nova-compute[75083]:   </devices>
Nov 29 06:05:01 user nova-compute[75083]: </domain>
Nov 29 06:05:01 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:01 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Instance destroyed successfully.
Nov 29 06:05:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:05:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] No VIF found with MAC fa:16:3e:d7:32:34, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG nova.compute.manager [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG nova.compute.manager [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] No waiting events found dispatching network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:05:02 user nova-compute[75083]: WARNING nova.compute.manager [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received unexpected event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 for instance with vm_state active and task_state rescuing.
Nov 29 06:05:02 user nova-compute[75083]: DEBUG nova.compute.manager [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG nova.compute.manager [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] No waiting events found dispatching network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:05:02 user nova-compute[75083]: WARNING nova.compute.manager [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received unexpected event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 for instance with vm_state active and task_state rescuing.
Nov 29 06:05:02 user nova-compute[75083]: DEBUG nova.compute.manager [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG nova.compute.manager [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] No waiting events found dispatching network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:05:02 user nova-compute[75083]: WARNING nova.compute.manager [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received unexpected event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 for instance with vm_state active and task_state rescuing.
Nov 29 06:05:02 user nova-compute[75083]: DEBUG nova.compute.manager [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-vif-unplugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG nova.compute.manager [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] No waiting events found dispatching network-vif-unplugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:05:02 user nova-compute[75083]: WARNING nova.compute.manager [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received unexpected event network-vif-unplugged-f90583fd-5231-46cb-9d2b-3534b01e2587 for instance with vm_state active and task_state rescuing.
Nov 29 06:05:02 user nova-compute[75083]: DEBUG nova.compute.manager [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG nova.compute.manager [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] No waiting events found dispatching network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:05:02 user nova-compute[75083]: WARNING nova.compute.manager [req-534a827a-42a0-4d96-afef-6f6acc8dbfe4 req-d6a4d8b0-7ab4-47f8-92b3-e529e85a30ae service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received unexpected event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 for instance with vm_state active and task_state rescuing.
Nov 29 06:05:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Acquiring lock "05f45fef-c8a7-41c1-a571-863307caca6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "05f45fef-c8a7-41c1-a571-863307caca6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Acquiring lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:03 user nova-compute[75083]: INFO nova.compute.manager [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Terminating instance
Nov 29 06:05:03 user nova-compute[75083]: DEBUG nova.compute.manager [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:05:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-c23988fd-4cb5-429e-aa06-5e067cb49409 req-95829929-eb45-4b68-b2c6-02624ee4bf28 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Received event network-vif-unplugged-27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c23988fd-4cb5-429e-aa06-5e067cb49409 req-95829929-eb45-4b68-b2c6-02624ee4bf28 service nova] Acquiring lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c23988fd-4cb5-429e-aa06-5e067cb49409 req-95829929-eb45-4b68-b2c6-02624ee4bf28 service nova] Lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c23988fd-4cb5-429e-aa06-5e067cb49409 req-95829929-eb45-4b68-b2c6-02624ee4bf28 service nova] Lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-c23988fd-4cb5-429e-aa06-5e067cb49409 req-95829929-eb45-4b68-b2c6-02624ee4bf28 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] No waiting events found dispatching network-vif-unplugged-27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-c23988fd-4cb5-429e-aa06-5e067cb49409 req-95829929-eb45-4b68-b2c6-02624ee4bf28 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Received event network-vif-unplugged-27a46712-1675-4c3d-83bd-9131f899b487 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-9a167029-ebc0-4b74-bbe9-a6c042163f2d req-2884cec5-0000-49ac-9a8c-f1d4be2d0d92 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9a167029-ebc0-4b74-bbe9-a6c042163f2d req-2884cec5-0000-49ac-9a8c-f1d4be2d0d92 service nova] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9a167029-ebc0-4b74-bbe9-a6c042163f2d req-2884cec5-0000-49ac-9a8c-f1d4be2d0d92 service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9a167029-ebc0-4b74-bbe9-a6c042163f2d req-2884cec5-0000-49ac-9a8c-f1d4be2d0d92 service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-9a167029-ebc0-4b74-bbe9-a6c042163f2d req-2884cec5-0000-49ac-9a8c-f1d4be2d0d92 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] No waiting events found dispatching network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:05:04 user nova-compute[75083]: WARNING nova.compute.manager [req-9a167029-ebc0-4b74-bbe9-a6c042163f2d req-2884cec5-0000-49ac-9a8c-f1d4be2d0d92 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received unexpected event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 for instance with vm_state active and task_state rescuing.
Nov 29 06:05:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-9a167029-ebc0-4b74-bbe9-a6c042163f2d req-2884cec5-0000-49ac-9a8c-f1d4be2d0d92 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9a167029-ebc0-4b74-bbe9-a6c042163f2d req-2884cec5-0000-49ac-9a8c-f1d4be2d0d92 service nova] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9a167029-ebc0-4b74-bbe9-a6c042163f2d req-2884cec5-0000-49ac-9a8c-f1d4be2d0d92 service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9a167029-ebc0-4b74-bbe9-a6c042163f2d req-2884cec5-0000-49ac-9a8c-f1d4be2d0d92 service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG nova.compute.manager [req-9a167029-ebc0-4b74-bbe9-a6c042163f2d req-2884cec5-0000-49ac-9a8c-f1d4be2d0d92 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] No waiting events found dispatching network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:05:04 user nova-compute[75083]: WARNING nova.compute.manager [req-9a167029-ebc0-4b74-bbe9-a6c042163f2d req-2884cec5-0000-49ac-9a8c-f1d4be2d0d92 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received unexpected event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 for instance with vm_state active and task_state rescuing.
Nov 29 06:05:04 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Instance destroyed successfully.
Nov 29 06:05:04 user nova-compute[75083]: DEBUG nova.objects.instance [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lazy-loading 'resources' on Instance uuid 05f45fef-c8a7-41c1-a571-863307caca6a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1394586748',display_name='tempest-ServersNegativeTestJSON-server-1394586748',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1394586748',id=24,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:56:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b42598c48c05439f8059b4b8bf30b9dd',ramdisk_id='',reservation_id='r-oz1j06l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1931576508',owner_user_name='tempest-ServersNegativeTestJSON-1931576508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:56:25Z,user_data=None,user_id='1e3cf798ed354d3ba55c0ff609e22d7f',uuid=05f45fef-c8a7-41c1-a571-863307caca6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27a46712-1675-4c3d-83bd-9131f899b487", "address": "fa:16:3e:a8:58:c9", "network": {"id": "f41035e0-21bb-472a-959b-099a854e4629", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-994952120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b42598c48c05439f8059b4b8bf30b9dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a46712-16", "ovs_interfaceid": "27a46712-1675-4c3d-83bd-9131f899b487", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Converting VIF {"id": "27a46712-1675-4c3d-83bd-9131f899b487", "address": "fa:16:3e:a8:58:c9", "network": {"id": "f41035e0-21bb-472a-959b-099a854e4629", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-994952120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b42598c48c05439f8059b4b8bf30b9dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a46712-16", "ovs_interfaceid": "27a46712-1675-4c3d-83bd-9131f899b487", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:58:c9,bridge_name='br-int',has_traffic_filtering=True,id=27a46712-1675-4c3d-83bd-9131f899b487,network=Network(f41035e0-21bb-472a-959b-099a854e4629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a46712-16') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG os_vif [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:58:c9,bridge_name='br-int',has_traffic_filtering=True,id=27a46712-1675-4c3d-83bd-9131f899b487,network=Network(f41035e0-21bb-472a-959b-099a854e4629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a46712-16') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27a46712-16, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c6dae8f-dbf1-4ba8-ae9f-34cb3a273f2f) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:04 user nova-compute[75083]: INFO os_vif [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:58:c9,bridge_name='br-int',has_traffic_filtering=True,id=27a46712-1675-4c3d-83bd-9131f899b487,network=Network(f41035e0-21bb-472a-959b-099a854e4629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a46712-16')
Nov 29 06:05:04 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Deleting instance files /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a_del
Nov 29 06:05:04 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Deletion of /opt/stack/data/nova/instances/05f45fef-c8a7-41c1-a571-863307caca6a_del complete
Nov 29 06:05:04 user nova-compute[75083]: INFO nova.compute.manager [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 29 06:05:04 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:05:04 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:05:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:05 user nova-compute[75083]: DEBUG nova.compute.manager [None req-a1810b3c-76d0-49c9-a3b4-46365b03a553 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:05:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:05 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:05:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:05 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Took 0.55 seconds to deallocate network for instance.
Nov 29 06:05:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:05 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:05:05 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:05:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:05 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Deleted allocations for instance 05f45fef-c8a7-41c1-a571-863307caca6a
Nov 29 06:05:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-020870f4-197e-4872-8d2c-d924930e897c tempest-ServersNegativeTestJSON-1931576508 tempest-ServersNegativeTestJSON-1931576508-project-member] Lock "05f45fef-c8a7-41c1-a571-863307caca6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.893s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Received event network-vif-plugged-27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] Acquiring lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] Lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] Lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] No waiting events found dispatching network-vif-plugged-27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:05:06 user nova-compute[75083]: WARNING nova.compute.manager [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Received unexpected event network-vif-plugged-27a46712-1675-4c3d-83bd-9131f899b487 for instance with vm_state deleted and task_state None.
Nov 29 06:05:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Received event network-vif-plugged-27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] Acquiring lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] Lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] Lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] No waiting events found dispatching network-vif-plugged-27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:05:06 user nova-compute[75083]: WARNING nova.compute.manager [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Received unexpected event network-vif-plugged-27a46712-1675-4c3d-83bd-9131f899b487 for instance with vm_state deleted and task_state None.
Nov 29 06:05:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Received event network-vif-plugged-27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] Acquiring lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] Lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] Lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] No waiting events found dispatching network-vif-plugged-27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:05:06 user nova-compute[75083]: WARNING nova.compute.manager [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Received unexpected event network-vif-plugged-27a46712-1675-4c3d-83bd-9131f899b487 for instance with vm_state deleted and task_state None.
Nov 29 06:05:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Received event network-vif-unplugged-27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] Acquiring lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] Lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] Lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] No waiting events found dispatching network-vif-unplugged-27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:05:06 user nova-compute[75083]: WARNING nova.compute.manager [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Received unexpected event network-vif-unplugged-27a46712-1675-4c3d-83bd-9131f899b487 for instance with vm_state deleted and task_state None.
Nov 29 06:05:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Received event network-vif-plugged-27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] Acquiring lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] Lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] Lock "05f45fef-c8a7-41c1-a571-863307caca6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] No waiting events found dispatching network-vif-plugged-27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:05:06 user nova-compute[75083]: WARNING nova.compute.manager [req-deee4c70-18f9-4882-a51a-b884c1d02314 req-3514c0f5-7257-400f-917f-5c3d2df7e338 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Received unexpected event network-vif-plugged-27a46712-1675-4c3d-83bd-9131f899b487 for instance with vm_state deleted and task_state None.
Nov 29 06:05:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-c63227c5-d46c-4195-874d-85f8316e07c4 req-4ceb18d2-d136-4ee8-ac4b-f50334491f25 service nova] [instance: 05f45fef-c8a7-41c1-a571-863307caca6a] Received event network-vif-deleted-27a46712-1675-4c3d-83bd-9131f899b487 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:07 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:05:08 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:05:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:10 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:05:10 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:05:10 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:05:13 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:05:13 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:05:13 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:05:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:13 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:05:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:05:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:05:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea64bdc-491c-46ba-9447-c175df432deb/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea64bdc-491c-46ba-9447-c175df432deb/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea64bdc-491c-46ba-9447-c175df432deb/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea64bdc-491c-46ba-9447-c175df432deb/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:05:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:05:17 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:05:17 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:05:17 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=7914MB free_disk=25.032127380371094GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:05:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 161c6455-90ce-4c40-a33e-7f582989135d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:05:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4435ed78-e35f-4859-8a4f-9920815d968a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:05:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a34d9d98-be73-4d52-85f0-83e48f60bc12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:05:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:05:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a6e1c2d7-1181-4d9f-99eb-d401d5f73b25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:05:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 733f9905-c483-4835-8ec9-953b341950d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:05:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fea64bdc-491c-46ba-9447-c175df432deb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:05:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance f1a6ae72-f187-4558-a164-49c436e886ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:05:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:05:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:05:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:18 user nova-compute[75083]: INFO nova.compute.manager [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Detaching volume 67ce4130-2536-4b45-8b5e-e4c94ad16542
Nov 29 06:05:18 user nova-compute[75083]: INFO nova.virt.block_device [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Attempting to driver detach volume 67ce4130-2536-4b45-8b5e-e4c94ad16542 from mountpoint /dev/vdb
Nov 29 06:05:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Attempting to detach device vdb from instance a6e1c2d7-1181-4d9f-99eb-d401d5f73b25 from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 06:05:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:05:18 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:05:18 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:05:18 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:05:18 user nova-compute[75083]:   <serial>67ce4130-2536-4b45-8b5e-e4c94ad16542</serial>
Nov 29 06:05:18 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:05:18 user nova-compute[75083]: </disk>
Nov 29 06:05:18 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:05:18 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Successfully detached device vdb from instance a6e1c2d7-1181-4d9f-99eb-d401d5f73b25 from the persistent domain config.
Nov 29 06:05:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6e1c2d7-1181-4d9f-99eb-d401d5f73b25 from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 06:05:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:05:18 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:05:18 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:05:18 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:05:18 user nova-compute[75083]:   <serial>67ce4130-2536-4b45-8b5e-e4c94ad16542</serial>
Nov 29 06:05:18 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:05:18 user nova-compute[75083]: </disk>
Nov 29 06:05:18 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:05:18 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:05:18 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:05:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:05:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.870s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6e1c2d7-1181-4d9f-99eb-d401d5f73b25 {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 06:05:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "161c6455-90ce-4c40-a33e-7f582989135d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "161c6455-90ce-4c40-a33e-7f582989135d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "161c6455-90ce-4c40-a33e-7f582989135d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "161c6455-90ce-4c40-a33e-7f582989135d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "161c6455-90ce-4c40-a33e-7f582989135d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:20 user nova-compute[75083]: INFO nova.compute.manager [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Terminating instance
Nov 29 06:05:20 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:05:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG nova.compute.manager [req-da5f41e4-0a8b-4984-8475-49225aa1df57 req-40ccffae-c815-472b-9549-3eaded13f237 service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Received event network-vif-unplugged-188d4866-21b0-4a1e-a17a-c0c82e849726 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-da5f41e4-0a8b-4984-8475-49225aa1df57 req-40ccffae-c815-472b-9549-3eaded13f237 service nova] Acquiring lock "161c6455-90ce-4c40-a33e-7f582989135d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-da5f41e4-0a8b-4984-8475-49225aa1df57 req-40ccffae-c815-472b-9549-3eaded13f237 service nova] Lock "161c6455-90ce-4c40-a33e-7f582989135d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-da5f41e4-0a8b-4984-8475-49225aa1df57 req-40ccffae-c815-472b-9549-3eaded13f237 service nova] Lock "161c6455-90ce-4c40-a33e-7f582989135d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG nova.compute.manager [req-da5f41e4-0a8b-4984-8475-49225aa1df57 req-40ccffae-c815-472b-9549-3eaded13f237 service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] No waiting events found dispatching network-vif-unplugged-188d4866-21b0-4a1e-a17a-c0c82e849726 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG nova.compute.manager [req-da5f41e4-0a8b-4984-8475-49225aa1df57 req-40ccffae-c815-472b-9549-3eaded13f237 service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Received event network-vif-unplugged-188d4866-21b0-4a1e-a17a-c0c82e849726 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Skipping network cache update for instance because it is being deleted. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 29 06:05:21 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Instance destroyed successfully.
Nov 29 06:05:21 user nova-compute[75083]: DEBUG nova.objects.instance [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lazy-loading 'resources' on Instance uuid 161c6455-90ce-4c40-a33e-7f582989135d {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-192619014',display_name='tempest-ServerActionsTestOtherA-server-192619014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-192619014',id=5,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/QARryHVy9tL0HspVgAb5d+hXfz/yMgw4/juPCBWiK9jONO+/KTLCL7Bj2On8DfV4bHN063zv9H1zJ2YV2YRCRWmcFlsfDLpgZRojBg+ehebykt/upaC2Fb+0QP3Sb0w==',key_name='tempest-keypair-908590560',keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:46:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95d0f3dd09bf436498e67d7bfdd904bf',ramdisk_id='',reservation_id='r-bv7tcywi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2114836332',owner_user_name='tempest-ServerActionsTestOtherA-2114836332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:46:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbd7f863ad7c4229957c4b08601b5003',uuid=161c6455-90ce-4c40-a33e-7f582989135d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "188d4866-21b0-4a1e-a17a-c0c82e849726", "address": "fa:16:3e:a8:14:4a", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d4866-21", "ovs_interfaceid": "188d4866-21b0-4a1e-a17a-c0c82e849726", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converting VIF {"id": "188d4866-21b0-4a1e-a17a-c0c82e849726", "address": "fa:16:3e:a8:14:4a", "network": {"id": "4ad21aa4-3184-49a1-9522-317ef1778342", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1824387480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d0f3dd09bf436498e67d7bfdd904bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d4866-21", "ovs_interfaceid": "188d4866-21b0-4a1e-a17a-c0c82e849726", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:14:4a,bridge_name='br-int',has_traffic_filtering=True,id=188d4866-21b0-4a1e-a17a-c0c82e849726,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap188d4866-21') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG os_vif [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:14:4a,bridge_name='br-int',has_traffic_filtering=True,id=188d4866-21b0-4a1e-a17a-c0c82e849726,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap188d4866-21') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap188d4866-21, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8297b02-c757-4f2b-b982-88d316955d2d) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:21 user nova-compute[75083]: INFO os_vif [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:14:4a,bridge_name='br-int',has_traffic_filtering=True,id=188d4866-21b0-4a1e-a17a-c0c82e849726,network=Network(4ad21aa4-3184-49a1-9522-317ef1778342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap188d4866-21')
Nov 29 06:05:21 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Deleting instance files /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d_del
Nov 29 06:05:21 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Deletion of /opt/stack/data/nova/instances/161c6455-90ce-4c40-a33e-7f582989135d_del complete
Nov 29 06:05:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lazy-loading 'info_cache' on Instance uuid 4435ed78-e35f-4859-8a4f-9920815d968a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:05:21 user nova-compute[75083]: INFO nova.compute.manager [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 29 06:05:21 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:05:21 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:05:22 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:05:22 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Took 0.50 seconds to deallocate network for instance.
Nov 29 06:05:22 user nova-compute[75083]: DEBUG nova.compute.manager [req-1ea837d1-4c4d-4344-b680-8f8a7c208142 req-5e0d8fa1-601e-46c4-98b4-2d485d2d4ec1 service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Received event network-vif-deleted-188d4866-21b0-4a1e-a17a-c0c82e849726 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:22 user nova-compute[75083]: INFO nova.compute.manager [req-1ea837d1-4c4d-4344-b680-8f8a7c208142 req-5e0d8fa1-601e-46c4-98b4-2d485d2d4ec1 service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Neutron deleted interface 188d4866-21b0-4a1e-a17a-c0c82e849726; detaching it from the instance and deleting it from the info cache
Nov 29 06:05:22 user nova-compute[75083]: DEBUG nova.network.neutron [req-1ea837d1-4c4d-4344-b680-8f8a7c208142 req-5e0d8fa1-601e-46c4-98b4-2d485d2d4ec1 service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:05:22 user nova-compute[75083]: DEBUG nova.compute.manager [req-1ea837d1-4c4d-4344-b680-8f8a7c208142 req-5e0d8fa1-601e-46c4-98b4-2d485d2d4ec1 service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Detach interface failed, port_id=188d4866-21b0-4a1e-a17a-c0c82e849726, reason: Instance 161c6455-90ce-4c40-a33e-7f582989135d could not be found. {{(pid=75083) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 06:05:22 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Updating instance_info_cache with network_info: [{"id": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "address": "fa:16:3e:8d:3b:2a", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f259ece-bc", "ovs_interfaceid": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:05:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:05:22 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:05:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:22 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:05:22 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:05:22 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:05:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:22 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Deleted allocations for instance 161c6455-90ce-4c40-a33e-7f582989135d
Nov 29 06:05:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d51f27c5-3481-438d-b04f-5479221a7768 tempest-ServerActionsTestOtherA-2114836332 tempest-ServerActionsTestOtherA-2114836332-project-member] Lock "161c6455-90ce-4c40-a33e-7f582989135d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.667s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-ac10dbe3-04c6-429c-8e66-acef4d1a8a58 req-33a7d618-bcb5-486e-8f91-eede2d080ab7 service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Received event network-vif-plugged-188d4866-21b0-4a1e-a17a-c0c82e849726 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ac10dbe3-04c6-429c-8e66-acef4d1a8a58 req-33a7d618-bcb5-486e-8f91-eede2d080ab7 service nova] Acquiring lock "161c6455-90ce-4c40-a33e-7f582989135d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ac10dbe3-04c6-429c-8e66-acef4d1a8a58 req-33a7d618-bcb5-486e-8f91-eede2d080ab7 service nova] Lock "161c6455-90ce-4c40-a33e-7f582989135d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ac10dbe3-04c6-429c-8e66-acef4d1a8a58 req-33a7d618-bcb5-486e-8f91-eede2d080ab7 service nova] Lock "161c6455-90ce-4c40-a33e-7f582989135d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-ac10dbe3-04c6-429c-8e66-acef4d1a8a58 req-33a7d618-bcb5-486e-8f91-eede2d080ab7 service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] No waiting events found dispatching network-vif-plugged-188d4866-21b0-4a1e-a17a-c0c82e849726 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:05:23 user nova-compute[75083]: WARNING nova.compute.manager [req-ac10dbe3-04c6-429c-8e66-acef4d1a8a58 req-33a7d618-bcb5-486e-8f91-eede2d080ab7 service nova] [instance: 161c6455-90ce-4c40-a33e-7f582989135d] Received unexpected event network-vif-plugged-188d4866-21b0-4a1e-a17a-c0c82e849726 for instance with vm_state deleted and task_state None.
Nov 29 06:05:24 user nova-compute[75083]: DEBUG nova.compute.manager [req-fcabbd53-39ca-4dc6-953d-086a030fae68 req-54aaefed-1f87-4ba8-b467-dab940e4dddd service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received event network-changed-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:24 user nova-compute[75083]: DEBUG nova.compute.manager [req-fcabbd53-39ca-4dc6-953d-086a030fae68 req-54aaefed-1f87-4ba8-b467-dab940e4dddd service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Refreshing instance network info cache due to event network-changed-b3126cae-fa19-4a34-b87a-5e97ca70770b. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:05:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fcabbd53-39ca-4dc6-953d-086a030fae68 req-54aaefed-1f87-4ba8-b467-dab940e4dddd service nova] Acquiring lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:05:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fcabbd53-39ca-4dc6-953d-086a030fae68 req-54aaefed-1f87-4ba8-b467-dab940e4dddd service nova] Acquired lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:05:24 user nova-compute[75083]: DEBUG nova.network.neutron [req-fcabbd53-39ca-4dc6-953d-086a030fae68 req-54aaefed-1f87-4ba8-b467-dab940e4dddd service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Refreshing network info cache for port b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:05:25 user nova-compute[75083]: DEBUG nova.network.neutron [req-fcabbd53-39ca-4dc6-953d-086a030fae68 req-54aaefed-1f87-4ba8-b467-dab940e4dddd service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Updated VIF entry in instance network info cache for port b3126cae-fa19-4a34-b87a-5e97ca70770b. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:05:25 user nova-compute[75083]: DEBUG nova.network.neutron [req-fcabbd53-39ca-4dc6-953d-086a030fae68 req-54aaefed-1f87-4ba8-b467-dab940e4dddd service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Updating instance_info_cache with network_info: [{"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:05:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fcabbd53-39ca-4dc6-953d-086a030fae68 req-54aaefed-1f87-4ba8-b467-dab940e4dddd service nova] Releasing lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:05:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "733f9905-c483-4835-8ec9-953b341950d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "733f9905-c483-4835-8ec9-953b341950d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:25 user nova-compute[75083]: INFO nova.compute.manager [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Detaching volume 00976084-3048-4cfe-871e-771d12c8e40f
Nov 29 06:05:25 user nova-compute[75083]: INFO nova.virt.block_device [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Attempting to driver detach volume 00976084-3048-4cfe-871e-771d12c8e40f from mountpoint /dev/vdb
Nov 29 06:05:25 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Attempting to detach device vdb from instance 733f9905-c483-4835-8ec9-953b341950d1 from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 06:05:25 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:05:25 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:05:25 user nova-compute[75083]:   <source dev="/dev/sde"/>
Nov 29 06:05:25 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:05:25 user nova-compute[75083]:   <serial>00976084-3048-4cfe-871e-771d12c8e40f</serial>
Nov 29 06:05:25 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 06:05:25 user nova-compute[75083]: </disk>
Nov 29 06:05:25 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:05:25 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Successfully detached device vdb from instance 733f9905-c483-4835-8ec9-953b341950d1 from the persistent domain config.
Nov 29 06:05:25 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 733f9905-c483-4835-8ec9-953b341950d1 from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 06:05:25 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:05:25 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:05:25 user nova-compute[75083]:   <source dev="/dev/sde"/>
Nov 29 06:05:25 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:05:25 user nova-compute[75083]:   <serial>00976084-3048-4cfe-871e-771d12c8e40f</serial>
Nov 29 06:05:25 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 06:05:25 user nova-compute[75083]: </disk>
Nov 29 06:05:25 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:05:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 733f9905-c483-4835-8ec9-953b341950d1 {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 06:05:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-34cc3715-7407-48d2-8c19-ee52531ac83f req-e10abbd0-5309-485a-84c9-762f687f9d42 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received event network-changed-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-34cc3715-7407-48d2-8c19-ee52531ac83f req-e10abbd0-5309-485a-84c9-762f687f9d42 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Refreshing instance network info cache due to event network-changed-b3126cae-fa19-4a34-b87a-5e97ca70770b. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:05:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-34cc3715-7407-48d2-8c19-ee52531ac83f req-e10abbd0-5309-485a-84c9-762f687f9d42 service nova] Acquiring lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:05:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-34cc3715-7407-48d2-8c19-ee52531ac83f req-e10abbd0-5309-485a-84c9-762f687f9d42 service nova] Acquired lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:05:26 user nova-compute[75083]: DEBUG nova.network.neutron [req-34cc3715-7407-48d2-8c19-ee52531ac83f req-e10abbd0-5309-485a-84c9-762f687f9d42 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Refreshing network info cache for port b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:05:27 user nova-compute[75083]: DEBUG nova.network.neutron [req-34cc3715-7407-48d2-8c19-ee52531ac83f req-e10abbd0-5309-485a-84c9-762f687f9d42 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Updated VIF entry in instance network info cache for port b3126cae-fa19-4a34-b87a-5e97ca70770b. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:05:27 user nova-compute[75083]: DEBUG nova.network.neutron [req-34cc3715-7407-48d2-8c19-ee52531ac83f req-e10abbd0-5309-485a-84c9-762f687f9d42 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Updating instance_info_cache with network_info: [{"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:05:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-34cc3715-7407-48d2-8c19-ee52531ac83f req-e10abbd0-5309-485a-84c9-762f687f9d42 service nova] Releasing lock "refresh_cache-733f9905-c483-4835-8ec9-953b341950d1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:05:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:38 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a6e1c2d7-1181-4d9f-99eb-d401d5f73b25 is timed out.
Nov 29 06:05:38 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Successfully detached device vdb from instance a6e1c2d7-1181-4d9f-99eb-d401d5f73b25 from the live domain config.
Nov 29 06:05:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLzbWoDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:05:38 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:05:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5cb531-00be-4c25-a6b1-368d990fbf67]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:05:38 user nova-compute[75083]: No targets found.
Nov 29 06:05:38 user nova-compute[75083]: iSNS:
Nov 29 06:05:38 user nova-compute[75083]: No targets found.
Nov 29 06:05:38 user nova-compute[75083]: STATIC:
Nov 29 06:05:38 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856
Nov 29 06:05:38 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:05:38 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:05:38 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f
Nov 29 06:05:38 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:05:38 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:05:38 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f
Nov 29 06:05:38 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:05:38 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:05:38 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542
Nov 29 06:05:38 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:05:38 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:05:38 user nova-compute[75083]: FIRMWARE:
Nov 29 06:05:38 user nova-compute[75083]: No targets found.
Nov 29 06:05:38 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:05:38 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:05:38 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[661c1495-04da-4c60-affe-12be0767c5dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3ddea1-4859-43d3-b324-85c623c315f7]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:05:38 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:05:38 user nova-compute[75083]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)
Nov 29 06:05:38 user nova-compute[75083]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)
Nov 29 06:05:38 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 (non-flash)
Nov 29 06:05:38 user nova-compute[75083]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:05:38 user nova-compute[75083]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)
Nov 29 06:05:38 user nova-compute[75083]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)
Nov 29 06:05:38 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b80ff2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[694ab6e7-3e20-41e8-b657-d393f767b5c6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f24d9bf-0c31-43e9-9ce7-6ad1b21d5af0]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[65874768-8883-4ce8-a671-eaf0e9a9c7fd]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffe1a53-0457-4f8d-bb72-b3f3ddff868c]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a124a338-91f9-416a-8ff0-2e24b425a6ef]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[093add4b-810b-4969-837d-8c065893ed3b]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542, portal: 172.16.0.220,3260]
Nov 29 06:05:38 user nova-compute[75083]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542, portal: 172.16.0.220,3260] successful.
Nov 29 06:05:38 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ce4130-2536-4b45-8b5e-e4c94ad16542 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f23fc62-1a4c-4c57-99d1-c24f4c657385]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] <== disconnect_volume: return (329ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:05:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:05:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:40 user nova-compute[75083]: DEBUG nova.objects.instance [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lazy-loading 'flavor' on Instance uuid a6e1c2d7-1181-4d9f-99eb-d401d5f73b25 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:05:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e3764cd3-c5ec-427d-a1f2-17a50684961c tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.031s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:05:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:45 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:05:45 user nova-compute[75083]: INFO nova.compute.claims [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Claim successful on node user
Nov 29 06:05:45 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:05:45 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:05:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:05:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:05:45 user nova-compute[75083]: DEBUG nova.network.neutron [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:05:45 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:05:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:05:45 user nova-compute[75083]: DEBUG nova.policy [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a47297b78304d20aae3c1e7660a8e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47937ed2be51456b840d797378c3e520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:05:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:05:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:05:45 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Creating image(s)
Nov 29 06:05:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "/opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "/opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:46 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 733f9905-c483-4835-8ec9-953b341950d1 is timed out.
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.269s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:46 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Successfully detached device vdb from instance 733f9905-c483-4835-8ec9-953b341950d1 from the live domain config.
Nov 29 06:05:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqhWlcvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:05:46 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:05:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a77fd4-f856-4ef1-94ff-d132bdcc367e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:05:46 user nova-compute[75083]: No targets found.
Nov 29 06:05:46 user nova-compute[75083]: iSNS:
Nov 29 06:05:46 user nova-compute[75083]: No targets found.
Nov 29 06:05:46 user nova-compute[75083]: STATIC:
Nov 29 06:05:46 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856
Nov 29 06:05:46 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:05:46 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:05:46 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f
Nov 29 06:05:46 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:05:46 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:05:46 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f
Nov 29 06:05:46 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:05:46 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:05:46 user nova-compute[75083]: FIRMWARE:
Nov 29 06:05:46 user nova-compute[75083]: No targets found.
Nov 29 06:05:46 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:05:46 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:05:46 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85e2614-c938-4d2c-9fdf-19064803803a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d821db-97cb-4276-8c41-7cd70000a1f0]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:05:46 user nova-compute[75083]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)
Nov 29 06:05:46 user nova-compute[75083]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)
Nov 29 06:05:46 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:05:46 user nova-compute[75083]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f (non-flash)
Nov 29 06:05:46 user nova-compute[75083]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)
Nov 29 06:05:46 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b87aee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f'): ({'sde'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Removing single pathed devices sde {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d259e2c7-9306-4bb9-904c-6075389f1bd3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk 1073741824" returned: 0 in 0.055s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed7a3e7-c335-4944-8fd3-7db198ee0c15]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Flushing IO for device /dev/sde {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b7eb32-6133-41fb-9df9-2abf40535730]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fc2914-0a08-4070-a74e-5a60dfa50e49]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] SCSI volumes sde have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG nova.network.neutron [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Successfully created port: ea463ac1-ea4e-4840-9c9f-2d9ab99e2963 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31342d4-381c-478c-a6bb-072011db77bd]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.178s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2563dde6-1fdd-4b10-a951-07749f1c6760]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f, portal: 172.16.0.220,3260]
Nov 29 06:05:46 user nova-compute[75083]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f, portal: 172.16.0.220,3260] successful.
Nov 29 06:05:46 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00976084-3048-4cfe-871e-771d12c8e40f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cc9b04-debe-4a9c-a06e-5ef843f48c33]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] <== disconnect_volume: return (412ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Cannot resize image /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Ensure instance console log exists: /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.network.neutron [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Successfully updated port: ea463ac1-ea4e-4840-9c9f-2d9ab99e2963 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "refresh_cache-ae1fbde4-f353-4e9f-ba98-14217e97e370" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquired lock "refresh_cache-ae1fbde4-f353-4e9f-ba98-14217e97e370" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.network.neutron [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.compute.manager [req-2a97468b-fa9c-45c0-b12f-7134d6bf6180 req-665d2cba-48e4-4316-8dac-8328f5c531e8 service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Received event network-changed-ea463ac1-ea4e-4840-9c9f-2d9ab99e2963 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.compute.manager [req-2a97468b-fa9c-45c0-b12f-7134d6bf6180 req-665d2cba-48e4-4316-8dac-8328f5c531e8 service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Refreshing instance network info cache due to event network-changed-ea463ac1-ea4e-4840-9c9f-2d9ab99e2963. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2a97468b-fa9c-45c0-b12f-7134d6bf6180 req-665d2cba-48e4-4316-8dac-8328f5c531e8 service nova] Acquiring lock "refresh_cache-ae1fbde4-f353-4e9f-ba98-14217e97e370" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.network.neutron [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.objects.instance [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lazy-loading 'flavor' on Instance uuid 733f9905-c483-4835-8ec9-953b341950d1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-52c7da9f-4493-4213-9329-d1c8d0524c3f tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "733f9905-c483-4835-8ec9-953b341950d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.798s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.network.neutron [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Updating instance_info_cache with network_info: [{"id": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "address": "fa:16:3e:7c:f1:4a", "network": {"id": "99b916bd-4b75-423b-a157-f73e647d7440", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852369892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47937ed2be51456b840d797378c3e520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea463ac1-ea", "ovs_interfaceid": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Releasing lock "refresh_cache-ae1fbde4-f353-4e9f-ba98-14217e97e370" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.compute.manager [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Instance network_info: |[{"id": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "address": "fa:16:3e:7c:f1:4a", "network": {"id": "99b916bd-4b75-423b-a157-f73e647d7440", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852369892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47937ed2be51456b840d797378c3e520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea463ac1-ea", "ovs_interfaceid": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2a97468b-fa9c-45c0-b12f-7134d6bf6180 req-665d2cba-48e4-4316-8dac-8328f5c531e8 service nova] Acquired lock "refresh_cache-ae1fbde4-f353-4e9f-ba98-14217e97e370" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.network.neutron [req-2a97468b-fa9c-45c0-b12f-7134d6bf6180 req-665d2cba-48e4-4316-8dac-8328f5c531e8 service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Refreshing network info cache for port ea463ac1-ea4e-4840-9c9f-2d9ab99e2963 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Start _get_guest_xml network_info=[{"id": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "address": "fa:16:3e:7c:f1:4a", "network": {"id": "99b916bd-4b75-423b-a157-f73e647d7440", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852369892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47937ed2be51456b840d797378c3e520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea463ac1-ea", "ovs_interfaceid": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:05:47 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:05:47 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:05:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2104024098',display_name='tempest-TestServerVolumeAttachmentScenario-server-2104024098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2104024098',id=35,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGID0tmXzlMqb7NMTyq96BsdvqdeM9eCXJmxraKJv4mfmi38oHjha2FY+g1vvX5JEIoRHZXQU882YG9OpzPYulAdvfZ3ZuBf5WZrzXImI2F1023JhsmFC+XOtXR6kPBAgw==',key_name='tempest-keypair-291706242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47937ed2be51456b840d797378c3e520',ramdisk_id='',reservation_id='r-2uxe20aa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1544022826',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1544022826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:05:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a47297b78304d20aae3c1e7660a8e71',uuid=ae1fbde4-f353-4e9f-ba98-14217e97e370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "address": "fa:16:3e:7c:f1:4a", "network": {"id": "99b916bd-4b75-423b-a157-f73e647d7440", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852369892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47937ed2be51456b840d797378c3e520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea463ac1-ea", "ovs_interfaceid": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Converting VIF {"id": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "address": "fa:16:3e:7c:f1:4a", "network": {"id": "99b916bd-4b75-423b-a157-f73e647d7440", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852369892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47937ed2be51456b840d797378c3e520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea463ac1-ea", "ovs_interfaceid": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:f1:4a,bridge_name='br-int',has_traffic_filtering=True,id=ea463ac1-ea4e-4840-9c9f-2d9ab99e2963,network=Network(99b916bd-4b75-423b-a157-f73e647d7440),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea463ac1-ea') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.objects.instance [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lazy-loading 'pci_devices' on Instance uuid ae1fbde4-f353-4e9f-ba98-14217e97e370 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:05:47 user nova-compute[75083]:   <uuid>ae1fbde4-f353-4e9f-ba98-14217e97e370</uuid>
Nov 29 06:05:47 user nova-compute[75083]:   <name>instance-00000023</name>
Nov 29 06:05:47 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:05:47 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:05:47 user nova-compute[75083]:   <metadata>
Nov 29 06:05:47 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:05:47 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:05:47 user nova-compute[75083]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2104024098</nova:name>
Nov 29 06:05:47 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:05:47</nova:creationTime>
Nov 29 06:05:47 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:05:47 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:05:47 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:05:47 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:05:47 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:05:47 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:05:47 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:05:47 user nova-compute[75083]:       <nova:owner>
Nov 29 06:05:47 user nova-compute[75083]:         <nova:user uuid="1a47297b78304d20aae3c1e7660a8e71">tempest-TestServerVolumeAttachmentScenario-1544022826-project-member</nova:user>
Nov 29 06:05:47 user nova-compute[75083]:         <nova:project uuid="47937ed2be51456b840d797378c3e520">tempest-TestServerVolumeAttachmentScenario-1544022826</nova:project>
Nov 29 06:05:47 user nova-compute[75083]:       </nova:owner>
Nov 29 06:05:47 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 06:05:47 user nova-compute[75083]:       <nova:ports>
Nov 29 06:05:47 user nova-compute[75083]:         <nova:port uuid="ea463ac1-ea4e-4840-9c9f-2d9ab99e2963">
Nov 29 06:05:47 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 06:05:47 user nova-compute[75083]:         </nova:port>
Nov 29 06:05:47 user nova-compute[75083]:       </nova:ports>
Nov 29 06:05:47 user nova-compute[75083]:     </nova:instance>
Nov 29 06:05:47 user nova-compute[75083]:   </metadata>
Nov 29 06:05:47 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:05:47 user nova-compute[75083]:     <system>
Nov 29 06:05:47 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:05:47 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:05:47 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:05:47 user nova-compute[75083]:       <entry name="serial">ae1fbde4-f353-4e9f-ba98-14217e97e370</entry>
Nov 29 06:05:47 user nova-compute[75083]:       <entry name="uuid">ae1fbde4-f353-4e9f-ba98-14217e97e370</entry>
Nov 29 06:05:47 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:05:47 user nova-compute[75083]:     </system>
Nov 29 06:05:47 user nova-compute[75083]:   </sysinfo>
Nov 29 06:05:47 user nova-compute[75083]:   <os>
Nov 29 06:05:47 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:05:47 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:05:47 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:05:47 user nova-compute[75083]:   </os>
Nov 29 06:05:47 user nova-compute[75083]:   <features>
Nov 29 06:05:47 user nova-compute[75083]:     <acpi/>
Nov 29 06:05:47 user nova-compute[75083]:     <apic/>
Nov 29 06:05:47 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:05:47 user nova-compute[75083]:   </features>
Nov 29 06:05:47 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:05:47 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:05:47 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:05:47 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:05:47 user nova-compute[75083]:   </clock>
Nov 29 06:05:47 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:05:47 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:05:47 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:05:47 user nova-compute[75083]:   </cpu>
Nov 29 06:05:47 user nova-compute[75083]:   <devices>
Nov 29 06:05:47 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:05:47 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:05:47 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk"/>
Nov 29 06:05:47 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:05:47 user nova-compute[75083]:     </disk>
Nov 29 06:05:47 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:05:47 user nova-compute[75083]:       <mac address="fa:16:3e:7c:f1:4a"/>
Nov 29 06:05:47 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:05:47 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:05:47 user nova-compute[75083]:       <target dev="tapea463ac1-ea"/>
Nov 29 06:05:47 user nova-compute[75083]:     </interface>
Nov 29 06:05:47 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:05:47 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/console.log" append="off"/>
Nov 29 06:05:47 user nova-compute[75083]:     </serial>
Nov 29 06:05:47 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:05:47 user nova-compute[75083]:     <video>
Nov 29 06:05:47 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:05:47 user nova-compute[75083]:     </video>
Nov 29 06:05:47 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:05:47 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:05:47 user nova-compute[75083]:     </rng>
Nov 29 06:05:47 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:05:47 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:05:47 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:05:47 user nova-compute[75083]:     </memballoon>
Nov 29 06:05:47 user nova-compute[75083]:   </devices>
Nov 29 06:05:47 user nova-compute[75083]: </domain>
Nov 29 06:05:47 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:05:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2104024098',display_name='tempest-TestServerVolumeAttachmentScenario-server-2104024098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2104024098',id=35,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGID0tmXzlMqb7NMTyq96BsdvqdeM9eCXJmxraKJv4mfmi38oHjha2FY+g1vvX5JEIoRHZXQU882YG9OpzPYulAdvfZ3ZuBf5WZrzXImI2F1023JhsmFC+XOtXR6kPBAgw==',key_name='tempest-keypair-291706242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47937ed2be51456b840d797378c3e520',ramdisk_id='',reservation_id='r-2uxe20aa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1544022826',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1544022826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:05:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a47297b78304d20aae3c1e7660a8e71',uuid=ae1fbde4-f353-4e9f-ba98-14217e97e370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "address": "fa:16:3e:7c:f1:4a", "network": {"id": "99b916bd-4b75-423b-a157-f73e647d7440", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852369892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47937ed2be51456b840d797378c3e520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea463ac1-ea", "ovs_interfaceid": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Converting VIF {"id": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "address": "fa:16:3e:7c:f1:4a", "network": {"id": "99b916bd-4b75-423b-a157-f73e647d7440", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852369892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47937ed2be51456b840d797378c3e520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea463ac1-ea", "ovs_interfaceid": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:f1:4a,bridge_name='br-int',has_traffic_filtering=True,id=ea463ac1-ea4e-4840-9c9f-2d9ab99e2963,network=Network(99b916bd-4b75-423b-a157-f73e647d7440),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea463ac1-ea') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG os_vif [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:f1:4a,bridge_name='br-int',has_traffic_filtering=True,id=ea463ac1-ea4e-4840-9c9f-2d9ab99e2963,network=Network(99b916bd-4b75-423b-a157-f73e647d7440),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea463ac1-ea') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5225a90-c021-5bca-ad86-2534efe988a7', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea463ac1-ea, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea463ac1-ea, col_values=(('qos', UUID('9c81bc60-384c-4c9c-b88e-bf324a76fc6a')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea463ac1-ea, col_values=(('external_ids', {'iface-id': 'ea463ac1-ea4e-4840-9c9f-2d9ab99e2963', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:f1:4a', 'vm-uuid': 'ae1fbde4-f353-4e9f-ba98-14217e97e370'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:47 user nova-compute[75083]: INFO os_vif [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:f1:4a,bridge_name='br-int',has_traffic_filtering=True,id=ea463ac1-ea4e-4840-9c9f-2d9ab99e2963,network=Network(99b916bd-4b75-423b-a157-f73e647d7440),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea463ac1-ea')
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:05:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] No VIF found with MAC fa:16:3e:7c:f1:4a, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:05:48 user nova-compute[75083]: DEBUG nova.network.neutron [req-2a97468b-fa9c-45c0-b12f-7134d6bf6180 req-665d2cba-48e4-4316-8dac-8328f5c531e8 service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Updated VIF entry in instance network info cache for port ea463ac1-ea4e-4840-9c9f-2d9ab99e2963. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:05:48 user nova-compute[75083]: DEBUG nova.network.neutron [req-2a97468b-fa9c-45c0-b12f-7134d6bf6180 req-665d2cba-48e4-4316-8dac-8328f5c531e8 service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Updating instance_info_cache with network_info: [{"id": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "address": "fa:16:3e:7c:f1:4a", "network": {"id": "99b916bd-4b75-423b-a157-f73e647d7440", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852369892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47937ed2be51456b840d797378c3e520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea463ac1-ea", "ovs_interfaceid": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:05:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2a97468b-fa9c-45c0-b12f-7134d6bf6180 req-665d2cba-48e4-4316-8dac-8328f5c531e8 service nova] Releasing lock "refresh_cache-ae1fbde4-f353-4e9f-ba98-14217e97e370" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:05:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:49 user nova-compute[75083]: DEBUG nova.compute.manager [req-7033900c-701b-4ff8-ba3c-fea37b2881af req-8aa31399-dd0c-41b2-88f6-b462344116aa service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Received event network-vif-plugged-ea463ac1-ea4e-4840-9c9f-2d9ab99e2963 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7033900c-701b-4ff8-ba3c-fea37b2881af req-8aa31399-dd0c-41b2-88f6-b462344116aa service nova] Acquiring lock "ae1fbde4-f353-4e9f-ba98-14217e97e370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7033900c-701b-4ff8-ba3c-fea37b2881af req-8aa31399-dd0c-41b2-88f6-b462344116aa service nova] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7033900c-701b-4ff8-ba3c-fea37b2881af req-8aa31399-dd0c-41b2-88f6-b462344116aa service nova] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:49 user nova-compute[75083]: DEBUG nova.compute.manager [req-7033900c-701b-4ff8-ba3c-fea37b2881af req-8aa31399-dd0c-41b2-88f6-b462344116aa service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] No waiting events found dispatching network-vif-plugged-ea463ac1-ea4e-4840-9c9f-2d9ab99e2963 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:05:49 user nova-compute[75083]: WARNING nova.compute.manager [req-7033900c-701b-4ff8-ba3c-fea37b2881af req-8aa31399-dd0c-41b2-88f6-b462344116aa service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Received unexpected event network-vif-plugged-ea463ac1-ea4e-4840-9c9f-2d9ab99e2963 for instance with vm_state building and task_state spawning.
Nov 29 06:05:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:51 user nova-compute[75083]: DEBUG nova.compute.manager [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:05:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:05:51 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Instance spawned successfully.
Nov 29 06:05:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:05:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:05:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:05:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:05:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:05:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:05:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:05:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:51 user nova-compute[75083]: DEBUG nova.compute.manager [req-5b7a9141-a563-4179-83eb-d34b7c9d77de req-24681c81-2bf1-4562-8bbe-34e0a194c9e2 service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Received event network-vif-plugged-ea463ac1-ea4e-4840-9c9f-2d9ab99e2963 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:05:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5b7a9141-a563-4179-83eb-d34b7c9d77de req-24681c81-2bf1-4562-8bbe-34e0a194c9e2 service nova] Acquiring lock "ae1fbde4-f353-4e9f-ba98-14217e97e370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:05:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5b7a9141-a563-4179-83eb-d34b7c9d77de req-24681c81-2bf1-4562-8bbe-34e0a194c9e2 service nova] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:05:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5b7a9141-a563-4179-83eb-d34b7c9d77de req-24681c81-2bf1-4562-8bbe-34e0a194c9e2 service nova] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:51 user nova-compute[75083]: DEBUG nova.compute.manager [req-5b7a9141-a563-4179-83eb-d34b7c9d77de req-24681c81-2bf1-4562-8bbe-34e0a194c9e2 service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] No waiting events found dispatching network-vif-plugged-ea463ac1-ea4e-4840-9c9f-2d9ab99e2963 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:05:51 user nova-compute[75083]: WARNING nova.compute.manager [req-5b7a9141-a563-4179-83eb-d34b7c9d77de req-24681c81-2bf1-4562-8bbe-34e0a194c9e2 service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Received unexpected event network-vif-plugged-ea463ac1-ea4e-4840-9c9f-2d9ab99e2963 for instance with vm_state building and task_state spawning.
Nov 29 06:05:51 user nova-compute[75083]: INFO nova.compute.manager [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 29 06:05:51 user nova-compute[75083]: DEBUG nova.compute.manager [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:05:51 user nova-compute[75083]: INFO nova.compute.manager [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Took 6.55 seconds to build instance.
Nov 29 06:05:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-732cd414-61fa-4365-8cca-3c88b2829013 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.658s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:05:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:05:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:06:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:06:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:06:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:06:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:07 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:06:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:06:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:06:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:06:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:06:08 user nova-compute[75083]: INFO nova.compute.manager [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Terminating instance
Nov 29 06:06:08 user nova-compute[75083]: DEBUG nova.compute.manager [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:06:08 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:06:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:08 user nova-compute[75083]: DEBUG nova.compute.manager [req-fc8c5eaa-d0b8-47fa-bfce-c888538d871a req-cf62f790-fc6c-4ec2-b736-8c9820b17904 service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Received event network-vif-unplugged-ec1e3052-9df5-4761-a59e-cd649ad258e9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:06:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fc8c5eaa-d0b8-47fa-bfce-c888538d871a req-cf62f790-fc6c-4ec2-b736-8c9820b17904 service nova] Acquiring lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:06:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fc8c5eaa-d0b8-47fa-bfce-c888538d871a req-cf62f790-fc6c-4ec2-b736-8c9820b17904 service nova] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:06:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fc8c5eaa-d0b8-47fa-bfce-c888538d871a req-cf62f790-fc6c-4ec2-b736-8c9820b17904 service nova] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:06:08 user nova-compute[75083]: DEBUG nova.compute.manager [req-fc8c5eaa-d0b8-47fa-bfce-c888538d871a req-cf62f790-fc6c-4ec2-b736-8c9820b17904 service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] No waiting events found dispatching network-vif-unplugged-ec1e3052-9df5-4761-a59e-cd649ad258e9 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:06:08 user nova-compute[75083]: DEBUG nova.compute.manager [req-fc8c5eaa-d0b8-47fa-bfce-c888538d871a req-cf62f790-fc6c-4ec2-b736-8c9820b17904 service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Received event network-vif-unplugged-ec1e3052-9df5-4761-a59e-cd649ad258e9 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:06:09 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Instance destroyed successfully.
Nov 29 06:06:09 user nova-compute[75083]: DEBUG nova.objects.instance [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lazy-loading 'resources' on Instance uuid a6e1c2d7-1181-4d9f-99eb-d401d5f73b25 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:06:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-685500313',display_name='tempest-AttachVolumeNegativeTest-server-685500313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-685500313',id=29,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRnm+yGLmOjNs1zTT5hxjXBiXKJ1nrKOwSJq0eWkW0eMRFnMPFtY66AF4OUr6dckTzJCJYuU0hxIEN55tky+ZEdO6ZQmV1iZjbC/Xqxx5h/uCcgBXhkfxyIsC7E2xSIVQ==',key_name='tempest-keypair-1215371615',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:00:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='112a98f04dc141dfbb0f7a10fd410cae',ramdisk_id='',reservation_id='r-thao6ppp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1387142425',owner_user_name='tempest-AttachVolumeNegativeTest-1387142425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dc42da0ede8433a827629a68e691658',uuid=a6e1c2d7-1181-4d9f-99eb-d401d5f73b25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "address": "fa:16:3e:ff:41:7d", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1e3052-9d", "ovs_interfaceid": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:06:09 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converting VIF {"id": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "address": "fa:16:3e:ff:41:7d", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1e3052-9d", "ovs_interfaceid": "ec1e3052-9df5-4761-a59e-cd649ad258e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:06:09 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:41:7d,bridge_name='br-int',has_traffic_filtering=True,id=ec1e3052-9df5-4761-a59e-cd649ad258e9,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec1e3052-9d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:06:09 user nova-compute[75083]: DEBUG os_vif [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:41:7d,bridge_name='br-int',has_traffic_filtering=True,id=ec1e3052-9df5-4761-a59e-cd649ad258e9,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec1e3052-9d') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:06:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec1e3052-9d, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:06:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:06:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2e87d65-27af-4d1d-941a-e17172ea2f92) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:06:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:06:09 user nova-compute[75083]: INFO os_vif [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:41:7d,bridge_name='br-int',has_traffic_filtering=True,id=ec1e3052-9df5-4761-a59e-cd649ad258e9,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec1e3052-9d')
Nov 29 06:06:09 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Deleting instance files /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25_del
Nov 29 06:06:09 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Deletion of /opt/stack/data/nova/instances/a6e1c2d7-1181-4d9f-99eb-d401d5f73b25_del complete
Nov 29 06:06:09 user nova-compute[75083]: INFO nova.compute.manager [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 06:06:09 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:06:09 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:06:09 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:06:09 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:06:10 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:06:10 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Took 0.84 seconds to deallocate network for instance.
Nov 29 06:06:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-025dbdd4-4688-4dc1-b365-ec206fb288db req-564c8697-f4aa-4e8a-b25d-b0d747e6cee5 service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Received event network-vif-deleted-ec1e3052-9df5-4761-a59e-cd649ad258e9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:06:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:06:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:06:10 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:06:10 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:06:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:06:10 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Deleted allocations for instance a6e1c2d7-1181-4d9f-99eb-d401d5f73b25
Nov 29 06:06:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3e94a00d-8e00-4222-a5c6-d0f14bb04334 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.202s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:06:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-e33e6b4c-f572-4e01-9861-cf3e7ceb4709 req-94bcedc0-abc7-4c31-bc7c-218840ed4857 service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Received event network-vif-plugged-ec1e3052-9df5-4761-a59e-cd649ad258e9 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:06:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e33e6b4c-f572-4e01-9861-cf3e7ceb4709 req-94bcedc0-abc7-4c31-bc7c-218840ed4857 service nova] Acquiring lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:06:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e33e6b4c-f572-4e01-9861-cf3e7ceb4709 req-94bcedc0-abc7-4c31-bc7c-218840ed4857 service nova] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:06:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e33e6b4c-f572-4e01-9861-cf3e7ceb4709 req-94bcedc0-abc7-4c31-bc7c-218840ed4857 service nova] Lock "a6e1c2d7-1181-4d9f-99eb-d401d5f73b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:06:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-e33e6b4c-f572-4e01-9861-cf3e7ceb4709 req-94bcedc0-abc7-4c31-bc7c-218840ed4857 service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] No waiting events found dispatching network-vif-plugged-ec1e3052-9df5-4761-a59e-cd649ad258e9 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:06:10 user nova-compute[75083]: WARNING nova.compute.manager [req-e33e6b4c-f572-4e01-9861-cf3e7ceb4709 req-94bcedc0-abc7-4c31-bc7c-218840ed4857 service nova] [instance: a6e1c2d7-1181-4d9f-99eb-d401d5f73b25] Received unexpected event network-vif-plugged-ec1e3052-9df5-4761-a59e-cd649ad258e9 for instance with vm_state deleted and task_state None.
Nov 29 06:06:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:12 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:06:12 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:06:12 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:06:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:06:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:14 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:06:14 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:06:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:06:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:06:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:06:14 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:06:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:06:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea64bdc-491c-46ba-9447-c175df432deb/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:06:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea64bdc-491c-46ba-9447-c175df432deb/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:06:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea64bdc-491c-46ba-9447-c175df432deb/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:06:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea64bdc-491c-46ba-9447-c175df432deb/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:06:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:06:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:06:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:06:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:06:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:06:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:06:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:06:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:06:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:06:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:06:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:06:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:06:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:06:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:06:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:06:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:06:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:06:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:06:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:06:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:06:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:06:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:06:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:06:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:06:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:06:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:06:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:06:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:06:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:06:18 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:06:18 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:06:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8032MB free_disk=25.05594253540039GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:06:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:06:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:06:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4435ed78-e35f-4859-8a4f-9920815d968a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:06:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a34d9d98-be73-4d52-85f0-83e48f60bc12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:06:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:06:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 733f9905-c483-4835-8ec9-953b341950d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:06:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fea64bdc-491c-46ba-9447-c175df432deb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:06:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance f1a6ae72-f187-4558-a164-49c436e886ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:06:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance ae1fbde4-f353-4e9f-ba98-14217e97e370 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:06:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:06:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:06:18 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:06:18 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:06:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:06:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:06:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:19 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:06:19 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-a34d9d98-be73-4d52-85f0-83e48f60bc12" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-a34d9d98-be73-4d52-85f0-83e48f60bc12" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:06:20 user nova-compute[75083]: INFO nova.compute.manager [None req-f2de4176-c083-491e-8758-d81ceda87faa tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Unrescuing
Nov 29 06:06:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2de4176-c083-491e-8758-d81ceda87faa tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2de4176-c083-491e-8758-d81ceda87faa tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquired lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f2de4176-c083-491e-8758-d81ceda87faa tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "733f9905-c483-4835-8ec9-953b341950d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "733f9905-c483-4835-8ec9-953b341950d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "733f9905-c483-4835-8ec9-953b341950d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "733f9905-c483-4835-8ec9-953b341950d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "733f9905-c483-4835-8ec9-953b341950d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:06:20 user nova-compute[75083]: INFO nova.compute.manager [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Terminating instance
Nov 29 06:06:20 user nova-compute[75083]: DEBUG nova.compute.manager [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Updating instance_info_cache with network_info: [{"id": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "address": "fa:16:3e:eb:95:6e", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31b37f5-06", "ovs_interfaceid": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-a34d9d98-be73-4d52-85f0-83e48f60bc12" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG nova.compute.manager [req-8ac1c651-e01e-49c6-bd2d-d2c2db8951b8 req-85ad1e47-f883-45b3-9228-90f121038c56 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received event network-vif-unplugged-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8ac1c651-e01e-49c6-bd2d-d2c2db8951b8 req-85ad1e47-f883-45b3-9228-90f121038c56 service nova] Acquiring lock "733f9905-c483-4835-8ec9-953b341950d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8ac1c651-e01e-49c6-bd2d-d2c2db8951b8 req-85ad1e47-f883-45b3-9228-90f121038c56 service nova] Lock "733f9905-c483-4835-8ec9-953b341950d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8ac1c651-e01e-49c6-bd2d-d2c2db8951b8 req-85ad1e47-f883-45b3-9228-90f121038c56 service nova] Lock "733f9905-c483-4835-8ec9-953b341950d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG nova.compute.manager [req-8ac1c651-e01e-49c6-bd2d-d2c2db8951b8 req-85ad1e47-f883-45b3-9228-90f121038c56 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] No waiting events found dispatching network-vif-unplugged-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG nova.compute.manager [req-8ac1c651-e01e-49c6-bd2d-d2c2db8951b8 req-85ad1e47-f883-45b3-9228-90f121038c56 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received event network-vif-unplugged-b3126cae-fa19-4a34-b87a-5e97ca70770b for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f2de4176-c083-491e-8758-d81ceda87faa tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Updating instance_info_cache with network_info: [{"id": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "address": "fa:16:3e:e1:f6:16", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feebf60-26", "ovs_interfaceid": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:06:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2de4176-c083-491e-8758-d81ceda87faa tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Releasing lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG nova.objects.instance [None req-f2de4176-c083-491e-8758-d81ceda87faa tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'flavor' on Instance uuid fea64bdc-491c-46ba-9447-c175df432deb {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG nova.compute.manager [req-9c7e3483-d35f-4d18-8d6e-0b84c18d4aa0 req-4cae5b22-973c-43f3-81f3-7d588f52a830 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received event network-vif-unplugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9c7e3483-d35f-4d18-8d6e-0b84c18d4aa0 req-4cae5b22-973c-43f3-81f3-7d588f52a830 service nova] Acquiring lock "fea64bdc-491c-46ba-9447-c175df432deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9c7e3483-d35f-4d18-8d6e-0b84c18d4aa0 req-4cae5b22-973c-43f3-81f3-7d588f52a830 service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9c7e3483-d35f-4d18-8d6e-0b84c18d4aa0 req-4cae5b22-973c-43f3-81f3-7d588f52a830 service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG nova.compute.manager [req-9c7e3483-d35f-4d18-8d6e-0b84c18d4aa0 req-4cae5b22-973c-43f3-81f3-7d588f52a830 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] No waiting events found dispatching network-vif-unplugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:06:21 user nova-compute[75083]: WARNING nova.compute.manager [req-9c7e3483-d35f-4d18-8d6e-0b84c18d4aa0 req-4cae5b22-973c-43f3-81f3-7d588f52a830 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received unexpected event network-vif-unplugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 for instance with vm_state rescued and task_state unrescuing.
Nov 29 06:06:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:21 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Instance destroyed successfully.
Nov 29 06:06:21 user nova-compute[75083]: DEBUG nova.objects.instance [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lazy-loading 'resources' on Instance uuid 733f9905-c483-4835-8ec9-953b341950d1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-534054970',display_name='tempest-TestMinimumBasicScenario-server-534054970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-534054970',id=30,image_ref='325c0786-2bab-4ff9-a435-46158e003aee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEN2s530aGNqCnv3Q2xJE1Vb0iCTwM9AOsamn/qxqdg0D1v7VpXgftDlWrVrqOqOuPZ9gUPuvoZNn/6knJQVreVVsytrn4dDpcRmQOd9fotXylI6tQ+iozlTHfRnex9sQ==',key_name='tempest-TestMinimumBasicScenario-631134433',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:01:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0801cbd66c8457b887d383721d95915',ramdisk_id='',reservation_id='r-2trkv2ny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='325c0786-2bab-4ff9-a435-46158e003aee',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2019017585',owner_user_name='tempest-TestMinimumBasicScenario-2019017585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:03:40Z,user_data=None,user_id='eb526efdda0c4ca2ba8e739ecbe9e148',uuid=733f9905-c483-4835-8ec9-953b341950d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Converting VIF {"id": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "address": "fa:16:3e:16:1e:34", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3126cae-fa", "ovs_interfaceid": "b3126cae-fa19-4a34-b87a-5e97ca70770b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=b3126cae-fa19-4a34-b87a-5e97ca70770b,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3126cae-fa') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG os_vif [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=b3126cae-fa19-4a34-b87a-5e97ca70770b,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3126cae-fa') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3126cae-fa, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69229c3f-fa04-4831-a2ff-75076bfd62ff) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:21 user nova-compute[75083]: INFO os_vif [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=b3126cae-fa19-4a34-b87a-5e97ca70770b,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3126cae-fa')
Nov 29 06:06:21 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Deleting instance files /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1_del
Nov 29 06:06:21 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Deletion of /opt/stack/data/nova/instances/733f9905-c483-4835-8ec9-953b341950d1_del complete
Nov 29 06:06:21 user nova-compute[75083]: INFO nova.compute.manager [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 29 06:06:21 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:06:21 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 733f9905-c483-4835-8ec9-953b341950d1] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:06:21 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Instance destroyed successfully.
Nov 29 06:06:22 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:06:22 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Took 0.84 seconds to deallocate network for instance.
Nov 29 06:06:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:06:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:06:22 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:06:22 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:06:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:06:22 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Deleted allocations for instance 733f9905-c483-4835-8ec9-953b341950d1
Nov 29 06:06:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-181735a1-40da-4078-b0cd-dd800511b1fa tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "733f9905-c483-4835-8ec9-953b341950d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.312s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:06:22 user nova-compute[75083]: DEBUG nova.compute.manager [req-03f28aca-a224-46fd-abed-18b55ef7642a req-6155f349-9bf6-4549-a7b8-2e4e8f0596d0 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received event network-vif-plugged-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:06:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-03f28aca-a224-46fd-abed-18b55ef7642a req-6155f349-9bf6-4549-a7b8-2e4e8f0596d0 service nova] Acquiring lock "733f9905-c483-4835-8ec9-953b341950d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:06:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-03f28aca-a224-46fd-abed-18b55ef7642a req-6155f349-9bf6-4549-a7b8-2e4e8f0596d0 service nova] Lock "733f9905-c483-4835-8ec9-953b341950d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:06:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-03f28aca-a224-46fd-abed-18b55ef7642a req-6155f349-9bf6-4549-a7b8-2e4e8f0596d0 service nova] Lock "733f9905-c483-4835-8ec9-953b341950d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:06:22 user nova-compute[75083]: DEBUG nova.compute.manager [req-03f28aca-a224-46fd-abed-18b55ef7642a req-6155f349-9bf6-4549-a7b8-2e4e8f0596d0 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] No waiting events found dispatching network-vif-plugged-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:06:22 user nova-compute[75083]: WARNING nova.compute.manager [req-03f28aca-a224-46fd-abed-18b55ef7642a req-6155f349-9bf6-4549-a7b8-2e4e8f0596d0 service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received unexpected event network-vif-plugged-b3126cae-fa19-4a34-b87a-5e97ca70770b for instance with vm_state deleted and task_state None.
Nov 29 06:06:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-28af2512-b768-44fc-8914-55cc73d3f077 req-5e763cff-5f6c-4357-8cb2-9bd73c4e1cec service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received event network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:06:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-28af2512-b768-44fc-8914-55cc73d3f077 req-5e763cff-5f6c-4357-8cb2-9bd73c4e1cec service nova] Acquiring lock "fea64bdc-491c-46ba-9447-c175df432deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:06:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-28af2512-b768-44fc-8914-55cc73d3f077 req-5e763cff-5f6c-4357-8cb2-9bd73c4e1cec service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:06:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-28af2512-b768-44fc-8914-55cc73d3f077 req-5e763cff-5f6c-4357-8cb2-9bd73c4e1cec service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:06:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-28af2512-b768-44fc-8914-55cc73d3f077 req-5e763cff-5f6c-4357-8cb2-9bd73c4e1cec service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] No waiting events found dispatching network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:06:23 user nova-compute[75083]: WARNING nova.compute.manager [req-28af2512-b768-44fc-8914-55cc73d3f077 req-5e763cff-5f6c-4357-8cb2-9bd73c4e1cec service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received unexpected event network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 for instance with vm_state rescued and task_state unrescuing.
Nov 29 06:06:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-28af2512-b768-44fc-8914-55cc73d3f077 req-5e763cff-5f6c-4357-8cb2-9bd73c4e1cec service nova] [instance: 733f9905-c483-4835-8ec9-953b341950d1] Received event network-vif-deleted-b3126cae-fa19-4a34-b87a-5e97ca70770b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:06:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-67c51389-39f5-4972-a170-062ef7afda4b req-14bdcfbe-f489-4cd2-84cf-b40e5786a7ae service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received event network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:06:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-67c51389-39f5-4972-a170-062ef7afda4b req-14bdcfbe-f489-4cd2-84cf-b40e5786a7ae service nova] Acquiring lock "fea64bdc-491c-46ba-9447-c175df432deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:06:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-67c51389-39f5-4972-a170-062ef7afda4b req-14bdcfbe-f489-4cd2-84cf-b40e5786a7ae service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:06:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-67c51389-39f5-4972-a170-062ef7afda4b req-14bdcfbe-f489-4cd2-84cf-b40e5786a7ae service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:06:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-67c51389-39f5-4972-a170-062ef7afda4b req-14bdcfbe-f489-4cd2-84cf-b40e5786a7ae service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] No waiting events found dispatching network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:06:25 user nova-compute[75083]: WARNING nova.compute.manager [req-67c51389-39f5-4972-a170-062ef7afda4b req-14bdcfbe-f489-4cd2-84cf-b40e5786a7ae service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received unexpected event network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 for instance with vm_state rescued and task_state unrescuing.
Nov 29 06:06:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-67c51389-39f5-4972-a170-062ef7afda4b req-14bdcfbe-f489-4cd2-84cf-b40e5786a7ae service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received event network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:06:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-67c51389-39f5-4972-a170-062ef7afda4b req-14bdcfbe-f489-4cd2-84cf-b40e5786a7ae service nova] Acquiring lock "fea64bdc-491c-46ba-9447-c175df432deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:06:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-67c51389-39f5-4972-a170-062ef7afda4b req-14bdcfbe-f489-4cd2-84cf-b40e5786a7ae service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:06:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-67c51389-39f5-4972-a170-062ef7afda4b req-14bdcfbe-f489-4cd2-84cf-b40e5786a7ae service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:06:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-67c51389-39f5-4972-a170-062ef7afda4b req-14bdcfbe-f489-4cd2-84cf-b40e5786a7ae service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] No waiting events found dispatching network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:06:25 user nova-compute[75083]: WARNING nova.compute.manager [req-67c51389-39f5-4972-a170-062ef7afda4b req-14bdcfbe-f489-4cd2-84cf-b40e5786a7ae service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received unexpected event network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 for instance with vm_state rescued and task_state unrescuing.
Nov 29 06:06:25 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f2de4176-c083-491e-8758-d81ceda87faa tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:06:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:06:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:06:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:06:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:06:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:06:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:06:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:06:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:06:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:50 user nova-compute[75083]: INFO nova.compute.manager [None req-fc74cd10-da70-4fb4-a579-ab31b5700354 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Unrescuing
Nov 29 06:06:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fc74cd10-da70-4fb4-a579-ab31b5700354 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:06:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fc74cd10-da70-4fb4-a579-ab31b5700354 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquired lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:06:50 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fc74cd10-da70-4fb4-a579-ab31b5700354 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:06:51 user nova-compute[75083]: DEBUG nova.network.neutron [None req-fc74cd10-da70-4fb4-a579-ab31b5700354 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Updating instance_info_cache with network_info: [{"id": "f90583fd-5231-46cb-9d2b-3534b01e2587", "address": "fa:16:3e:d7:32:34", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90583fd-52", "ovs_interfaceid": "f90583fd-5231-46cb-9d2b-3534b01e2587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:06:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fc74cd10-da70-4fb4-a579-ab31b5700354 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Releasing lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:06:51 user nova-compute[75083]: DEBUG nova.objects.instance [None req-fc74cd10-da70-4fb4-a579-ab31b5700354 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'flavor' on Instance uuid f1a6ae72-f187-4558-a164-49c436e886ee {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:06:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:51 user nova-compute[75083]: DEBUG nova.compute.manager [req-69ef6e03-e339-4151-84d7-b226d4e08edb req-25a43460-285f-4ab3-bfc9-ffcd1fffd19e service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-vif-unplugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:06:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-69ef6e03-e339-4151-84d7-b226d4e08edb req-25a43460-285f-4ab3-bfc9-ffcd1fffd19e service nova] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:06:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-69ef6e03-e339-4151-84d7-b226d4e08edb req-25a43460-285f-4ab3-bfc9-ffcd1fffd19e service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:06:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-69ef6e03-e339-4151-84d7-b226d4e08edb req-25a43460-285f-4ab3-bfc9-ffcd1fffd19e service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:06:51 user nova-compute[75083]: DEBUG nova.compute.manager [req-69ef6e03-e339-4151-84d7-b226d4e08edb req-25a43460-285f-4ab3-bfc9-ffcd1fffd19e service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] No waiting events found dispatching network-vif-unplugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:06:51 user nova-compute[75083]: WARNING nova.compute.manager [req-69ef6e03-e339-4151-84d7-b226d4e08edb req-25a43460-285f-4ab3-bfc9-ffcd1fffd19e service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received unexpected event network-vif-unplugged-f90583fd-5231-46cb-9d2b-3534b01e2587 for instance with vm_state rescued and task_state unrescuing.
Nov 29 06:06:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:51 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Instance destroyed successfully.
Nov 29 06:06:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:53 user nova-compute[75083]: DEBUG nova.compute.manager [req-419c7091-03b0-4984-8f2e-ebbddcbfa5f2 req-8ad549fc-4a47-4f02-98ad-9ca88e6d4f34 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:06:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-419c7091-03b0-4984-8f2e-ebbddcbfa5f2 req-8ad549fc-4a47-4f02-98ad-9ca88e6d4f34 service nova] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:06:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-419c7091-03b0-4984-8f2e-ebbddcbfa5f2 req-8ad549fc-4a47-4f02-98ad-9ca88e6d4f34 service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:06:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-419c7091-03b0-4984-8f2e-ebbddcbfa5f2 req-8ad549fc-4a47-4f02-98ad-9ca88e6d4f34 service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:06:53 user nova-compute[75083]: DEBUG nova.compute.manager [req-419c7091-03b0-4984-8f2e-ebbddcbfa5f2 req-8ad549fc-4a47-4f02-98ad-9ca88e6d4f34 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] No waiting events found dispatching network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:06:53 user nova-compute[75083]: WARNING nova.compute.manager [req-419c7091-03b0-4984-8f2e-ebbddcbfa5f2 req-8ad549fc-4a47-4f02-98ad-9ca88e6d4f34 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received unexpected event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 for instance with vm_state rescued and task_state unrescuing.
Nov 29 06:06:53 user nova-compute[75083]: DEBUG nova.compute.manager [req-419c7091-03b0-4984-8f2e-ebbddcbfa5f2 req-8ad549fc-4a47-4f02-98ad-9ca88e6d4f34 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:06:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-419c7091-03b0-4984-8f2e-ebbddcbfa5f2 req-8ad549fc-4a47-4f02-98ad-9ca88e6d4f34 service nova] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:06:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-419c7091-03b0-4984-8f2e-ebbddcbfa5f2 req-8ad549fc-4a47-4f02-98ad-9ca88e6d4f34 service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:06:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-419c7091-03b0-4984-8f2e-ebbddcbfa5f2 req-8ad549fc-4a47-4f02-98ad-9ca88e6d4f34 service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:06:53 user nova-compute[75083]: DEBUG nova.compute.manager [req-419c7091-03b0-4984-8f2e-ebbddcbfa5f2 req-8ad549fc-4a47-4f02-98ad-9ca88e6d4f34 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] No waiting events found dispatching network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:06:53 user nova-compute[75083]: WARNING nova.compute.manager [req-419c7091-03b0-4984-8f2e-ebbddcbfa5f2 req-8ad549fc-4a47-4f02-98ad-9ca88e6d4f34 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received unexpected event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 for instance with vm_state rescued and task_state unrescuing.
Nov 29 06:06:55 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fc74cd10-da70-4fb4-a579-ab31b5700354 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:06:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-a41ef699-b0c5-44ae-8b01-d9df3428d175 req-75970a3c-4473-4ab5-a715-047823aa49a5 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:06:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a41ef699-b0c5-44ae-8b01-d9df3428d175 req-75970a3c-4473-4ab5-a715-047823aa49a5 service nova] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:06:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a41ef699-b0c5-44ae-8b01-d9df3428d175 req-75970a3c-4473-4ab5-a715-047823aa49a5 service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:06:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a41ef699-b0c5-44ae-8b01-d9df3428d175 req-75970a3c-4473-4ab5-a715-047823aa49a5 service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:06:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-a41ef699-b0c5-44ae-8b01-d9df3428d175 req-75970a3c-4473-4ab5-a715-047823aa49a5 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] No waiting events found dispatching network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:06:55 user nova-compute[75083]: WARNING nova.compute.manager [req-a41ef699-b0c5-44ae-8b01-d9df3428d175 req-75970a3c-4473-4ab5-a715-047823aa49a5 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received unexpected event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 for instance with vm_state active and task_state None.
Nov 29 06:06:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:06:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:07:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:07:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:07:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:07:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:07:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:02 user nova-compute[75083]: DEBUG nova.compute.manager [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:07:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:02 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:07:02 user nova-compute[75083]: INFO nova.compute.claims [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Claim successful on node user
Nov 29 06:07:03 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:07:03 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:07:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:07:03 user nova-compute[75083]: DEBUG nova.compute.manager [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:07:03 user nova-compute[75083]: DEBUG nova.compute.manager [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:07:03 user nova-compute[75083]: DEBUG nova.network.neutron [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:07:03 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:07:03 user nova-compute[75083]: DEBUG nova.compute.manager [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:07:03 user nova-compute[75083]: DEBUG nova.policy [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4dc42da0ede8433a827629a68e691658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112a98f04dc141dfbb0f7a10fd410cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:07:03 user nova-compute[75083]: DEBUG nova.compute.manager [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:07:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:07:03 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Creating image(s)
Nov 29 06:07:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "/opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "/opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "/opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:07:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.195s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.208s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk 1073741824" returned: 0 in 0.077s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:07:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:04 user nova-compute[75083]: DEBUG nova.network.neutron [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Successfully created port: 47704c3e-14b2-4aff-a773-c92babf49bde {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:07:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.265s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:04 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 06:07:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:04 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Cannot resize image /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 06:07:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 06:07:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Ensure instance console log exists: /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:07:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:07:04 user nova-compute[75083]: DEBUG nova.network.neutron [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Successfully updated port: 47704c3e-14b2-4aff-a773-c92babf49bde {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:07:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "refresh_cache-13099ea1-93dc-4424-b0cf-fbaaf39aaeab" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:07:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquired lock "refresh_cache-13099ea1-93dc-4424-b0cf-fbaaf39aaeab" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:07:04 user nova-compute[75083]: DEBUG nova.network.neutron [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.compute.manager [req-3d6530d6-9048-4bc0-a156-a35d4e11549c req-1bc01bf5-1958-4f5f-aa87-85cd0d3a14e0 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Received event network-changed-47704c3e-14b2-4aff-a773-c92babf49bde {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.compute.manager [req-3d6530d6-9048-4bc0-a156-a35d4e11549c req-1bc01bf5-1958-4f5f-aa87-85cd0d3a14e0 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Refreshing instance network info cache due to event network-changed-47704c3e-14b2-4aff-a773-c92babf49bde. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3d6530d6-9048-4bc0-a156-a35d4e11549c req-1bc01bf5-1958-4f5f-aa87-85cd0d3a14e0 service nova] Acquiring lock "refresh_cache-13099ea1-93dc-4424-b0cf-fbaaf39aaeab" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.network.neutron [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.network.neutron [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Updating instance_info_cache with network_info: [{"id": "47704c3e-14b2-4aff-a773-c92babf49bde", "address": "fa:16:3e:0e:e2:84", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47704c3e-14", "ovs_interfaceid": "47704c3e-14b2-4aff-a773-c92babf49bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Releasing lock "refresh_cache-13099ea1-93dc-4424-b0cf-fbaaf39aaeab" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.compute.manager [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Instance network_info: |[{"id": "47704c3e-14b2-4aff-a773-c92babf49bde", "address": "fa:16:3e:0e:e2:84", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47704c3e-14", "ovs_interfaceid": "47704c3e-14b2-4aff-a773-c92babf49bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3d6530d6-9048-4bc0-a156-a35d4e11549c req-1bc01bf5-1958-4f5f-aa87-85cd0d3a14e0 service nova] Acquired lock "refresh_cache-13099ea1-93dc-4424-b0cf-fbaaf39aaeab" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.network.neutron [req-3d6530d6-9048-4bc0-a156-a35d4e11549c req-1bc01bf5-1958-4f5f-aa87-85cd0d3a14e0 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Refreshing network info cache for port 47704c3e-14b2-4aff-a773-c92babf49bde {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Start _get_guest_xml network_info=[{"id": "47704c3e-14b2-4aff-a773-c92babf49bde", "address": "fa:16:3e:0e:e2:84", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47704c3e-14", "ovs_interfaceid": "47704c3e-14b2-4aff-a773-c92babf49bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:07:05 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:07:05 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:07:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-310275406',display_name='tempest-AttachVolumeNegativeTest-server-310275406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-310275406',id=36,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwO16J1BNGOs59eXS2n/ZewLJHA3SebviIYOU8K/grbKzn9lfd5MraNBbyylWWBxEfsXW7Q7sJ0vNsln+EOu2DB4uIxdtIinnHb/EevPOE7AXMhCOc+k/Oj8MwftDviLg==',key_name='tempest-keypair-720654791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112a98f04dc141dfbb0f7a10fd410cae',ramdisk_id='',reservation_id='r-fcj12pt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1387142425',owner_user_name='tempest-AttachVolumeNegativeTest-1387142425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dc42da0ede8433a827629a68e691658',uuid=13099ea1-93dc-4424-b0cf-fbaaf39aaeab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47704c3e-14b2-4aff-a773-c92babf49bde", "address": "fa:16:3e:0e:e2:84", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47704c3e-14", "ovs_interfaceid": "47704c3e-14b2-4aff-a773-c92babf49bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converting VIF {"id": "47704c3e-14b2-4aff-a773-c92babf49bde", "address": "fa:16:3e:0e:e2:84", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47704c3e-14", "ovs_interfaceid": "47704c3e-14b2-4aff-a773-c92babf49bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:e2:84,bridge_name='br-int',has_traffic_filtering=True,id=47704c3e-14b2-4aff-a773-c92babf49bde,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47704c3e-14') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.objects.instance [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lazy-loading 'pci_devices' on Instance uuid 13099ea1-93dc-4424-b0cf-fbaaf39aaeab {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:07:05 user nova-compute[75083]:   <uuid>13099ea1-93dc-4424-b0cf-fbaaf39aaeab</uuid>
Nov 29 06:07:05 user nova-compute[75083]:   <name>instance-00000024</name>
Nov 29 06:07:05 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:07:05 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:07:05 user nova-compute[75083]:   <metadata>
Nov 29 06:07:05 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:07:05 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:07:05 user nova-compute[75083]:       <nova:name>tempest-AttachVolumeNegativeTest-server-310275406</nova:name>
Nov 29 06:07:05 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:07:05</nova:creationTime>
Nov 29 06:07:05 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:07:05 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:07:05 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:07:05 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:07:05 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:07:05 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:07:05 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:07:05 user nova-compute[75083]:       <nova:owner>
Nov 29 06:07:05 user nova-compute[75083]:         <nova:user uuid="4dc42da0ede8433a827629a68e691658">tempest-AttachVolumeNegativeTest-1387142425-project-member</nova:user>
Nov 29 06:07:05 user nova-compute[75083]:         <nova:project uuid="112a98f04dc141dfbb0f7a10fd410cae">tempest-AttachVolumeNegativeTest-1387142425</nova:project>
Nov 29 06:07:05 user nova-compute[75083]:       </nova:owner>
Nov 29 06:07:05 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 06:07:05 user nova-compute[75083]:       <nova:ports>
Nov 29 06:07:05 user nova-compute[75083]:         <nova:port uuid="47704c3e-14b2-4aff-a773-c92babf49bde">
Nov 29 06:07:05 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 06:07:05 user nova-compute[75083]:         </nova:port>
Nov 29 06:07:05 user nova-compute[75083]:       </nova:ports>
Nov 29 06:07:05 user nova-compute[75083]:     </nova:instance>
Nov 29 06:07:05 user nova-compute[75083]:   </metadata>
Nov 29 06:07:05 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:07:05 user nova-compute[75083]:     <system>
Nov 29 06:07:05 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:07:05 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:07:05 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:07:05 user nova-compute[75083]:       <entry name="serial">13099ea1-93dc-4424-b0cf-fbaaf39aaeab</entry>
Nov 29 06:07:05 user nova-compute[75083]:       <entry name="uuid">13099ea1-93dc-4424-b0cf-fbaaf39aaeab</entry>
Nov 29 06:07:05 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:07:05 user nova-compute[75083]:     </system>
Nov 29 06:07:05 user nova-compute[75083]:   </sysinfo>
Nov 29 06:07:05 user nova-compute[75083]:   <os>
Nov 29 06:07:05 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:07:05 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:07:05 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:07:05 user nova-compute[75083]:   </os>
Nov 29 06:07:05 user nova-compute[75083]:   <features>
Nov 29 06:07:05 user nova-compute[75083]:     <acpi/>
Nov 29 06:07:05 user nova-compute[75083]:     <apic/>
Nov 29 06:07:05 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:07:05 user nova-compute[75083]:   </features>
Nov 29 06:07:05 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:07:05 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:07:05 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:07:05 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:07:05 user nova-compute[75083]:   </clock>
Nov 29 06:07:05 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:07:05 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:07:05 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:07:05 user nova-compute[75083]:   </cpu>
Nov 29 06:07:05 user nova-compute[75083]:   <devices>
Nov 29 06:07:05 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:07:05 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:07:05 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk"/>
Nov 29 06:07:05 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:07:05 user nova-compute[75083]:     </disk>
Nov 29 06:07:05 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:07:05 user nova-compute[75083]:       <mac address="fa:16:3e:0e:e2:84"/>
Nov 29 06:07:05 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:07:05 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:07:05 user nova-compute[75083]:       <target dev="tap47704c3e-14"/>
Nov 29 06:07:05 user nova-compute[75083]:     </interface>
Nov 29 06:07:05 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:07:05 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/console.log" append="off"/>
Nov 29 06:07:05 user nova-compute[75083]:     </serial>
Nov 29 06:07:05 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:07:05 user nova-compute[75083]:     <video>
Nov 29 06:07:05 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:07:05 user nova-compute[75083]:     </video>
Nov 29 06:07:05 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:07:05 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:07:05 user nova-compute[75083]:     </rng>
Nov 29 06:07:05 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:07:05 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:07:05 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:07:05 user nova-compute[75083]:     </memballoon>
Nov 29 06:07:05 user nova-compute[75083]:   </devices>
Nov 29 06:07:05 user nova-compute[75083]: </domain>
Nov 29 06:07:05 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:07:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-310275406',display_name='tempest-AttachVolumeNegativeTest-server-310275406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-310275406',id=36,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwO16J1BNGOs59eXS2n/ZewLJHA3SebviIYOU8K/grbKzn9lfd5MraNBbyylWWBxEfsXW7Q7sJ0vNsln+EOu2DB4uIxdtIinnHb/EevPOE7AXMhCOc+k/Oj8MwftDviLg==',key_name='tempest-keypair-720654791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112a98f04dc141dfbb0f7a10fd410cae',ramdisk_id='',reservation_id='r-fcj12pt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1387142425',owner_user_name='tempest-AttachVolumeNegativeTest-1387142425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dc42da0ede8433a827629a68e691658',uuid=13099ea1-93dc-4424-b0cf-fbaaf39aaeab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47704c3e-14b2-4aff-a773-c92babf49bde", "address": "fa:16:3e:0e:e2:84", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47704c3e-14", "ovs_interfaceid": "47704c3e-14b2-4aff-a773-c92babf49bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converting VIF {"id": "47704c3e-14b2-4aff-a773-c92babf49bde", "address": "fa:16:3e:0e:e2:84", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47704c3e-14", "ovs_interfaceid": "47704c3e-14b2-4aff-a773-c92babf49bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:e2:84,bridge_name='br-int',has_traffic_filtering=True,id=47704c3e-14b2-4aff-a773-c92babf49bde,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47704c3e-14') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG os_vif [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:e2:84,bridge_name='br-int',has_traffic_filtering=True,id=47704c3e-14b2-4aff-a773-c92babf49bde,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47704c3e-14') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b34424d-6975-503d-8b64-93748d577430', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47704c3e-14, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47704c3e-14, col_values=(('qos', UUID('e0011c31-90c5-4122-bbd8-a9f413f95cda')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47704c3e-14, col_values=(('external_ids', {'iface-id': '47704c3e-14b2-4aff-a773-c92babf49bde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:e2:84', 'vm-uuid': '13099ea1-93dc-4424-b0cf-fbaaf39aaeab'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:05 user nova-compute[75083]: INFO os_vif [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:e2:84,bridge_name='br-int',has_traffic_filtering=True,id=47704c3e-14b2-4aff-a773-c92babf49bde,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47704c3e-14')
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:07:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] No VIF found with MAC fa:16:3e:0e:e2:84, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:07:06 user nova-compute[75083]: DEBUG nova.network.neutron [req-3d6530d6-9048-4bc0-a156-a35d4e11549c req-1bc01bf5-1958-4f5f-aa87-85cd0d3a14e0 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Updated VIF entry in instance network info cache for port 47704c3e-14b2-4aff-a773-c92babf49bde. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:07:06 user nova-compute[75083]: DEBUG nova.network.neutron [req-3d6530d6-9048-4bc0-a156-a35d4e11549c req-1bc01bf5-1958-4f5f-aa87-85cd0d3a14e0 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Updating instance_info_cache with network_info: [{"id": "47704c3e-14b2-4aff-a773-c92babf49bde", "address": "fa:16:3e:0e:e2:84", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47704c3e-14", "ovs_interfaceid": "47704c3e-14b2-4aff-a773-c92babf49bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:07:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3d6530d6-9048-4bc0-a156-a35d4e11549c req-1bc01bf5-1958-4f5f-aa87-85cd0d3a14e0 service nova] Releasing lock "refresh_cache-13099ea1-93dc-4424-b0cf-fbaaf39aaeab" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:07:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:07 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:07 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:07 user nova-compute[75083]: DEBUG nova.compute.manager [req-44da12d0-d51e-4d96-bd94-41477501af2b req-31bf838c-69cb-4e0e-a5f6-1102dd8248c3 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Received event network-vif-plugged-47704c3e-14b2-4aff-a773-c92babf49bde {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:07:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-44da12d0-d51e-4d96-bd94-41477501af2b req-31bf838c-69cb-4e0e-a5f6-1102dd8248c3 service nova] Acquiring lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-44da12d0-d51e-4d96-bd94-41477501af2b req-31bf838c-69cb-4e0e-a5f6-1102dd8248c3 service nova] Lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-44da12d0-d51e-4d96-bd94-41477501af2b req-31bf838c-69cb-4e0e-a5f6-1102dd8248c3 service nova] Lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:07:07 user nova-compute[75083]: DEBUG nova.compute.manager [req-44da12d0-d51e-4d96-bd94-41477501af2b req-31bf838c-69cb-4e0e-a5f6-1102dd8248c3 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] No waiting events found dispatching network-vif-plugged-47704c3e-14b2-4aff-a773-c92babf49bde {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:07:07 user nova-compute[75083]: WARNING nova.compute.manager [req-44da12d0-d51e-4d96-bd94-41477501af2b req-31bf838c-69cb-4e0e-a5f6-1102dd8248c3 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Received unexpected event network-vif-plugged-47704c3e-14b2-4aff-a773-c92babf49bde for instance with vm_state building and task_state spawning.
Nov 29 06:07:07 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:07 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:07 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:07 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:08 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:07:09 user nova-compute[75083]: DEBUG nova.compute.manager [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:07:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:07:09 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Instance spawned successfully.
Nov 29 06:07:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:07:09 user nova-compute[75083]: DEBUG nova.compute.manager [req-7f208f0c-4813-4e31-b545-2f831599243a req-43eb42cb-6e18-4a03-a7de-cab4130369f5 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Received event network-vif-plugged-47704c3e-14b2-4aff-a773-c92babf49bde {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:07:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7f208f0c-4813-4e31-b545-2f831599243a req-43eb42cb-6e18-4a03-a7de-cab4130369f5 service nova] Acquiring lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7f208f0c-4813-4e31-b545-2f831599243a req-43eb42cb-6e18-4a03-a7de-cab4130369f5 service nova] Lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7f208f0c-4813-4e31-b545-2f831599243a req-43eb42cb-6e18-4a03-a7de-cab4130369f5 service nova] Lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:07:09 user nova-compute[75083]: DEBUG nova.compute.manager [req-7f208f0c-4813-4e31-b545-2f831599243a req-43eb42cb-6e18-4a03-a7de-cab4130369f5 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] No waiting events found dispatching network-vif-plugged-47704c3e-14b2-4aff-a773-c92babf49bde {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:07:09 user nova-compute[75083]: WARNING nova.compute.manager [req-7f208f0c-4813-4e31-b545-2f831599243a req-43eb42cb-6e18-4a03-a7de-cab4130369f5 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Received unexpected event network-vif-plugged-47704c3e-14b2-4aff-a773-c92babf49bde for instance with vm_state building and task_state spawning.
Nov 29 06:07:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:07:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:07:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:07:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:07:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:07:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:07:09 user nova-compute[75083]: INFO nova.compute.manager [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 29 06:07:09 user nova-compute[75083]: DEBUG nova.compute.manager [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:07:09 user nova-compute[75083]: INFO nova.compute.manager [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Took 6.74 seconds to build instance.
Nov 29 06:07:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5d663bc6-2d33-4cea-a77c-593a9e520837 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.852s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:07:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:10 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:07:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:13 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:07:13 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:07:13 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:07:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "4778c1d7-7248-4449-9743-56d95aab658a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "4778c1d7-7248-4449-9743-56d95aab658a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:15 user nova-compute[75083]: DEBUG nova.compute.manager [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:07:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:15 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:07:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:15 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:07:15 user nova-compute[75083]: INFO nova.compute.claims [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Claim successful on node user
Nov 29 06:07:15 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Refreshing inventories for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 06:07:15 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Updating ProviderTree inventory for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 06:07:15 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Updating inventory in ProviderTree for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 06:07:15 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Refreshing aggregate associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, aggregates: None {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 06:07:15 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Refreshing trait associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, traits: HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 06:07:16 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:07:16 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:07:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.673s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:07:16 user nova-compute[75083]: DEBUG nova.compute.manager [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:07:16 user nova-compute[75083]: DEBUG nova.compute.manager [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:07:16 user nova-compute[75083]: DEBUG nova.network.neutron [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:07:16 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:07:16 user nova-compute[75083]: DEBUG nova.compute.manager [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:07:16 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:07:16 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:07:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:07:16 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:07:16 user nova-compute[75083]: DEBUG nova.policy [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb526efdda0c4ca2ba8e739ecbe9e148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0801cbd66c8457b887d383721d95915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:07:16 user nova-compute[75083]: DEBUG nova.compute.manager [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:07:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:07:16 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Creating image(s)
Nov 29 06:07:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "/opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "/opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "/opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:07:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "4db62da88214c3226b11bb98526997a3d3834466" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "4db62da88214c3226b11bb98526997a3d3834466" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4db62da88214c3226b11bb98526997a3d3834466.part --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:07:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4db62da88214c3226b11bb98526997a3d3834466.part --force-share --output=json" returned: 0 in 0.220s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:17 user nova-compute[75083]: DEBUG nova.virt.images [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] 3369687c-be1f-4764-a66e-a30d90e3560a was qcow2, converting to raw {{(pid=75083) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 06:07:17 user nova-compute[75083]: DEBUG nova.privsep.utils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75083) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 06:07:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4db62da88214c3226b11bb98526997a3d3834466.part /opt/stack/data/nova/instances/_base/4db62da88214c3226b11bb98526997a3d3834466.converted {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:17 user nova-compute[75083]: DEBUG nova.network.neutron [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Successfully created port: f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:07:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:07:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4db62da88214c3226b11bb98526997a3d3834466.part /opt/stack/data/nova/instances/_base/4db62da88214c3226b11bb98526997a3d3834466.converted" returned: 0 in 0.466s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4db62da88214c3226b11bb98526997a3d3834466.converted --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4db62da88214c3226b11bb98526997a3d3834466.converted --force-share --output=json" returned: 0 in 0.260s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "4db62da88214c3226b11bb98526997a3d3834466" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.607s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4db62da88214c3226b11bb98526997a3d3834466 --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4db62da88214c3226b11bb98526997a3d3834466 --force-share --output=json" returned: 0 in 0.195s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "4db62da88214c3226b11bb98526997a3d3834466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "4db62da88214c3226b11bb98526997a3d3834466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4db62da88214c3226b11bb98526997a3d3834466 --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG nova.network.neutron [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Successfully updated port: f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquired lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG nova.network.neutron [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-6b2e1298-6696-4a6e-8932-39700189d093 req-c6b8de6f-f985-4da5-a76b-4e82d3cafd1f service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received event network-changed-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-6b2e1298-6696-4a6e-8932-39700189d093 req-c6b8de6f-f985-4da5-a76b-4e82d3cafd1f service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Refreshing instance network info cache due to event network-changed-f6e12473-48ac-49f8-ac20-12a3d9e59a56. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6b2e1298-6696-4a6e-8932-39700189d093 req-c6b8de6f-f985-4da5-a76b-4e82d3cafd1f service nova] Acquiring lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG nova.network.neutron [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4db62da88214c3226b11bb98526997a3d3834466 --force-share --output=json" returned: 0 in 0.209s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4db62da88214c3226b11bb98526997a3d3834466,backing_fmt=raw /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4db62da88214c3226b11bb98526997a3d3834466,backing_fmt=raw /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk 1073741824" returned: 0 in 0.067s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "4db62da88214c3226b11bb98526997a3d3834466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4db62da88214c3226b11bb98526997a3d3834466 --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4db62da88214c3226b11bb98526997a3d3834466 --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 06:07:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.network.neutron [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Updating instance_info_cache with network_info: [{"id": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "address": "fa:16:3e:b2:03:18", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e12473-48", "ovs_interfaceid": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Cannot resize image /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Ensure instance console log exists: /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Releasing lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.compute.manager [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Instance network_info: |[{"id": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "address": "fa:16:3e:b2:03:18", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e12473-48", "ovs_interfaceid": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6b2e1298-6696-4a6e-8932-39700189d093 req-c6b8de6f-f985-4da5-a76b-4e82d3cafd1f service nova] Acquired lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.network.neutron [req-6b2e1298-6696-4a6e-8932-39700189d093 req-c6b8de6f-f985-4da5-a76b-4e82d3cafd1f service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Refreshing network info cache for port f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Start _get_guest_xml network_info=[{"id": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "address": "fa:16:3e:b2:03:18", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e12473-48", "ovs_interfaceid": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T06:07:12Z,direct_url=<?>,disk_format='qcow2',id=3369687c-be1f-4764-a66e-a30d90e3560a,min_disk=0,min_ram=0,name='tempest-scenario-img--606983220',owner='f0801cbd66c8457b887d383721d95915',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T06:07:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '3369687c-be1f-4764-a66e-a30d90e3560a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:07:19 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:07:19 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T06:07:12Z,direct_url=<?>,disk_format='qcow2',id=3369687c-be1f-4764-a66e-a30d90e3560a,min_disk=0,min_ram=0,name='tempest-scenario-img--606983220',owner='f0801cbd66c8457b887d383721d95915',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T06:07:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1196933813',display_name='tempest-TestMinimumBasicScenario-server-1196933813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1196933813',id=37,image_ref='3369687c-be1f-4764-a66e-a30d90e3560a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNX5DKDRwMOdT2gJ7zxJs99EoHSy7Ya/opoGPgZqjC3/D2mNeldvd8HQ3YuuVj1eMJIrbJ2TTot5Ys4Uh6Fg/WjBS34zl9yNXEoKlsVjbAM0EeJPyfspLxNeUO2WZE1WmA==',key_name='tempest-TestMinimumBasicScenario-235294968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0801cbd66c8457b887d383721d95915',ramdisk_id='',reservation_id='r-h363mm50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3369687c-be1f-4764-a66e-a30d90e3560a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2019017585',owner_user_name='tempest-TestMinimumBasicScenario-2019017585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:07:17Z,user_data=None,user_id='eb526efdda0c4ca2ba8e739ecbe9e148',uuid=4778c1d7-7248-4449-9743-56d95aab658a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "address": "fa:16:3e:b2:03:18", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e12473-48", "ovs_interfaceid": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Converting VIF {"id": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "address": "fa:16:3e:b2:03:18", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e12473-48", "ovs_interfaceid": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:03:18,bridge_name='br-int',has_traffic_filtering=True,id=f6e12473-48ac-49f8-ac20-12a3d9e59a56,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e12473-48') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.objects.instance [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lazy-loading 'pci_devices' on Instance uuid 4778c1d7-7248-4449-9743-56d95aab658a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:07:19 user nova-compute[75083]:   <uuid>4778c1d7-7248-4449-9743-56d95aab658a</uuid>
Nov 29 06:07:19 user nova-compute[75083]:   <name>instance-00000025</name>
Nov 29 06:07:19 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:07:19 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:07:19 user nova-compute[75083]:   <metadata>
Nov 29 06:07:19 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:07:19 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:07:19 user nova-compute[75083]:       <nova:name>tempest-TestMinimumBasicScenario-server-1196933813</nova:name>
Nov 29 06:07:19 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:07:19</nova:creationTime>
Nov 29 06:07:19 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:07:19 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:07:19 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:07:19 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:07:19 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:07:19 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:07:19 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:07:19 user nova-compute[75083]:       <nova:owner>
Nov 29 06:07:19 user nova-compute[75083]:         <nova:user uuid="eb526efdda0c4ca2ba8e739ecbe9e148">tempest-TestMinimumBasicScenario-2019017585-project-member</nova:user>
Nov 29 06:07:19 user nova-compute[75083]:         <nova:project uuid="f0801cbd66c8457b887d383721d95915">tempest-TestMinimumBasicScenario-2019017585</nova:project>
Nov 29 06:07:19 user nova-compute[75083]:       </nova:owner>
Nov 29 06:07:19 user nova-compute[75083]:       <nova:root type="image" uuid="3369687c-be1f-4764-a66e-a30d90e3560a"/>
Nov 29 06:07:19 user nova-compute[75083]:       <nova:ports>
Nov 29 06:07:19 user nova-compute[75083]:         <nova:port uuid="f6e12473-48ac-49f8-ac20-12a3d9e59a56">
Nov 29 06:07:19 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 06:07:19 user nova-compute[75083]:         </nova:port>
Nov 29 06:07:19 user nova-compute[75083]:       </nova:ports>
Nov 29 06:07:19 user nova-compute[75083]:     </nova:instance>
Nov 29 06:07:19 user nova-compute[75083]:   </metadata>
Nov 29 06:07:19 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:07:19 user nova-compute[75083]:     <system>
Nov 29 06:07:19 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:07:19 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:07:19 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:07:19 user nova-compute[75083]:       <entry name="serial">4778c1d7-7248-4449-9743-56d95aab658a</entry>
Nov 29 06:07:19 user nova-compute[75083]:       <entry name="uuid">4778c1d7-7248-4449-9743-56d95aab658a</entry>
Nov 29 06:07:19 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:07:19 user nova-compute[75083]:     </system>
Nov 29 06:07:19 user nova-compute[75083]:   </sysinfo>
Nov 29 06:07:19 user nova-compute[75083]:   <os>
Nov 29 06:07:19 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:07:19 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:07:19 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:07:19 user nova-compute[75083]:   </os>
Nov 29 06:07:19 user nova-compute[75083]:   <features>
Nov 29 06:07:19 user nova-compute[75083]:     <acpi/>
Nov 29 06:07:19 user nova-compute[75083]:     <apic/>
Nov 29 06:07:19 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:07:19 user nova-compute[75083]:   </features>
Nov 29 06:07:19 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:07:19 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:07:19 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:07:19 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:07:19 user nova-compute[75083]:   </clock>
Nov 29 06:07:19 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:07:19 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:07:19 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:07:19 user nova-compute[75083]:   </cpu>
Nov 29 06:07:19 user nova-compute[75083]:   <devices>
Nov 29 06:07:19 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:07:19 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:07:19 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk"/>
Nov 29 06:07:19 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:07:19 user nova-compute[75083]:     </disk>
Nov 29 06:07:19 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:07:19 user nova-compute[75083]:       <mac address="fa:16:3e:b2:03:18"/>
Nov 29 06:07:19 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:07:19 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:07:19 user nova-compute[75083]:       <target dev="tapf6e12473-48"/>
Nov 29 06:07:19 user nova-compute[75083]:     </interface>
Nov 29 06:07:19 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:07:19 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/console.log" append="off"/>
Nov 29 06:07:19 user nova-compute[75083]:     </serial>
Nov 29 06:07:19 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:07:19 user nova-compute[75083]:     <video>
Nov 29 06:07:19 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:07:19 user nova-compute[75083]:     </video>
Nov 29 06:07:19 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:07:19 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:07:19 user nova-compute[75083]:     </rng>
Nov 29 06:07:19 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:07:19 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:07:19 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:07:19 user nova-compute[75083]:     </memballoon>
Nov 29 06:07:19 user nova-compute[75083]:   </devices>
Nov 29 06:07:19 user nova-compute[75083]: </domain>
Nov 29 06:07:19 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1196933813',display_name='tempest-TestMinimumBasicScenario-server-1196933813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1196933813',id=37,image_ref='3369687c-be1f-4764-a66e-a30d90e3560a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNX5DKDRwMOdT2gJ7zxJs99EoHSy7Ya/opoGPgZqjC3/D2mNeldvd8HQ3YuuVj1eMJIrbJ2TTot5Ys4Uh6Fg/WjBS34zl9yNXEoKlsVjbAM0EeJPyfspLxNeUO2WZE1WmA==',key_name='tempest-TestMinimumBasicScenario-235294968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0801cbd66c8457b887d383721d95915',ramdisk_id='',reservation_id='r-h363mm50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3369687c-be1f-4764-a66e-a30d90e3560a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2019017585',owner_user_name='tempest-TestMinimumBasicScenario-2019017585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:07:17Z,user_data=None,user_id='eb526efdda0c4ca2ba8e739ecbe9e148',uuid=4778c1d7-7248-4449-9743-56d95aab658a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "address": "fa:16:3e:b2:03:18", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e12473-48", "ovs_interfaceid": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Converting VIF {"id": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "address": "fa:16:3e:b2:03:18", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e12473-48", "ovs_interfaceid": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:03:18,bridge_name='br-int',has_traffic_filtering=True,id=f6e12473-48ac-49f8-ac20-12a3d9e59a56,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e12473-48') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG os_vif [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:03:18,bridge_name='br-int',has_traffic_filtering=True,id=f6e12473-48ac-49f8-ac20-12a3d9e59a56,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e12473-48') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f9f538c-60df-5abc-915d-9b82b2978c9f', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6e12473-48, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6e12473-48, col_values=(('qos', UUID('67b8e24d-3fcc-4bb1-88e7-f129707e8e53')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6e12473-48, col_values=(('external_ids', {'iface-id': 'f6e12473-48ac-49f8-ac20-12a3d9e59a56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:03:18', 'vm-uuid': '4778c1d7-7248-4449-9743-56d95aab658a'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:07:19 user nova-compute[75083]: INFO os_vif [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:03:18,bridge_name='br-int',has_traffic_filtering=True,id=f6e12473-48ac-49f8-ac20-12a3d9e59a56,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e12473-48')
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] No VIF found with MAC fa:16:3e:b2:03:18, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:20 user nova-compute[75083]: DEBUG nova.network.neutron [req-6b2e1298-6696-4a6e-8932-39700189d093 req-c6b8de6f-f985-4da5-a76b-4e82d3cafd1f service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Updated VIF entry in instance network info cache for port f6e12473-48ac-49f8-ac20-12a3d9e59a56. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:07:20 user nova-compute[75083]: DEBUG nova.network.neutron [req-6b2e1298-6696-4a6e-8932-39700189d093 req-c6b8de6f-f985-4da5-a76b-4e82d3cafd1f service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Updating instance_info_cache with network_info: [{"id": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "address": "fa:16:3e:b2:03:18", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e12473-48", "ovs_interfaceid": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:07:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6b2e1298-6696-4a6e-8932-39700189d093 req-c6b8de6f-f985-4da5-a76b-4e82d3cafd1f service nova] Releasing lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:07:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.manager [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-a72f960d-71e4-4a05-ad53-c18460e6b4a2 req-ca01db8c-68d7-4ecb-a172-56e4592205bc service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received event network-vif-plugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a72f960d-71e4-4a05-ad53-c18460e6b4a2 req-ca01db8c-68d7-4ecb-a172-56e4592205bc service nova] Acquiring lock "4778c1d7-7248-4449-9743-56d95aab658a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a72f960d-71e4-4a05-ad53-c18460e6b4a2 req-ca01db8c-68d7-4ecb-a172-56e4592205bc service nova] Lock "4778c1d7-7248-4449-9743-56d95aab658a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a72f960d-71e4-4a05-ad53-c18460e6b4a2 req-ca01db8c-68d7-4ecb-a172-56e4592205bc service nova] Lock "4778c1d7-7248-4449-9743-56d95aab658a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-a72f960d-71e4-4a05-ad53-c18460e6b4a2 req-ca01db8c-68d7-4ecb-a172-56e4592205bc service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] No waiting events found dispatching network-vif-plugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:07:23 user nova-compute[75083]: WARNING nova.compute.manager [req-a72f960d-71e4-4a05-ad53-c18460e6b4a2 req-ca01db8c-68d7-4ecb-a172-56e4592205bc service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received unexpected event network-vif-plugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 for instance with vm_state building and task_state spawning.
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-a4a46c42-fdc4-48c7-95e8-1c132f7b6cff req-2fd3eed7-ba6b-48a8-abc5-4b605d408a6d service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received event network-vif-plugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a4a46c42-fdc4-48c7-95e8-1c132f7b6cff req-2fd3eed7-ba6b-48a8-abc5-4b605d408a6d service nova] Acquiring lock "4778c1d7-7248-4449-9743-56d95aab658a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a4a46c42-fdc4-48c7-95e8-1c132f7b6cff req-2fd3eed7-ba6b-48a8-abc5-4b605d408a6d service nova] Lock "4778c1d7-7248-4449-9743-56d95aab658a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a4a46c42-fdc4-48c7-95e8-1c132f7b6cff req-2fd3eed7-ba6b-48a8-abc5-4b605d408a6d service nova] Lock "4778c1d7-7248-4449-9743-56d95aab658a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-a4a46c42-fdc4-48c7-95e8-1c132f7b6cff req-2fd3eed7-ba6b-48a8-abc5-4b605d408a6d service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] No waiting events found dispatching network-vif-plugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:07:23 user nova-compute[75083]: WARNING nova.compute.manager [req-a4a46c42-fdc4-48c7-95e8-1c132f7b6cff req-2fd3eed7-ba6b-48a8-abc5-4b605d408a6d service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received unexpected event network-vif-plugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 for instance with vm_state building and task_state spawning.
Nov 29 06:07:23 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:07:23 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8111MB free_disk=25.073562622070312GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:23 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Instance spawned successfully.
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:07:23 user nova-compute[75083]: INFO nova.compute.manager [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Took 6.84 seconds to spawn the instance on the hypervisor.
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.manager [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4435ed78-e35f-4859-8a4f-9920815d968a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a34d9d98-be73-4d52-85f0-83e48f60bc12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fea64bdc-491c-46ba-9447-c175df432deb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance f1a6ae72-f187-4558-a164-49c436e886ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance ae1fbde4-f353-4e9f-ba98-14217e97e370 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 13099ea1-93dc-4424-b0cf-fbaaf39aaeab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4778c1d7-7248-4449-9743-56d95aab658a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:07:23 user nova-compute[75083]: INFO nova.compute.manager [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Took 8.03 seconds to build instance.
Nov 29 06:07:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-27dfea3e-471d-4b15-a58f-fd4f570d6e9e tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "4778c1d7-7248-4449-9743-56d95aab658a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.141s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] There are 0 instances to clean {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75083) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 06:07:23 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:07:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:25 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:07:25 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:07:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:07:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:07:26 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:07:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:26 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Updating instance_info_cache with network_info: [{"id": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "address": "fa:16:3e:8a:f0:ed", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb2c35d-ef", "ovs_interfaceid": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:07:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:07:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:07:26 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:07:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:36 user nova-compute[75083]: DEBUG nova.compute.manager [req-123fcf58-563e-4859-892d-d746170b5e38 req-9be82392-46dd-4435-871d-cefe291f773e service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Received event network-changed-ea463ac1-ea4e-4840-9c9f-2d9ab99e2963 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:07:36 user nova-compute[75083]: DEBUG nova.compute.manager [req-123fcf58-563e-4859-892d-d746170b5e38 req-9be82392-46dd-4435-871d-cefe291f773e service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Refreshing instance network info cache due to event network-changed-ea463ac1-ea4e-4840-9c9f-2d9ab99e2963. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:07:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-123fcf58-563e-4859-892d-d746170b5e38 req-9be82392-46dd-4435-871d-cefe291f773e service nova] Acquiring lock "refresh_cache-ae1fbde4-f353-4e9f-ba98-14217e97e370" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:07:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-123fcf58-563e-4859-892d-d746170b5e38 req-9be82392-46dd-4435-871d-cefe291f773e service nova] Acquired lock "refresh_cache-ae1fbde4-f353-4e9f-ba98-14217e97e370" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:07:36 user nova-compute[75083]: DEBUG nova.network.neutron [req-123fcf58-563e-4859-892d-d746170b5e38 req-9be82392-46dd-4435-871d-cefe291f773e service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Refreshing network info cache for port ea463ac1-ea4e-4840-9c9f-2d9ab99e2963 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:07:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:36 user nova-compute[75083]: DEBUG nova.network.neutron [req-123fcf58-563e-4859-892d-d746170b5e38 req-9be82392-46dd-4435-871d-cefe291f773e service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Updated VIF entry in instance network info cache for port ea463ac1-ea4e-4840-9c9f-2d9ab99e2963. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:07:36 user nova-compute[75083]: DEBUG nova.network.neutron [req-123fcf58-563e-4859-892d-d746170b5e38 req-9be82392-46dd-4435-871d-cefe291f773e service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Updating instance_info_cache with network_info: [{"id": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "address": "fa:16:3e:7c:f1:4a", "network": {"id": "99b916bd-4b75-423b-a157-f73e647d7440", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852369892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47937ed2be51456b840d797378c3e520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea463ac1-ea", "ovs_interfaceid": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:07:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-123fcf58-563e-4859-892d-d746170b5e38 req-9be82392-46dd-4435-871d-cefe291f773e service nova] Releasing lock "refresh_cache-ae1fbde4-f353-4e9f-ba98-14217e97e370" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:07:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:37 user nova-compute[75083]: DEBUG nova.objects.instance [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lazy-loading 'flavor' on Instance uuid ae1fbde4-f353-4e9f-ba98-14217e97e370 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:07:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:38 user nova-compute[75083]: INFO nova.compute.manager [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Attaching volume c1c1efe2-4836-4bb2-949d-b17cbeabd73c to /dev/vdb
Nov 29 06:07:38 user nova-compute[75083]: DEBUG os_brick.utils [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda123c1-48cd-4615-8d2e-406cbf6ce965]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[301bb2b5-a283-4e51-b982-67577ef8ed57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a7389d-cc52-4483-ab12-e2cd800b678d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca23a23d-667b-48c3-b437-08fe26c86f8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:07:38 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:07:38 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b4c709-5fbd-4ee9-a12f-1d99ca8f54fe]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG os_brick.utils [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:07:38 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Updating existing volume attachment record: 27fc478d-0827-4c51-ad04-592d360ea34e {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:07:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qhGeJIcO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:07:45 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:07:45 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:07:45 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6e99c5-190a-4c77-8294-2617f54ed1fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:07:45 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd1c06c-60aa-43b1-9810-b15552146a50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c] added
Nov 29 06:07:45 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baf6e13-1be7-4e0a-a666-967507b638e8]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2c3466-a48b-48b3-9d05-0cef55222ddb]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qhGeJIcO {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qhGeJIcO" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[24356b2a-9f1e-4e7b-8a3c-6141db4f351c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qhGeJIcO'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1d8f6e-7ffd-458c-80fd-6c3c373be6dc]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[68924881-0c15-463e-8813-6b153632d8ce]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:07:45 user nova-compute[75083]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)
Nov 29 06:07:45 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:07:45 user nova-compute[75083]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)
Nov 29 06:07:45 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3150426a-56d7-4752-bd99-7a80486b6e4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c, portal: 172.16.0.220,3260]
Nov 29 06:07:45 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c, portal: 172.16.0.220,3260] successful.
Nov 29 06:07:45 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[352b4f4f-d590-4b2e-a926-ac0b41f136f9]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[20186f18-8255-4d7d-b16b-f1e9b1ec44c3]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:07:45 user nova-compute[75083]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)
Nov 29 06:07:45 user nova-compute[75083]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)
Nov 29 06:07:45 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:07:45 user nova-compute[75083]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)
Nov 29 06:07:45 user nova-compute[75083]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)
Nov 29 06:07:45 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df3ec51-c915-47cd-a724-ab35e98808ac]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:07:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qhGeJIcO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:07:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:07:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23738633539636264', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:07:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738633539636264', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:07:46 user nova-compute[75083]: DEBUG nova.objects.instance [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lazy-loading 'flavor' on Instance uuid ae1fbde4-f353-4e9f-ba98-14217e97e370 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:07:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 06:07:46 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:07:46 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:07:46 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:07:46 user nova-compute[75083]:   <serial>c1c1efe2-4836-4bb2-949d-b17cbeabd73c</serial>
Nov 29 06:07:46 user nova-compute[75083]: </disk>
Nov 29 06:07:46 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 06:07:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:07:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:07:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] No VIF found with MAC fa:16:3e:7c:f1:4a, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:07:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-11cb1256-65dc-4b9e-8088-d1e441333da5 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.425s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:07:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:50 user nova-compute[75083]: DEBUG nova.objects.instance [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lazy-loading 'flavor' on Instance uuid ae1fbde4-f353-4e9f-ba98-14217e97e370 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:07:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:07:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:07:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:07:50 user nova-compute[75083]: INFO nova.compute.manager [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Attaching volume 96b8e829-a752-4aee-afce-28e792e367d4 to /dev/vdc
Nov 29 06:07:50 user nova-compute[75083]: DEBUG os_brick.utils [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:07:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:50 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b102af-6bd5-485e-8def-9b72faa1a06d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:50 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[86749b2f-26d7-4b19-ba7a-53bb94eabc1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:50 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cd94c7-75c5-4da8-9cf7-01c814fde70f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:50 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffd5334-fa55-4686-94bb-d9768926c819]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:07:50 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:07:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:07:51 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:07:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2b6c5b-4f80-4f3a-ae2f-212d030d13c6]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:07:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:07:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:07:51 user nova-compute[75083]: DEBUG os_brick.utils [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:07:51 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Updating existing volume attachment record: cde64ba2-1040-4d35-922f-2bd3d4896e80 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:07:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aiunbDzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:07:58 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:07:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:07:58 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:07:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:07:58 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5a5dc6-52f2-4d02-b643-d5d9afb4e784]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:07:58 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1f8c4f-bcff-45a5-8d35-05b145f088c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4] added
Nov 29 06:07:58 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3df7d9b-9871-49c7-b442-79ebd7051143]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9db72d-6951-4f4d-9ddf-60c4599983a4]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aiunbDzC {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aiunbDzC" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[891c84bf-bae5-403e-8dbd-9369b092bc95]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aiunbDzC'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d2202f-5a3c-47df-95ea-3fc9d7d295b8]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1660f025-5b98-4fac-b6ae-10ddf158e4d4]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:07:58 user nova-compute[75083]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)
Nov 29 06:07:58 user nova-compute[75083]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)
Nov 29 06:07:58 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:07:58 user nova-compute[75083]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)
Nov 29 06:07:58 user nova-compute[75083]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)
Nov 29 06:07:58 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:07:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf83e42-7f92-4c6b-a139-95b0925d6d52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4, portal: 172.16.0.220,3260]
Nov 29 06:07:59 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4, portal: 172.16.0.220,3260] successful.
Nov 29 06:07:59 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f670ffa9-9003-426e-9bb9-5144ec33c87e]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[48226e42-6753-4002-a6b7-dd3db4cc8615]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:07:59 user nova-compute[75083]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)
Nov 29 06:07:59 user nova-compute[75083]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)
Nov 29 06:07:59 user nova-compute[75083]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 (non-flash)
Nov 29 06:07:59 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:07:59 user nova-compute[75083]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)
Nov 29 06:07:59 user nova-compute[75083]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)
Nov 29 06:07:59 user nova-compute[75083]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 (non-flash)
Nov 29 06:07:59 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f27b03a-7b8c-4405-96b6-e8452ddf79c7]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aiunbDzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:07:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:08:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23164386230373532', 'path': '/dev/sde'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:08:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164386230373532', 'path': '/dev/sde'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:08:00 user nova-compute[75083]: DEBUG nova.objects.instance [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lazy-loading 'flavor' on Instance uuid ae1fbde4-f353-4e9f-ba98-14217e97e370 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:08:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 06:08:00 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:08:00 user nova-compute[75083]:   <source dev="/dev/sde"/>
Nov 29 06:08:00 user nova-compute[75083]:   <target dev="vdc" bus="virtio"/>
Nov 29 06:08:00 user nova-compute[75083]:   <serial>96b8e829-a752-4aee-afce-28e792e367d4</serial>
Nov 29 06:08:00 user nova-compute[75083]: </disk>
Nov 29 06:08:00 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 06:08:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:08:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:08:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:08:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] No VIF found with MAC fa:16:3e:7c:f1:4a, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:08:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-af2935a2-4afb-4241-b3e3-3e838d89ae99 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.855s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:08:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:01 user nova-compute[75083]: INFO nova.compute.manager [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Detaching volume 96b8e829-a752-4aee-afce-28e792e367d4
Nov 29 06:08:01 user nova-compute[75083]: INFO nova.virt.block_device [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Attempting to driver detach volume 96b8e829-a752-4aee-afce-28e792e367d4 from mountpoint /dev/vdc
Nov 29 06:08:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Attempting to detach device vdc from instance ae1fbde4-f353-4e9f-ba98-14217e97e370 from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 06:08:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:08:01 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:08:01 user nova-compute[75083]:   <source dev="/dev/sde"/>
Nov 29 06:08:01 user nova-compute[75083]:   <target dev="vdc" bus="virtio"/>
Nov 29 06:08:01 user nova-compute[75083]:   <serial>96b8e829-a752-4aee-afce-28e792e367d4</serial>
Nov 29 06:08:01 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 06:08:01 user nova-compute[75083]: </disk>
Nov 29 06:08:01 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:08:01 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Successfully detached device vdc from instance ae1fbde4-f353-4e9f-ba98-14217e97e370 from the persistent domain config.
Nov 29 06:08:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ae1fbde4-f353-4e9f-ba98-14217e97e370 from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 06:08:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:08:01 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:08:01 user nova-compute[75083]:   <source dev="/dev/sde"/>
Nov 29 06:08:01 user nova-compute[75083]:   <target dev="vdc" bus="virtio"/>
Nov 29 06:08:01 user nova-compute[75083]:   <serial>96b8e829-a752-4aee-afce-28e792e367d4</serial>
Nov 29 06:08:01 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 06:08:01 user nova-compute[75083]: </disk>
Nov 29 06:08:01 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:08:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ae1fbde4-f353-4e9f-ba98-14217e97e370 {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 06:08:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:08:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:08:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:08:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:08:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:08:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:09 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:08:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:12 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:08:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:08:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:08:12 user nova-compute[75083]: INFO nova.compute.claims [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Claim successful on node user
Nov 29 06:08:13 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:08:13 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:08:13 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG nova.policy [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4145bf5a07ea4d398f1a1e10a976c10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47694ecf400b4d6c952d0c06d0764d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:08:13 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Creating image(s)
Nov 29 06:08:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "/opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "/opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "/opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.186s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.185s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk 1073741824" returned: 0 in 0.052s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Successfully created port: f38c71e9-810f-4add-b8cb-1a41f2146304 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 06:08:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Cannot resize image /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Ensure instance console log exists: /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Successfully updated port: f38c71e9-810f-4add-b8cb-1a41f2146304 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "refresh_cache-be4598f6-6ee2-4219-b8a2-446ba87b2efd" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquired lock "refresh_cache-be4598f6-6ee2-4219-b8a2-446ba87b2efd" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.compute.manager [req-ce0b4965-703c-4ee9-aafd-158708f48a81 req-012eeb68-8414-491a-8276-7ee3364c221f service nova] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Received event network-changed-f38c71e9-810f-4add-b8cb-1a41f2146304 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.compute.manager [req-ce0b4965-703c-4ee9-aafd-158708f48a81 req-012eeb68-8414-491a-8276-7ee3364c221f service nova] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Refreshing instance network info cache due to event network-changed-f38c71e9-810f-4add-b8cb-1a41f2146304. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ce0b4965-703c-4ee9-aafd-158708f48a81 req-012eeb68-8414-491a-8276-7ee3364c221f service nova] Acquiring lock "refresh_cache-be4598f6-6ee2-4219-b8a2-446ba87b2efd" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Updating instance_info_cache with network_info: [{"id": "f38c71e9-810f-4add-b8cb-1a41f2146304", "address": "fa:16:3e:70:3d:40", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38c71e9-81", "ovs_interfaceid": "f38c71e9-810f-4add-b8cb-1a41f2146304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Releasing lock "refresh_cache-be4598f6-6ee2-4219-b8a2-446ba87b2efd" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Instance network_info: |[{"id": "f38c71e9-810f-4add-b8cb-1a41f2146304", "address": "fa:16:3e:70:3d:40", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38c71e9-81", "ovs_interfaceid": "f38c71e9-810f-4add-b8cb-1a41f2146304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ce0b4965-703c-4ee9-aafd-158708f48a81 req-012eeb68-8414-491a-8276-7ee3364c221f service nova] Acquired lock "refresh_cache-be4598f6-6ee2-4219-b8a2-446ba87b2efd" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.network.neutron [req-ce0b4965-703c-4ee9-aafd-158708f48a81 req-012eeb68-8414-491a-8276-7ee3364c221f service nova] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Refreshing network info cache for port f38c71e9-810f-4add-b8cb-1a41f2146304 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Start _get_guest_xml network_info=[{"id": "f38c71e9-810f-4add-b8cb-1a41f2146304", "address": "fa:16:3e:70:3d:40", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38c71e9-81", "ovs_interfaceid": "f38c71e9-810f-4add-b8cb-1a41f2146304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:08:14 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:08:14 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:08:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-484206354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-484206354',id=38,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47694ecf400b4d6c952d0c06d0764d1b',ramdisk_id='',reservation_id='r-3kp8h4me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:08:13Z,user_data=None,user_id='4145bf5a07ea4d398f1a1e10a976c10f',uuid=be4598f6-6ee2-4219-b8a2-446ba87b2efd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f38c71e9-810f-4add-b8cb-1a41f2146304", "address": "fa:16:3e:70:3d:40", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38c71e9-81", "ovs_interfaceid": "f38c71e9-810f-4add-b8cb-1a41f2146304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converting VIF {"id": "f38c71e9-810f-4add-b8cb-1a41f2146304", "address": "fa:16:3e:70:3d:40", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38c71e9-81", "ovs_interfaceid": "f38c71e9-810f-4add-b8cb-1a41f2146304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:3d:40,bridge_name='br-int',has_traffic_filtering=True,id=f38c71e9-810f-4add-b8cb-1a41f2146304,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38c71e9-81') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.objects.instance [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'pci_devices' on Instance uuid be4598f6-6ee2-4219-b8a2-446ba87b2efd {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:08:14 user nova-compute[75083]:   <uuid>be4598f6-6ee2-4219-b8a2-446ba87b2efd</uuid>
Nov 29 06:08:14 user nova-compute[75083]:   <name>instance-00000026</name>
Nov 29 06:08:14 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:08:14 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:08:14 user nova-compute[75083]:   <metadata>
Nov 29 06:08:14 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:08:14 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:08:14 user nova-compute[75083]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-484206354</nova:name>
Nov 29 06:08:14 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:08:14</nova:creationTime>
Nov 29 06:08:14 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:08:14 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:08:14 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:08:14 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:08:14 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:08:14 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:08:14 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:08:14 user nova-compute[75083]:       <nova:owner>
Nov 29 06:08:14 user nova-compute[75083]:         <nova:user uuid="4145bf5a07ea4d398f1a1e10a976c10f">tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member</nova:user>
Nov 29 06:08:14 user nova-compute[75083]:         <nova:project uuid="47694ecf400b4d6c952d0c06d0764d1b">tempest-ServerBootFromVolumeStableRescueTest-1530350051</nova:project>
Nov 29 06:08:14 user nova-compute[75083]:       </nova:owner>
Nov 29 06:08:14 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 06:08:14 user nova-compute[75083]:       <nova:ports>
Nov 29 06:08:14 user nova-compute[75083]:         <nova:port uuid="f38c71e9-810f-4add-b8cb-1a41f2146304">
Nov 29 06:08:14 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 06:08:14 user nova-compute[75083]:         </nova:port>
Nov 29 06:08:14 user nova-compute[75083]:       </nova:ports>
Nov 29 06:08:14 user nova-compute[75083]:     </nova:instance>
Nov 29 06:08:14 user nova-compute[75083]:   </metadata>
Nov 29 06:08:14 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:08:14 user nova-compute[75083]:     <system>
Nov 29 06:08:14 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:08:14 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:08:14 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:08:14 user nova-compute[75083]:       <entry name="serial">be4598f6-6ee2-4219-b8a2-446ba87b2efd</entry>
Nov 29 06:08:14 user nova-compute[75083]:       <entry name="uuid">be4598f6-6ee2-4219-b8a2-446ba87b2efd</entry>
Nov 29 06:08:14 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:08:14 user nova-compute[75083]:     </system>
Nov 29 06:08:14 user nova-compute[75083]:   </sysinfo>
Nov 29 06:08:14 user nova-compute[75083]:   <os>
Nov 29 06:08:14 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:08:14 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:08:14 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:08:14 user nova-compute[75083]:   </os>
Nov 29 06:08:14 user nova-compute[75083]:   <features>
Nov 29 06:08:14 user nova-compute[75083]:     <acpi/>
Nov 29 06:08:14 user nova-compute[75083]:     <apic/>
Nov 29 06:08:14 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:08:14 user nova-compute[75083]:   </features>
Nov 29 06:08:14 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:08:14 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:08:14 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:08:14 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:08:14 user nova-compute[75083]:   </clock>
Nov 29 06:08:14 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:08:14 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:08:14 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:08:14 user nova-compute[75083]:   </cpu>
Nov 29 06:08:14 user nova-compute[75083]:   <devices>
Nov 29 06:08:14 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:08:14 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:08:14 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk"/>
Nov 29 06:08:14 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:08:14 user nova-compute[75083]:     </disk>
Nov 29 06:08:14 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:08:14 user nova-compute[75083]:       <mac address="fa:16:3e:70:3d:40"/>
Nov 29 06:08:14 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:08:14 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:08:14 user nova-compute[75083]:       <target dev="tapf38c71e9-81"/>
Nov 29 06:08:14 user nova-compute[75083]:     </interface>
Nov 29 06:08:14 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:08:14 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/console.log" append="off"/>
Nov 29 06:08:14 user nova-compute[75083]:     </serial>
Nov 29 06:08:14 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:08:14 user nova-compute[75083]:     <video>
Nov 29 06:08:14 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:08:14 user nova-compute[75083]:     </video>
Nov 29 06:08:14 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:08:14 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:08:14 user nova-compute[75083]:     </rng>
Nov 29 06:08:14 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:08:14 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:08:14 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:08:14 user nova-compute[75083]:     </memballoon>
Nov 29 06:08:14 user nova-compute[75083]:   </devices>
Nov 29 06:08:14 user nova-compute[75083]: </domain>
Nov 29 06:08:14 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:08:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-484206354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-484206354',id=38,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47694ecf400b4d6c952d0c06d0764d1b',ramdisk_id='',reservation_id='r-3kp8h4me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:08:13Z,user_data=None,user_id='4145bf5a07ea4d398f1a1e10a976c10f',uuid=be4598f6-6ee2-4219-b8a2-446ba87b2efd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f38c71e9-810f-4add-b8cb-1a41f2146304", "address": "fa:16:3e:70:3d:40", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38c71e9-81", "ovs_interfaceid": "f38c71e9-810f-4add-b8cb-1a41f2146304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converting VIF {"id": "f38c71e9-810f-4add-b8cb-1a41f2146304", "address": "fa:16:3e:70:3d:40", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38c71e9-81", "ovs_interfaceid": "f38c71e9-810f-4add-b8cb-1a41f2146304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:3d:40,bridge_name='br-int',has_traffic_filtering=True,id=f38c71e9-810f-4add-b8cb-1a41f2146304,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38c71e9-81') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG os_vif [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:3d:40,bridge_name='br-int',has_traffic_filtering=True,id=f38c71e9-810f-4add-b8cb-1a41f2146304,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38c71e9-81') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2eb4b1bf-ea21-50c7-950b-163ff63ad835', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf38c71e9-81, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf38c71e9-81, col_values=(('qos', UUID('fc84cdbf-2ea5-48b4-b3d6-8d44688ab82e')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf38c71e9-81, col_values=(('external_ids', {'iface-id': 'f38c71e9-810f-4add-b8cb-1a41f2146304', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:3d:40', 'vm-uuid': 'be4598f6-6ee2-4219-b8a2-446ba87b2efd'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:08:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:14 user nova-compute[75083]: INFO os_vif [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:3d:40,bridge_name='br-int',has_traffic_filtering=True,id=f38c71e9-810f-4add-b8cb-1a41f2146304,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38c71e9-81')
Nov 29 06:08:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:08:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] No VIF found with MAC fa:16:3e:70:3d:40, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:08:15 user nova-compute[75083]: DEBUG nova.network.neutron [req-ce0b4965-703c-4ee9-aafd-158708f48a81 req-012eeb68-8414-491a-8276-7ee3364c221f service nova] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Updated VIF entry in instance network info cache for port f38c71e9-810f-4add-b8cb-1a41f2146304. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:08:15 user nova-compute[75083]: DEBUG nova.network.neutron [req-ce0b4965-703c-4ee9-aafd-158708f48a81 req-012eeb68-8414-491a-8276-7ee3364c221f service nova] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Updating instance_info_cache with network_info: [{"id": "f38c71e9-810f-4add-b8cb-1a41f2146304", "address": "fa:16:3e:70:3d:40", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38c71e9-81", "ovs_interfaceid": "f38c71e9-810f-4add-b8cb-1a41f2146304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:08:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ce0b4965-703c-4ee9-aafd-158708f48a81 req-012eeb68-8414-491a-8276-7ee3364c221f service nova] Releasing lock "refresh_cache-be4598f6-6ee2-4219-b8a2-446ba87b2efd" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:08:15 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:08:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:16 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:08:16 user nova-compute[75083]: DEBUG nova.compute.manager [req-22e151e9-1e56-4164-80c9-d817227f2e4e req-85c3ff54-cc72-46a3-8131-9043839064ba service nova] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Received event network-vif-plugged-f38c71e9-810f-4add-b8cb-1a41f2146304 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:08:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-22e151e9-1e56-4164-80c9-d817227f2e4e req-85c3ff54-cc72-46a3-8131-9043839064ba service nova] Acquiring lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-22e151e9-1e56-4164-80c9-d817227f2e4e req-85c3ff54-cc72-46a3-8131-9043839064ba service nova] Lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-22e151e9-1e56-4164-80c9-d817227f2e4e req-85c3ff54-cc72-46a3-8131-9043839064ba service nova] Lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:08:16 user nova-compute[75083]: DEBUG nova.compute.manager [req-22e151e9-1e56-4164-80c9-d817227f2e4e req-85c3ff54-cc72-46a3-8131-9043839064ba service nova] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] No waiting events found dispatching network-vif-plugged-f38c71e9-810f-4add-b8cb-1a41f2146304 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:08:16 user nova-compute[75083]: WARNING nova.compute.manager [req-22e151e9-1e56-4164-80c9-d817227f2e4e req-85c3ff54-cc72-46a3-8131-9043839064ba service nova] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Received unexpected event network-vif-plugged-f38c71e9-810f-4add-b8cb-1a41f2146304 for instance with vm_state building and task_state spawning.
Nov 29 06:08:18 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:08:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:08:18 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Instance spawned successfully.
Nov 29 06:08:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:08:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:08:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:08:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:08:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:08:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:08:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:08:18 user nova-compute[75083]: INFO nova.compute.manager [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 29 06:08:18 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:08:18 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:08:18 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:08:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:08:18 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:08:18 user nova-compute[75083]: INFO nova.compute.manager [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Took 5.95 seconds to build instance.
Nov 29 06:08:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef34385d-cd8f-4ca0-aec1-2b4b07b972bd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.063s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:08:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-e757594d-e68b-485d-8ab8-e26387a6314a req-17d569bc-cbed-495f-b81c-15599b774320 service nova] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Received event network-vif-plugged-f38c71e9-810f-4add-b8cb-1a41f2146304 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:08:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e757594d-e68b-485d-8ab8-e26387a6314a req-17d569bc-cbed-495f-b81c-15599b774320 service nova] Acquiring lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e757594d-e68b-485d-8ab8-e26387a6314a req-17d569bc-cbed-495f-b81c-15599b774320 service nova] Lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e757594d-e68b-485d-8ab8-e26387a6314a req-17d569bc-cbed-495f-b81c-15599b774320 service nova] Lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:08:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-e757594d-e68b-485d-8ab8-e26387a6314a req-17d569bc-cbed-495f-b81c-15599b774320 service nova] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] No waiting events found dispatching network-vif-plugged-f38c71e9-810f-4add-b8cb-1a41f2146304 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:08:18 user nova-compute[75083]: WARNING nova.compute.manager [req-e757594d-e68b-485d-8ab8-e26387a6314a req-17d569bc-cbed-495f-b81c-15599b774320 service nova] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Received unexpected event network-vif-plugged-f38c71e9-810f-4add-b8cb-1a41f2146304 for instance with vm_state active and task_state None.
Nov 29 06:08:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:08:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:08:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:08:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:22 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance ae1fbde4-f353-4e9f-ba98-14217e97e370 is timed out.
Nov 29 06:08:22 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Successfully detached device vdc from instance ae1fbde4-f353-4e9f-ba98-14217e97e370 from the live domain config.
Nov 29 06:08:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aiunbDzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:08:22 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:08:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba78c35-cc6b-4f14-a044-86b32129c718]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:08:22 user nova-compute[75083]: No targets found.
Nov 29 06:08:22 user nova-compute[75083]: iSNS:
Nov 29 06:08:22 user nova-compute[75083]: No targets found.
Nov 29 06:08:22 user nova-compute[75083]: STATIC:
Nov 29 06:08:22 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856
Nov 29 06:08:22 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:08:22 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:08:22 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f
Nov 29 06:08:22 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:08:22 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:08:22 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4
Nov 29 06:08:22 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:08:22 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:08:22 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c
Nov 29 06:08:22 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:08:22 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:08:22 user nova-compute[75083]: FIRMWARE:
Nov 29 06:08:22 user nova-compute[75083]: No targets found.
Nov 29 06:08:22 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:08:22 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:08:22 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b0309b-6e09-4c9f-9a2e-6d32157a90c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d7a9ab-24f1-4aff-bf47-2903f9074b01]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:08:22 user nova-compute[75083]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)
Nov 29 06:08:22 user nova-compute[75083]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)
Nov 29 06:08:22 user nova-compute[75083]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 (non-flash)
Nov 29 06:08:22 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:08:22 user nova-compute[75083]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)
Nov 29 06:08:22 user nova-compute[75083]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)
Nov 29 06:08:22 user nova-compute[75083]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 (non-flash)
Nov 29 06:08:22 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b8172a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4'): ({'sde'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Removing single pathed devices sde {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec4f091-eec0-433b-a40d-dcb2b426175e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:08:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8185bc4-2068-481b-b98b-4fd4e427194f]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Flushing IO for device /dev/sde {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:23 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:08:23 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:08:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8007MB free_disk=24.962703704833984GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0deba6f6-c602-4a7b-b692-934e99883a19]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[947a671a-b27e-4cbe-ab9d-68565ce7cb72]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] SCSI volumes sde have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a0374d-2531-4716-9766-d6a9c7a6dbcf]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfbe8ab-452f-4db1-b602-1f00c2c9423a]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4, portal: 172.16.0.220,3260]
Nov 29 06:08:23 user nova-compute[75083]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4, portal: 172.16.0.220,3260] successful.
Nov 29 06:08:23 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4435ed78-e35f-4859-8a4f-9920815d968a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a34d9d98-be73-4d52-85f0-83e48f60bc12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fea64bdc-491c-46ba-9447-c175df432deb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance f1a6ae72-f187-4558-a164-49c436e886ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance ae1fbde4-f353-4e9f-ba98-14217e97e370 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 13099ea1-93dc-4424-b0cf-fbaaf39aaeab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4778c1d7-7248-4449-9743-56d95aab658a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance be4598f6-6ee2-4219-b8a2-446ba87b2efd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96b8e829-a752-4aee-afce-28e792e367d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3446f5b3-ae5f-4808-bc93-f60ec3395e68]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.841s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] <== disconnect_volume: return (844ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:08:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:08:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:24 user nova-compute[75083]: DEBUG nova.objects.instance [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lazy-loading 'flavor' on Instance uuid ae1fbde4-f353-4e9f-ba98-14217e97e370 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:08:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5ef0c984-bcd8-492c-9693-bd1f15432235 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.364s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:08:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:25 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:08:25 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:08:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:08:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:08:25 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:08:26 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Updating instance_info_cache with network_info: [{"id": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "address": "fa:16:3e:e1:f6:16", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feebf60-26", "ovs_interfaceid": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:08:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:08:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:08:26 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:08:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "08b33e17-334b-4816-bcf6-26a67f132bc1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:34 user nova-compute[75083]: DEBUG nova.compute.manager [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:08:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:34 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:08:34 user nova-compute[75083]: INFO nova.compute.claims [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Claim successful on node user
Nov 29 06:08:35 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:08:35 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:08:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:08:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:08:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:08:35 user nova-compute[75083]: DEBUG nova.network.neutron [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:08:35 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:08:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:08:35 user nova-compute[75083]: DEBUG nova.policy [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67f54a8c7ddf47e2b386fb54427ea74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ff233f7ca74890b5f100ed01b943b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:08:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:08:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:08:35 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Creating image(s)
Nov 29 06:08:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "/opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "/opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "/opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:08:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.189s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk 1073741824" returned: 0 in 0.070s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:08:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:36 user nova-compute[75083]: DEBUG nova.network.neutron [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Successfully created port: fe369aec-feeb-4444-a640-012a5b6eb231 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:08:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:36 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 06:08:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:36 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:36 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Cannot resize image /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 06:08:36 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 06:08:36 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Ensure instance console log exists: /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:08:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.network.neutron [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Successfully updated port: fe369aec-feeb-4444-a640-012a5b6eb231 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "refresh_cache-08b33e17-334b-4816-bcf6-26a67f132bc1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquired lock "refresh_cache-08b33e17-334b-4816-bcf6-26a67f132bc1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.network.neutron [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.compute.manager [req-e63de0ec-69b0-4b49-b2bd-9a1165f37881 req-8a1bd9d6-7941-4680-921c-a374e14696a8 service nova] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Received event network-changed-fe369aec-feeb-4444-a640-012a5b6eb231 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.compute.manager [req-e63de0ec-69b0-4b49-b2bd-9a1165f37881 req-8a1bd9d6-7941-4680-921c-a374e14696a8 service nova] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Refreshing instance network info cache due to event network-changed-fe369aec-feeb-4444-a640-012a5b6eb231. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e63de0ec-69b0-4b49-b2bd-9a1165f37881 req-8a1bd9d6-7941-4680-921c-a374e14696a8 service nova] Acquiring lock "refresh_cache-08b33e17-334b-4816-bcf6-26a67f132bc1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.network.neutron [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.network.neutron [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Updating instance_info_cache with network_info: [{"id": "fe369aec-feeb-4444-a640-012a5b6eb231", "address": "fa:16:3e:11:81:6e", "network": {"id": "1c5d3b69-0dc0-44fc-8d62-0e184770a31c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-246603725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ff233f7ca74890b5f100ed01b943b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe369aec-fe", "ovs_interfaceid": "fe369aec-feeb-4444-a640-012a5b6eb231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Releasing lock "refresh_cache-08b33e17-334b-4816-bcf6-26a67f132bc1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.compute.manager [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Instance network_info: |[{"id": "fe369aec-feeb-4444-a640-012a5b6eb231", "address": "fa:16:3e:11:81:6e", "network": {"id": "1c5d3b69-0dc0-44fc-8d62-0e184770a31c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-246603725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ff233f7ca74890b5f100ed01b943b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe369aec-fe", "ovs_interfaceid": "fe369aec-feeb-4444-a640-012a5b6eb231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e63de0ec-69b0-4b49-b2bd-9a1165f37881 req-8a1bd9d6-7941-4680-921c-a374e14696a8 service nova] Acquired lock "refresh_cache-08b33e17-334b-4816-bcf6-26a67f132bc1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.network.neutron [req-e63de0ec-69b0-4b49-b2bd-9a1165f37881 req-8a1bd9d6-7941-4680-921c-a374e14696a8 service nova] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Refreshing network info cache for port fe369aec-feeb-4444-a640-012a5b6eb231 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Start _get_guest_xml network_info=[{"id": "fe369aec-feeb-4444-a640-012a5b6eb231", "address": "fa:16:3e:11:81:6e", "network": {"id": "1c5d3b69-0dc0-44fc-8d62-0e184770a31c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-246603725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ff233f7ca74890b5f100ed01b943b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe369aec-fe", "ovs_interfaceid": "fe369aec-feeb-4444-a640-012a5b6eb231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:08:37 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:08:37 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:08:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-39080786',display_name='tempest-SnapshotDataIntegrityTests-server-39080786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-39080786',id=39,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6jQs3Kut7TxWq2uauoulDgrCuCRVMKegYKDfSzhHH2p48Q15Vkx3Zy65C7CafFPSlWOErU2M7xH7WG6YACf7Kv/2zkdHarZcSIPFbN/OvbGMs2UZAFkE1HHqdEaLlRRw==',key_name='tempest-keypair-398955017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07ff233f7ca74890b5f100ed01b943b6',ramdisk_id='',reservation_id='r-5ag8zeh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-44492845',owner_user_name='tempest-SnapshotDataIntegrityTests-44492845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:08:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f54a8c7ddf47e2b386fb54427ea74c',uuid=08b33e17-334b-4816-bcf6-26a67f132bc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe369aec-feeb-4444-a640-012a5b6eb231", "address": "fa:16:3e:11:81:6e", "network": {"id": "1c5d3b69-0dc0-44fc-8d62-0e184770a31c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-246603725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ff233f7ca74890b5f100ed01b943b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe369aec-fe", "ovs_interfaceid": "fe369aec-feeb-4444-a640-012a5b6eb231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Converting VIF {"id": "fe369aec-feeb-4444-a640-012a5b6eb231", "address": "fa:16:3e:11:81:6e", "network": {"id": "1c5d3b69-0dc0-44fc-8d62-0e184770a31c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-246603725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ff233f7ca74890b5f100ed01b943b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe369aec-fe", "ovs_interfaceid": "fe369aec-feeb-4444-a640-012a5b6eb231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:81:6e,bridge_name='br-int',has_traffic_filtering=True,id=fe369aec-feeb-4444-a640-012a5b6eb231,network=Network(1c5d3b69-0dc0-44fc-8d62-0e184770a31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe369aec-fe') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.objects.instance [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lazy-loading 'pci_devices' on Instance uuid 08b33e17-334b-4816-bcf6-26a67f132bc1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:08:37 user nova-compute[75083]:   <uuid>08b33e17-334b-4816-bcf6-26a67f132bc1</uuid>
Nov 29 06:08:37 user nova-compute[75083]:   <name>instance-00000027</name>
Nov 29 06:08:37 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:08:37 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:08:37 user nova-compute[75083]:   <metadata>
Nov 29 06:08:37 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:08:37 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:08:37 user nova-compute[75083]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-39080786</nova:name>
Nov 29 06:08:37 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:08:37</nova:creationTime>
Nov 29 06:08:37 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:08:37 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:08:37 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:08:37 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:08:37 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:08:37 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:08:37 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:08:37 user nova-compute[75083]:       <nova:owner>
Nov 29 06:08:37 user nova-compute[75083]:         <nova:user uuid="67f54a8c7ddf47e2b386fb54427ea74c">tempest-SnapshotDataIntegrityTests-44492845-project-member</nova:user>
Nov 29 06:08:37 user nova-compute[75083]:         <nova:project uuid="07ff233f7ca74890b5f100ed01b943b6">tempest-SnapshotDataIntegrityTests-44492845</nova:project>
Nov 29 06:08:37 user nova-compute[75083]:       </nova:owner>
Nov 29 06:08:37 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 06:08:37 user nova-compute[75083]:       <nova:ports>
Nov 29 06:08:37 user nova-compute[75083]:         <nova:port uuid="fe369aec-feeb-4444-a640-012a5b6eb231">
Nov 29 06:08:37 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 06:08:37 user nova-compute[75083]:         </nova:port>
Nov 29 06:08:37 user nova-compute[75083]:       </nova:ports>
Nov 29 06:08:37 user nova-compute[75083]:     </nova:instance>
Nov 29 06:08:37 user nova-compute[75083]:   </metadata>
Nov 29 06:08:37 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:08:37 user nova-compute[75083]:     <system>
Nov 29 06:08:37 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:08:37 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:08:37 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:08:37 user nova-compute[75083]:       <entry name="serial">08b33e17-334b-4816-bcf6-26a67f132bc1</entry>
Nov 29 06:08:37 user nova-compute[75083]:       <entry name="uuid">08b33e17-334b-4816-bcf6-26a67f132bc1</entry>
Nov 29 06:08:37 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:08:37 user nova-compute[75083]:     </system>
Nov 29 06:08:37 user nova-compute[75083]:   </sysinfo>
Nov 29 06:08:37 user nova-compute[75083]:   <os>
Nov 29 06:08:37 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:08:37 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:08:37 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:08:37 user nova-compute[75083]:   </os>
Nov 29 06:08:37 user nova-compute[75083]:   <features>
Nov 29 06:08:37 user nova-compute[75083]:     <acpi/>
Nov 29 06:08:37 user nova-compute[75083]:     <apic/>
Nov 29 06:08:37 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:08:37 user nova-compute[75083]:   </features>
Nov 29 06:08:37 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:08:37 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:08:37 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:08:37 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:08:37 user nova-compute[75083]:   </clock>
Nov 29 06:08:37 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:08:37 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:08:37 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:08:37 user nova-compute[75083]:   </cpu>
Nov 29 06:08:37 user nova-compute[75083]:   <devices>
Nov 29 06:08:37 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:08:37 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:08:37 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk"/>
Nov 29 06:08:37 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:08:37 user nova-compute[75083]:     </disk>
Nov 29 06:08:37 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:08:37 user nova-compute[75083]:       <mac address="fa:16:3e:11:81:6e"/>
Nov 29 06:08:37 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:08:37 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:08:37 user nova-compute[75083]:       <target dev="tapfe369aec-fe"/>
Nov 29 06:08:37 user nova-compute[75083]:     </interface>
Nov 29 06:08:37 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:08:37 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/console.log" append="off"/>
Nov 29 06:08:37 user nova-compute[75083]:     </serial>
Nov 29 06:08:37 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:08:37 user nova-compute[75083]:     <video>
Nov 29 06:08:37 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:08:37 user nova-compute[75083]:     </video>
Nov 29 06:08:37 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:08:37 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:08:37 user nova-compute[75083]:     </rng>
Nov 29 06:08:37 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:08:37 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:08:37 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:08:37 user nova-compute[75083]:     </memballoon>
Nov 29 06:08:37 user nova-compute[75083]:   </devices>
Nov 29 06:08:37 user nova-compute[75083]: </domain>
Nov 29 06:08:37 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:08:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-39080786',display_name='tempest-SnapshotDataIntegrityTests-server-39080786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-39080786',id=39,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6jQs3Kut7TxWq2uauoulDgrCuCRVMKegYKDfSzhHH2p48Q15Vkx3Zy65C7CafFPSlWOErU2M7xH7WG6YACf7Kv/2zkdHarZcSIPFbN/OvbGMs2UZAFkE1HHqdEaLlRRw==',key_name='tempest-keypair-398955017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07ff233f7ca74890b5f100ed01b943b6',ramdisk_id='',reservation_id='r-5ag8zeh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-44492845',owner_user_name='tempest-SnapshotDataIntegrityTests-44492845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:08:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f54a8c7ddf47e2b386fb54427ea74c',uuid=08b33e17-334b-4816-bcf6-26a67f132bc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe369aec-feeb-4444-a640-012a5b6eb231", "address": "fa:16:3e:11:81:6e", "network": {"id": "1c5d3b69-0dc0-44fc-8d62-0e184770a31c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-246603725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ff233f7ca74890b5f100ed01b943b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe369aec-fe", "ovs_interfaceid": "fe369aec-feeb-4444-a640-012a5b6eb231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Converting VIF {"id": "fe369aec-feeb-4444-a640-012a5b6eb231", "address": "fa:16:3e:11:81:6e", "network": {"id": "1c5d3b69-0dc0-44fc-8d62-0e184770a31c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-246603725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ff233f7ca74890b5f100ed01b943b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe369aec-fe", "ovs_interfaceid": "fe369aec-feeb-4444-a640-012a5b6eb231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:81:6e,bridge_name='br-int',has_traffic_filtering=True,id=fe369aec-feeb-4444-a640-012a5b6eb231,network=Network(1c5d3b69-0dc0-44fc-8d62-0e184770a31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe369aec-fe') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG os_vif [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:81:6e,bridge_name='br-int',has_traffic_filtering=True,id=fe369aec-feeb-4444-a640-012a5b6eb231,network=Network(1c5d3b69-0dc0-44fc-8d62-0e184770a31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe369aec-fe') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cff9f3c4-99dc-5251-805a-93d8eb57c82c', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe369aec-fe, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe369aec-fe, col_values=(('qos', UUID('9c32c33d-df20-4ab8-9acf-6a4029c27dee')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe369aec-fe, col_values=(('external_ids', {'iface-id': 'fe369aec-feeb-4444-a640-012a5b6eb231', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:81:6e', 'vm-uuid': '08b33e17-334b-4816-bcf6-26a67f132bc1'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:37 user nova-compute[75083]: INFO os_vif [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:81:6e,bridge_name='br-int',has_traffic_filtering=True,id=fe369aec-feeb-4444-a640-012a5b6eb231,network=Network(1c5d3b69-0dc0-44fc-8d62-0e184770a31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe369aec-fe')
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] No VIF found with MAC fa:16:3e:11:81:6e, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.network.neutron [req-e63de0ec-69b0-4b49-b2bd-9a1165f37881 req-8a1bd9d6-7941-4680-921c-a374e14696a8 service nova] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Updated VIF entry in instance network info cache for port fe369aec-feeb-4444-a640-012a5b6eb231. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG nova.network.neutron [req-e63de0ec-69b0-4b49-b2bd-9a1165f37881 req-8a1bd9d6-7941-4680-921c-a374e14696a8 service nova] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Updating instance_info_cache with network_info: [{"id": "fe369aec-feeb-4444-a640-012a5b6eb231", "address": "fa:16:3e:11:81:6e", "network": {"id": "1c5d3b69-0dc0-44fc-8d62-0e184770a31c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-246603725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ff233f7ca74890b5f100ed01b943b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe369aec-fe", "ovs_interfaceid": "fe369aec-feeb-4444-a640-012a5b6eb231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:08:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e63de0ec-69b0-4b49-b2bd-9a1165f37881 req-8a1bd9d6-7941-4680-921c-a374e14696a8 service nova] Releasing lock "refresh_cache-08b33e17-334b-4816-bcf6-26a67f132bc1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:08:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:39 user nova-compute[75083]: DEBUG nova.compute.manager [req-a82734b1-fcb7-4150-ad24-f9884c15e4b1 req-245b3a72-d26f-486f-a451-2e3a03b88153 service nova] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Received event network-vif-plugged-fe369aec-feeb-4444-a640-012a5b6eb231 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:08:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a82734b1-fcb7-4150-ad24-f9884c15e4b1 req-245b3a72-d26f-486f-a451-2e3a03b88153 service nova] Acquiring lock "08b33e17-334b-4816-bcf6-26a67f132bc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a82734b1-fcb7-4150-ad24-f9884c15e4b1 req-245b3a72-d26f-486f-a451-2e3a03b88153 service nova] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a82734b1-fcb7-4150-ad24-f9884c15e4b1 req-245b3a72-d26f-486f-a451-2e3a03b88153 service nova] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:08:39 user nova-compute[75083]: DEBUG nova.compute.manager [req-a82734b1-fcb7-4150-ad24-f9884c15e4b1 req-245b3a72-d26f-486f-a451-2e3a03b88153 service nova] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] No waiting events found dispatching network-vif-plugged-fe369aec-feeb-4444-a640-012a5b6eb231 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:08:39 user nova-compute[75083]: WARNING nova.compute.manager [req-a82734b1-fcb7-4150-ad24-f9884c15e4b1 req-245b3a72-d26f-486f-a451-2e3a03b88153 service nova] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Received unexpected event network-vif-plugged-fe369aec-feeb-4444-a640-012a5b6eb231 for instance with vm_state building and task_state spawning.
Nov 29 06:08:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:41 user nova-compute[75083]: DEBUG nova.compute.manager [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:08:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:08:41 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Instance spawned successfully.
Nov 29 06:08:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:08:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:08:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:08:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:08:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:08:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:08:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:08:41 user nova-compute[75083]: INFO nova.compute.manager [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 29 06:08:41 user nova-compute[75083]: DEBUG nova.compute.manager [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:08:41 user nova-compute[75083]: INFO nova.compute.manager [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Took 6.35 seconds to build instance.
Nov 29 06:08:41 user nova-compute[75083]: DEBUG nova.compute.manager [req-dd75ee2a-361c-4ced-a514-a391f1660848 req-c9095fc5-d7b4-45ee-8f2e-9af1c8d3ab11 service nova] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Received event network-vif-plugged-fe369aec-feeb-4444-a640-012a5b6eb231 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:08:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-dd75ee2a-361c-4ced-a514-a391f1660848 req-c9095fc5-d7b4-45ee-8f2e-9af1c8d3ab11 service nova] Acquiring lock "08b33e17-334b-4816-bcf6-26a67f132bc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-dd75ee2a-361c-4ced-a514-a391f1660848 req-c9095fc5-d7b4-45ee-8f2e-9af1c8d3ab11 service nova] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-dd75ee2a-361c-4ced-a514-a391f1660848 req-c9095fc5-d7b4-45ee-8f2e-9af1c8d3ab11 service nova] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:08:41 user nova-compute[75083]: DEBUG nova.compute.manager [req-dd75ee2a-361c-4ced-a514-a391f1660848 req-c9095fc5-d7b4-45ee-8f2e-9af1c8d3ab11 service nova] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] No waiting events found dispatching network-vif-plugged-fe369aec-feeb-4444-a640-012a5b6eb231 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:08:41 user nova-compute[75083]: WARNING nova.compute.manager [req-dd75ee2a-361c-4ced-a514-a391f1660848 req-c9095fc5-d7b4-45ee-8f2e-9af1c8d3ab11 service nova] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Received unexpected event network-vif-plugged-fe369aec-feeb-4444-a640-012a5b6eb231 for instance with vm_state active and task_state None.
Nov 29 06:08:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-3474817b-119b-47eb-82d6-8b1b32cbd375 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.452s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:08:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-ba813cbe-89d4-40b0-9ee8-3e68a8c4bea5 req-d4201f93-d542-4279-9c2e-1c35e7359b2f service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-changed-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:08:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-ba813cbe-89d4-40b0-9ee8-3e68a8c4bea5 req-d4201f93-d542-4279-9c2e-1c35e7359b2f service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Refreshing instance network info cache due to event network-changed-f90583fd-5231-46cb-9d2b-3534b01e2587. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:08:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ba813cbe-89d4-40b0-9ee8-3e68a8c4bea5 req-d4201f93-d542-4279-9c2e-1c35e7359b2f service nova] Acquiring lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:08:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ba813cbe-89d4-40b0-9ee8-3e68a8c4bea5 req-d4201f93-d542-4279-9c2e-1c35e7359b2f service nova] Acquired lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:08:42 user nova-compute[75083]: DEBUG nova.network.neutron [req-ba813cbe-89d4-40b0-9ee8-3e68a8c4bea5 req-d4201f93-d542-4279-9c2e-1c35e7359b2f service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Refreshing network info cache for port f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:08:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "f1a6ae72-f187-4558-a164-49c436e886ee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:42 user nova-compute[75083]: INFO nova.compute.manager [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Detaching volume 04bed82c-c3fa-4f5f-8218-5b22f296642f
Nov 29 06:08:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:42 user nova-compute[75083]: DEBUG nova.network.neutron [req-ba813cbe-89d4-40b0-9ee8-3e68a8c4bea5 req-d4201f93-d542-4279-9c2e-1c35e7359b2f service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Updated VIF entry in instance network info cache for port f90583fd-5231-46cb-9d2b-3534b01e2587. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:08:42 user nova-compute[75083]: DEBUG nova.network.neutron [req-ba813cbe-89d4-40b0-9ee8-3e68a8c4bea5 req-d4201f93-d542-4279-9c2e-1c35e7359b2f service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Updating instance_info_cache with network_info: [{"id": "f90583fd-5231-46cb-9d2b-3534b01e2587", "address": "fa:16:3e:d7:32:34", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90583fd-52", "ovs_interfaceid": "f90583fd-5231-46cb-9d2b-3534b01e2587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:08:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ba813cbe-89d4-40b0-9ee8-3e68a8c4bea5 req-d4201f93-d542-4279-9c2e-1c35e7359b2f service nova] Releasing lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:08:42 user nova-compute[75083]: INFO nova.virt.block_device [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Attempting to driver detach volume 04bed82c-c3fa-4f5f-8218-5b22f296642f from mountpoint /dev/vdb
Nov 29 06:08:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Attempting to detach device vdb from instance f1a6ae72-f187-4558-a164-49c436e886ee from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 06:08:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:08:42 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:08:42 user nova-compute[75083]:   <source dev="/dev/sdc"/>
Nov 29 06:08:42 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:08:42 user nova-compute[75083]:   <serial>04bed82c-c3fa-4f5f-8218-5b22f296642f</serial>
Nov 29 06:08:42 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:08:42 user nova-compute[75083]: </disk>
Nov 29 06:08:42 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:08:42 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Successfully detached device vdb from instance f1a6ae72-f187-4558-a164-49c436e886ee from the persistent domain config.
Nov 29 06:08:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f1a6ae72-f187-4558-a164-49c436e886ee from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 06:08:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:08:42 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:08:42 user nova-compute[75083]:   <source dev="/dev/sdc"/>
Nov 29 06:08:42 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:08:42 user nova-compute[75083]:   <serial>04bed82c-c3fa-4f5f-8218-5b22f296642f</serial>
Nov 29 06:08:42 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:08:42 user nova-compute[75083]: </disk>
Nov 29 06:08:42 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:08:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f1a6ae72-f187-4558-a164-49c436e886ee {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 06:08:44 user nova-compute[75083]: DEBUG nova.compute.manager [req-d90459cb-3be3-4041-9e7e-e40de4608be3 req-d396750f-0906-4b24-878b-75f2110cb819 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-changed-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:08:44 user nova-compute[75083]: DEBUG nova.compute.manager [req-d90459cb-3be3-4041-9e7e-e40de4608be3 req-d396750f-0906-4b24-878b-75f2110cb819 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Refreshing instance network info cache due to event network-changed-f90583fd-5231-46cb-9d2b-3534b01e2587. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:08:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d90459cb-3be3-4041-9e7e-e40de4608be3 req-d396750f-0906-4b24-878b-75f2110cb819 service nova] Acquiring lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:08:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d90459cb-3be3-4041-9e7e-e40de4608be3 req-d396750f-0906-4b24-878b-75f2110cb819 service nova] Acquired lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:08:44 user nova-compute[75083]: DEBUG nova.network.neutron [req-d90459cb-3be3-4041-9e7e-e40de4608be3 req-d396750f-0906-4b24-878b-75f2110cb819 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Refreshing network info cache for port f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:08:44 user nova-compute[75083]: DEBUG nova.network.neutron [req-d90459cb-3be3-4041-9e7e-e40de4608be3 req-d396750f-0906-4b24-878b-75f2110cb819 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Updated VIF entry in instance network info cache for port f90583fd-5231-46cb-9d2b-3534b01e2587. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:08:44 user nova-compute[75083]: DEBUG nova.network.neutron [req-d90459cb-3be3-4041-9e7e-e40de4608be3 req-d396750f-0906-4b24-878b-75f2110cb819 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Updating instance_info_cache with network_info: [{"id": "f90583fd-5231-46cb-9d2b-3534b01e2587", "address": "fa:16:3e:d7:32:34", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90583fd-52", "ovs_interfaceid": "f90583fd-5231-46cb-9d2b-3534b01e2587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:08:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d90459cb-3be3-4041-9e7e-e40de4608be3 req-d396750f-0906-4b24-878b-75f2110cb819 service nova] Releasing lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:08:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:52 user nova-compute[75083]: INFO nova.compute.manager [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Detaching volume c1c1efe2-4836-4bb2-949d-b17cbeabd73c
Nov 29 06:08:52 user nova-compute[75083]: INFO nova.virt.block_device [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Attempting to driver detach volume c1c1efe2-4836-4bb2-949d-b17cbeabd73c from mountpoint /dev/vdb
Nov 29 06:08:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Attempting to detach device vdb from instance ae1fbde4-f353-4e9f-ba98-14217e97e370 from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 06:08:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:08:52 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:08:52 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:08:52 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:08:52 user nova-compute[75083]:   <serial>c1c1efe2-4836-4bb2-949d-b17cbeabd73c</serial>
Nov 29 06:08:52 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:08:52 user nova-compute[75083]: </disk>
Nov 29 06:08:52 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:08:52 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Successfully detached device vdb from instance ae1fbde4-f353-4e9f-ba98-14217e97e370 from the persistent domain config.
Nov 29 06:08:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ae1fbde4-f353-4e9f-ba98-14217e97e370 from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 06:08:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:08:52 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:08:52 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:08:52 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:08:52 user nova-compute[75083]:   <serial>c1c1efe2-4836-4bb2-949d-b17cbeabd73c</serial>
Nov 29 06:08:52 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:08:52 user nova-compute[75083]: </disk>
Nov 29 06:08:52 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:08:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ae1fbde4-f353-4e9f-ba98-14217e97e370 {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 06:08:53 user nova-compute[75083]: DEBUG nova.compute.manager [req-92833f0e-30de-4027-b6fb-9bcf77e32c7f req-87b8a48c-dc9c-470f-bb59-ad369a3196b6 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Received event network-changed-47704c3e-14b2-4aff-a773-c92babf49bde {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:08:53 user nova-compute[75083]: DEBUG nova.compute.manager [req-92833f0e-30de-4027-b6fb-9bcf77e32c7f req-87b8a48c-dc9c-470f-bb59-ad369a3196b6 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Refreshing instance network info cache due to event network-changed-47704c3e-14b2-4aff-a773-c92babf49bde. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:08:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-92833f0e-30de-4027-b6fb-9bcf77e32c7f req-87b8a48c-dc9c-470f-bb59-ad369a3196b6 service nova] Acquiring lock "refresh_cache-13099ea1-93dc-4424-b0cf-fbaaf39aaeab" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:08:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-92833f0e-30de-4027-b6fb-9bcf77e32c7f req-87b8a48c-dc9c-470f-bb59-ad369a3196b6 service nova] Acquired lock "refresh_cache-13099ea1-93dc-4424-b0cf-fbaaf39aaeab" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:08:53 user nova-compute[75083]: DEBUG nova.network.neutron [req-92833f0e-30de-4027-b6fb-9bcf77e32c7f req-87b8a48c-dc9c-470f-bb59-ad369a3196b6 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Refreshing network info cache for port 47704c3e-14b2-4aff-a773-c92babf49bde {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:08:54 user nova-compute[75083]: DEBUG nova.network.neutron [req-92833f0e-30de-4027-b6fb-9bcf77e32c7f req-87b8a48c-dc9c-470f-bb59-ad369a3196b6 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Updated VIF entry in instance network info cache for port 47704c3e-14b2-4aff-a773-c92babf49bde. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:08:54 user nova-compute[75083]: DEBUG nova.network.neutron [req-92833f0e-30de-4027-b6fb-9bcf77e32c7f req-87b8a48c-dc9c-470f-bb59-ad369a3196b6 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Updating instance_info_cache with network_info: [{"id": "47704c3e-14b2-4aff-a773-c92babf49bde", "address": "fa:16:3e:0e:e2:84", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47704c3e-14", "ovs_interfaceid": "47704c3e-14b2-4aff-a773-c92babf49bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:08:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-92833f0e-30de-4027-b6fb-9bcf77e32c7f req-87b8a48c-dc9c-470f-bb59-ad369a3196b6 service nova] Releasing lock "refresh_cache-13099ea1-93dc-4424-b0cf-fbaaf39aaeab" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:08:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:08:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:56 user nova-compute[75083]: DEBUG nova.objects.instance [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lazy-loading 'flavor' on Instance uuid 13099ea1-93dc-4424-b0cf-fbaaf39aaeab {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:08:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:08:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:08:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:08:56 user nova-compute[75083]: INFO nova.compute.manager [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Attaching volume 8ddec731-c19e-46dc-9fad-81ae9e3146fe to /dev/vdb
Nov 29 06:08:56 user nova-compute[75083]: DEBUG os_brick.utils [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:08:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:56 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a908fb35-8c54-4165-a075-dcc99098af67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:08:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:56 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[453bce1d-c457-4bc0-9180-384a314ac74f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:08:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:08:56 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e30d516-ff20-4625-bedd-c6688f9827f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:08:56 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25c5a8f-7bbf-46c6-9455-800d8d779079]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:08:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:08:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:08:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:08:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:08:57 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:08:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9a30d2-fb37-493f-94d2-3d56f7bdc298]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:08:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:08:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:08:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:08:57 user nova-compute[75083]: DEBUG os_brick.utils [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:08:57 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Updating existing volume attachment record: d08d1b3d-7465-4077-8c16-a54a39188336 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:08:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:03 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f1a6ae72-f187-4558-a164-49c436e886ee is timed out.
Nov 29 06:09:03 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Successfully detached device vdb from instance f1a6ae72-f187-4558-a164-49c436e886ee from the live domain config.
Nov 29 06:09:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrLRFBOk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:09:03 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:09:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[134cf4f7-1a3b-4e1f-8399-71cf9dfe868f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:09:03 user nova-compute[75083]: No targets found.
Nov 29 06:09:03 user nova-compute[75083]: iSNS:
Nov 29 06:09:03 user nova-compute[75083]: No targets found.
Nov 29 06:09:03 user nova-compute[75083]: STATIC:
Nov 29 06:09:03 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856
Nov 29 06:09:03 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:09:03 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:09:03 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f
Nov 29 06:09:03 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:09:03 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:09:03 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c
Nov 29 06:09:03 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:09:03 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:09:03 user nova-compute[75083]: FIRMWARE:
Nov 29 06:09:03 user nova-compute[75083]: No targets found.
Nov 29 06:09:03 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:09:03 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:09:03 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad128158-6999-479b-852c-104c40b82fd5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[00aa707f-c4b1-433d-9f8f-72d5fe17e528]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:09:03 user nova-compute[75083]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)
Nov 29 06:09:03 user nova-compute[75083]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)
Nov 29 06:09:03 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:09:03 user nova-compute[75083]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f (non-flash)
Nov 29 06:09:03 user nova-compute[75083]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)
Nov 29 06:09:03 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b83268c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f'): ({'sdc'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Removing single pathed devices sdc {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5f87ee-8742-43b4-bcdb-b2f658bc96b5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ee196c-c1a4-4176-994e-920a8bcaa9cc]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Flushing IO for device /dev/sdc {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cebde4-57fa-4340-9354-b53c7b37444c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb7ef7b-7d7a-46ee-afc2-03ba665da81d]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[988484b7-b699-432b-9d80-cf2cfe38f0fa]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ebcf1f-f4e5-41d9-9017-455494001d4a]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f, portal: 172.16.0.220,3260]
Nov 29 06:09:03 user nova-compute[75083]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f, portal: 172.16.0.220,3260] successful.
Nov 29 06:09:03 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bed82c-c3fa-4f5f-8218-5b22f296642f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0f44de-0a05-47f4-99c8-ae1a118f1982]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] <== disconnect_volume: return (309ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:09:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG nova.objects.instance [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'flavor' on Instance uuid f1a6ae72-f187-4558-a164-49c436e886ee {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vodnTrAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:09:04 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:09:04 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:09:04 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d7388f93-6800-48d6-8c26-2bf0f555b484 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "f1a6ae72-f187-4558-a164-49c436e886ee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.794s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb3c9d2-1f87-4e4e-8399-73f508ebabd4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:09:04 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda3b9bd-400e-4717-b1a9-a218ecf6c60f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe] added
Nov 29 06:09:04 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcc82d8-f4d0-4c54-a972-434d35d2f637]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9028dc5-ce9a-4e34-a136-a5c972b23c6c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vodnTrAf {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vodnTrAf" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc10628e-dca1-4c8c-bba6-936056b8e05b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vodnTrAf'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22d5a5e-73cf-479d-9aac-c6d3f6753d78]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadbf538-14d5-4394-8542-20cd172b8801]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:09:04 user nova-compute[75083]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)
Nov 29 06:09:04 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:09:04 user nova-compute[75083]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)
Nov 29 06:09:04 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a608e29c-67e4-4427-a909-32d85886aa38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe, portal: 172.16.0.220,3260]
Nov 29 06:09:04 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe, portal: 172.16.0.220,3260] successful.
Nov 29 06:09:04 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec32571-3e5f-4552-a886-b6ef23dff354]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ece36b-e0b2-45ae-b27a-eb056fe135b9]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:09:04 user nova-compute[75083]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)
Nov 29 06:09:04 user nova-compute[75083]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe (non-flash)
Nov 29 06:09:04 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:09:04 user nova-compute[75083]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)
Nov 29 06:09:04 user nova-compute[75083]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe (non-flash)
Nov 29 06:09:04 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ead0d96-9c4f-4962-bea4-69f638a563c7]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:09:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vodnTrAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:09:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:09:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26264323164396165', 'path': '/dev/sdc'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:09:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264323164396165', 'path': '/dev/sdc'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:09:05 user nova-compute[75083]: DEBUG nova.objects.instance [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lazy-loading 'flavor' on Instance uuid 13099ea1-93dc-4424-b0cf-fbaaf39aaeab {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:09:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 06:09:05 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:09:05 user nova-compute[75083]:   <source dev="/dev/sdc"/>
Nov 29 06:09:05 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:09:05 user nova-compute[75083]:   <serial>8ddec731-c19e-46dc-9fad-81ae9e3146fe</serial>
Nov 29 06:09:05 user nova-compute[75083]: </disk>
Nov 29 06:09:05 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 06:09:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:09:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:09:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] No VIF found with MAC fa:16:3e:0e:e2:84, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:09:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2aa528da-415e-483a-8e24-46d80f07bad6 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.425s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:06 user nova-compute[75083]: INFO nova.compute.manager [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Detaching volume 8ddec731-c19e-46dc-9fad-81ae9e3146fe
Nov 29 06:09:06 user nova-compute[75083]: INFO nova.virt.block_device [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Attempting to driver detach volume 8ddec731-c19e-46dc-9fad-81ae9e3146fe from mountpoint /dev/vdb
Nov 29 06:09:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Attempting to detach device vdb from instance 13099ea1-93dc-4424-b0cf-fbaaf39aaeab from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 06:09:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:09:06 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:09:06 user nova-compute[75083]:   <source dev="/dev/sdc"/>
Nov 29 06:09:06 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:09:06 user nova-compute[75083]:   <serial>8ddec731-c19e-46dc-9fad-81ae9e3146fe</serial>
Nov 29 06:09:06 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:09:06 user nova-compute[75083]: </disk>
Nov 29 06:09:06 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:09:06 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Successfully detached device vdb from instance 13099ea1-93dc-4424-b0cf-fbaaf39aaeab from the persistent domain config.
Nov 29 06:09:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 13099ea1-93dc-4424-b0cf-fbaaf39aaeab from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 06:09:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:09:06 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:09:06 user nova-compute[75083]:   <source dev="/dev/sdc"/>
Nov 29 06:09:06 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:09:06 user nova-compute[75083]:   <serial>8ddec731-c19e-46dc-9fad-81ae9e3146fe</serial>
Nov 29 06:09:06 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:09:06 user nova-compute[75083]: </disk>
Nov 29 06:09:06 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:09:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 13099ea1-93dc-4424-b0cf-fbaaf39aaeab {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 06:09:07 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "4778c1d7-7248-4449-9743-56d95aab658a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "4778c1d7-7248-4449-9743-56d95aab658a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:08 user nova-compute[75083]: DEBUG nova.objects.instance [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lazy-loading 'flavor' on Instance uuid 4778c1d7-7248-4449-9743-56d95aab658a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:09:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "4778c1d7-7248-4449-9743-56d95aab658a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "4778c1d7-7248-4449-9743-56d95aab658a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "4778c1d7-7248-4449-9743-56d95aab658a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:08 user nova-compute[75083]: INFO nova.compute.manager [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Attaching volume aa7c8f31-9b5b-4bd5-9309-903ae880cf4d to /dev/vdb
Nov 29 06:09:08 user nova-compute[75083]: DEBUG os_brick.utils [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:09:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ef9a9d-5460-49b6-b220-be1f31c4178f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80765f7-c887-47b0-9c57-d8433f961973]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda1ea3b-90b9-444c-8f1b-11644b46c3d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc1e66b-571c-489b-b116-20579a9806ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:09:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:09:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:09 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:09:09 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:09:09 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1a7ba7-969c-421e-82fd-4230d641224c]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:09:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:09:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:09:09 user nova-compute[75083]: DEBUG os_brick.utils [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:09:09 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Updating existing volume attachment record: 0a16804a-e2d4-4d56-aab2-32c3df450418 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:09:10 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:09:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:12 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ae1fbde4-f353-4e9f-ba98-14217e97e370 is timed out.
Nov 29 06:09:12 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Successfully detached device vdb from instance ae1fbde4-f353-4e9f-ba98-14217e97e370 from the live domain config.
Nov 29 06:09:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:09:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qhGeJIcO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:09:12 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:09:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:09:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:09:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55a2b95-74ef-4601-b0ec-a933acbb3599]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:09:12 user nova-compute[75083]: No targets found.
Nov 29 06:09:12 user nova-compute[75083]: iSNS:
Nov 29 06:09:12 user nova-compute[75083]: No targets found.
Nov 29 06:09:12 user nova-compute[75083]: STATIC:
Nov 29 06:09:12 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe
Nov 29 06:09:12 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:09:12 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:09:12 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856
Nov 29 06:09:12 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:09:12 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:09:12 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c
Nov 29 06:09:12 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:09:12 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:09:12 user nova-compute[75083]: FIRMWARE:
Nov 29 06:09:12 user nova-compute[75083]: No targets found.
Nov 29 06:09:12 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:09:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:09:12 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:09:12 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:09:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:09:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2241fc6-cb36-43ba-996e-645c300bccc2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7047f79c-bd41-42a4-8ead-5ce70499245c]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:09:13 user nova-compute[75083]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)
Nov 29 06:09:13 user nova-compute[75083]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe (non-flash)
Nov 29 06:09:13 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:09:13 user nova-compute[75083]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c (non-flash)
Nov 29 06:09:13 user nova-compute[75083]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe (non-flash)
Nov 29 06:09:13 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0d84eb0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4eebcf3-cfc3-4b0b-8c7f-cca0dc6535d0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[753c9dbc-9e64-483f-b2ed-de191ef08147]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[373d67a4-01f6-4cb8-b095-e1447c7afe95]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f3de06-cfdc-4aa1-86ff-ba5755f337be]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[46578472-5c9c-4309-8fd0-2b7855eeb71a]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb75a43a-afd0-4be1-9744-6d6f0eeca8a9]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c, portal: 172.16.0.220,3260]
Nov 29 06:09:13 user nova-compute[75083]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c, portal: 172.16.0.220,3260] successful.
Nov 29 06:09:13 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c1efe2-4836-4bb2-949d-b17cbeabd73c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d56c56-fe23-48ac-9cf0-aa630c15ccb4]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] <== disconnect_volume: return (300ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:09:13 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:09:14 user nova-compute[75083]: DEBUG nova.objects.instance [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lazy-loading 'flavor' on Instance uuid ae1fbde4-f353-4e9f-ba98-14217e97e370 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:09:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-54abcede-9e7e-4c73-b79e-ea5ee73bcc93 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.724s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:14 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:09:15 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWfTMkYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:09:16 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:09:16 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:09:16 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e601f314-36c4-45bf-a007-f649e14f7782]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:09:16 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fabfc7-60f5-4239-baae-65a514c75a1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d] added
Nov 29 06:09:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1463661-f0ab-4a47-a621-57e427b0d7ac]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[63970846-8dba-4308-80ac-abb682282fb9]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wWfTMkYn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wWfTMkYn" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4905ca27-9291-412b-b9fb-909aafcbfd20]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wWfTMkYn'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0172c0-62c2-4fd5-83e5-c42dfaab944b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9305e8-4c3e-47f2-93d4-a916dca83b74]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:09:16 user nova-compute[75083]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe (non-flash)
Nov 29 06:09:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:09:16 user nova-compute[75083]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe (non-flash)
Nov 29 06:09:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41714e4-639d-4f9d-a1b7-5dc0b0915272]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d, portal: 172.16.0.220,3260]
Nov 29 06:09:16 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d, portal: 172.16.0.220,3260] successful.
Nov 29 06:09:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d514b67c-dd92-431f-8af4-55bcef805733]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4866db71-6df3-4897-b60c-5a8a21d3877d]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:09:16 user nova-compute[75083]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe (non-flash)
Nov 29 06:09:16 user nova-compute[75083]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)
Nov 29 06:09:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:09:16 user nova-compute[75083]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe (non-flash)
Nov 29 06:09:16 user nova-compute[75083]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)
Nov 29 06:09:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e8eb50-63e0-4d44-936d-9430a9952c1c]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:16 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:09:17 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:09:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWfTMkYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:09:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:09:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23034653464326262', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:09:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034653464326262', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:09:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:09:17 user nova-compute[75083]: DEBUG nova.objects.instance [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lazy-loading 'flavor' on Instance uuid 4778c1d7-7248-4449-9743-56d95aab658a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:09:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 06:09:17 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:09:17 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:09:17 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:09:17 user nova-compute[75083]:   <serial>aa7c8f31-9b5b-4bd5-9309-903ae880cf4d</serial>
Nov 29 06:09:17 user nova-compute[75083]: </disk>
Nov 29 06:09:17 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 06:09:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:09:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:09:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] No VIF found with MAC fa:16:3e:b2:03:18, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:09:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-7d517dfb-51bc-4522-aa06-3c3afbdd81ff tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "4778c1d7-7248-4449-9743-56d95aab658a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.338s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:20 user nova-compute[75083]: DEBUG nova.compute.manager [req-d9d5f621-8b6b-48ae-8b7b-aacf4dc313fd req-4921cdf6-6b6b-424f-a188-32e654db65dd service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received event network-changed-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:09:20 user nova-compute[75083]: DEBUG nova.compute.manager [req-d9d5f621-8b6b-48ae-8b7b-aacf4dc313fd req-4921cdf6-6b6b-424f-a188-32e654db65dd service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Refreshing instance network info cache due to event network-changed-f6e12473-48ac-49f8-ac20-12a3d9e59a56. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:09:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d9d5f621-8b6b-48ae-8b7b-aacf4dc313fd req-4921cdf6-6b6b-424f-a188-32e654db65dd service nova] Acquiring lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:09:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d9d5f621-8b6b-48ae-8b7b-aacf4dc313fd req-4921cdf6-6b6b-424f-a188-32e654db65dd service nova] Acquired lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:09:20 user nova-compute[75083]: DEBUG nova.network.neutron [req-d9d5f621-8b6b-48ae-8b7b-aacf4dc313fd req-4921cdf6-6b6b-424f-a188-32e654db65dd service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Refreshing network info cache for port f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:09:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:20 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:09:20 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:09:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:20 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:09:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:21 user nova-compute[75083]: DEBUG nova.network.neutron [req-d9d5f621-8b6b-48ae-8b7b-aacf4dc313fd req-4921cdf6-6b6b-424f-a188-32e654db65dd service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Updated VIF entry in instance network info cache for port f6e12473-48ac-49f8-ac20-12a3d9e59a56. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:09:21 user nova-compute[75083]: DEBUG nova.network.neutron [req-d9d5f621-8b6b-48ae-8b7b-aacf4dc313fd req-4921cdf6-6b6b-424f-a188-32e654db65dd service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Updating instance_info_cache with network_info: [{"id": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "address": "fa:16:3e:b2:03:18", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e12473-48", "ovs_interfaceid": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:09:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d9d5f621-8b6b-48ae-8b7b-aacf4dc313fd req-4921cdf6-6b6b-424f-a188-32e654db65dd service nova] Releasing lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:09:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:21 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:09:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:21 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:22 user nova-compute[75083]: DEBUG nova.compute.manager [req-0a8436cc-ac96-4f3b-9257-59138e150c05 req-e57e3e07-6faa-4dfb-bc2e-79c782a080a2 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received event network-changed-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:09:22 user nova-compute[75083]: DEBUG nova.compute.manager [req-0a8436cc-ac96-4f3b-9257-59138e150c05 req-e57e3e07-6faa-4dfb-bc2e-79c782a080a2 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Refreshing instance network info cache due to event network-changed-f6e12473-48ac-49f8-ac20-12a3d9e59a56. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:09:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0a8436cc-ac96-4f3b-9257-59138e150c05 req-e57e3e07-6faa-4dfb-bc2e-79c782a080a2 service nova] Acquiring lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:09:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0a8436cc-ac96-4f3b-9257-59138e150c05 req-e57e3e07-6faa-4dfb-bc2e-79c782a080a2 service nova] Acquired lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:09:22 user nova-compute[75083]: DEBUG nova.network.neutron [req-0a8436cc-ac96-4f3b-9257-59138e150c05 req-e57e3e07-6faa-4dfb-bc2e-79c782a080a2 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Refreshing network info cache for port f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:09:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:09:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f29cc010-8937-4b5b-9d2d-280c717f7767 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "4778c1d7-7248-4449-9743-56d95aab658a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f29cc010-8937-4b5b-9d2d-280c717f7767 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "4778c1d7-7248-4449-9743-56d95aab658a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:23 user nova-compute[75083]: INFO nova.compute.manager [None req-f29cc010-8937-4b5b-9d2d-280c717f7767 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Rebooting instance
Nov 29 06:09:23 user nova-compute[75083]: DEBUG nova.network.neutron [req-0a8436cc-ac96-4f3b-9257-59138e150c05 req-e57e3e07-6faa-4dfb-bc2e-79c782a080a2 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Updated VIF entry in instance network info cache for port f6e12473-48ac-49f8-ac20-12a3d9e59a56. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:09:23 user nova-compute[75083]: DEBUG nova.network.neutron [req-0a8436cc-ac96-4f3b-9257-59138e150c05 req-e57e3e07-6faa-4dfb-bc2e-79c782a080a2 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Updating instance_info_cache with network_info: [{"id": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "address": "fa:16:3e:b2:03:18", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e12473-48", "ovs_interfaceid": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:09:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0a8436cc-ac96-4f3b-9257-59138e150c05 req-e57e3e07-6faa-4dfb-bc2e-79c782a080a2 service nova] Releasing lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:09:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f29cc010-8937-4b5b-9d2d-280c717f7767 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:09:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f29cc010-8937-4b5b-9d2d-280c717f7767 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquired lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:09:23 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f29cc010-8937-4b5b-9d2d-280c717f7767 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:09:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:24 user nova-compute[75083]: DEBUG nova.network.neutron [None req-f29cc010-8937-4b5b-9d2d-280c717f7767 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Updating instance_info_cache with network_info: [{"id": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "address": "fa:16:3e:b2:03:18", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e12473-48", "ovs_interfaceid": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:09:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f29cc010-8937-4b5b-9d2d-280c717f7767 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Releasing lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:09:24 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f29cc010-8937-4b5b-9d2d-280c717f7767 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:09:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:24 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:09:24 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:09:24 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=7758MB free_disk=24.895179748535156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:09:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4435ed78-e35f-4859-8a4f-9920815d968a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:09:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a34d9d98-be73-4d52-85f0-83e48f60bc12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:09:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:09:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fea64bdc-491c-46ba-9447-c175df432deb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:09:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance f1a6ae72-f187-4558-a164-49c436e886ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:09:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance ae1fbde4-f353-4e9f-ba98-14217e97e370 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:09:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 13099ea1-93dc-4424-b0cf-fbaaf39aaeab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:09:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4778c1d7-7248-4449-9743-56d95aab658a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:09:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance be4598f6-6ee2-4219-b8a2-446ba87b2efd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:09:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 08b33e17-334b-4816-bcf6-26a67f132bc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:09:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:09:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:09:25 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:09:25 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:09:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:09:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:26 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:09:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:09:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:09:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:09:26 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:09:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-2f4b5efd-5f5b-4a0d-9445-1c0a10977cfe req-85840dec-326b-4c4c-9920-df63ef52a6ef service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received event network-vif-unplugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:09:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2f4b5efd-5f5b-4a0d-9445-1c0a10977cfe req-85840dec-326b-4c4c-9920-df63ef52a6ef service nova] Acquiring lock "4778c1d7-7248-4449-9743-56d95aab658a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2f4b5efd-5f5b-4a0d-9445-1c0a10977cfe req-85840dec-326b-4c4c-9920-df63ef52a6ef service nova] Lock "4778c1d7-7248-4449-9743-56d95aab658a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2f4b5efd-5f5b-4a0d-9445-1c0a10977cfe req-85840dec-326b-4c4c-9920-df63ef52a6ef service nova] Lock "4778c1d7-7248-4449-9743-56d95aab658a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-2f4b5efd-5f5b-4a0d-9445-1c0a10977cfe req-85840dec-326b-4c4c-9920-df63ef52a6ef service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] No waiting events found dispatching network-vif-unplugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:09:26 user nova-compute[75083]: WARNING nova.compute.manager [req-2f4b5efd-5f5b-4a0d-9445-1c0a10977cfe req-85840dec-326b-4c4c-9920-df63ef52a6ef service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received unexpected event network-vif-unplugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 for instance with vm_state active and task_state reboot_started.
Nov 29 06:09:26 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Updating instance_info_cache with network_info: [{"id": "f90583fd-5231-46cb-9d2b-3534b01e2587", "address": "fa:16:3e:d7:32:34", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90583fd-52", "ovs_interfaceid": "f90583fd-5231-46cb-9d2b-3534b01e2587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:09:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-f1a6ae72-f187-4558-a164-49c436e886ee" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:09:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:09:26 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:09:27 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-f29cc010-8937-4b5b-9d2d-280c717f7767 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Instance shutdown successfully.
Nov 29 06:09:27 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 13099ea1-93dc-4424-b0cf-fbaaf39aaeab is timed out.
Nov 29 06:09:27 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Successfully detached device vdb from instance 13099ea1-93dc-4424-b0cf-fbaaf39aaeab from the live domain config.
Nov 29 06:09:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vodnTrAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:09:27 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:09:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca86ddd-77dc-441e-88a6-2425ac954a6e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:09:27 user nova-compute[75083]: No targets found.
Nov 29 06:09:27 user nova-compute[75083]: iSNS:
Nov 29 06:09:27 user nova-compute[75083]: No targets found.
Nov 29 06:09:27 user nova-compute[75083]: STATIC:
Nov 29 06:09:27 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe
Nov 29 06:09:27 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:09:27 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:09:27 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856
Nov 29 06:09:27 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:09:27 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:09:27 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d
Nov 29 06:09:27 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:09:27 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:09:27 user nova-compute[75083]: FIRMWARE:
Nov 29 06:09:27 user nova-compute[75083]: No targets found.
Nov 29 06:09:27 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:09:27 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:09:27 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7524805c-ff96-4234-b5dc-7a6dac5ada38]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5661cde6-9ae7-4906-9503-3963cd22cee6]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:09:27 user nova-compute[75083]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe (non-flash)
Nov 29 06:09:27 user nova-compute[75083]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)
Nov 29 06:09:27 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:09:27 user nova-compute[75083]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe (non-flash)
Nov 29 06:09:27 user nova-compute[75083]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)
Nov 29 06:09:27 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b8171090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe'): ({'sdc'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Removing single pathed devices sdc {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac30c2e-b097-4cfa-8af1-58ea4547dcf2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ab1e1e-64f6-4093-9188-d29eebe6b5ed]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Flushing IO for device /dev/sdc {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[719e7b20-c158-4577-9c93-9bbb881ce968]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2b3bf9-9132-4404-bd12-7d0e7aa0820d]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7e008b-2813-41b9-a570-71ae120244af]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca6f36d-8bc9-48a9-a9e6-81c6b55c93f0]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe, portal: 172.16.0.220,3260]
Nov 29 06:09:27 user nova-compute[75083]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe, portal: 172.16.0.220,3260] successful.
Nov 29 06:09:27 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddec731-c19e-46dc-9fad-81ae9e3146fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a83c65-b0f7-41ca-ae39-6b5bf83ee699]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] <== disconnect_volume: return (299ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:09:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:09:28 user nova-compute[75083]: DEBUG nova.objects.instance [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lazy-loading 'flavor' on Instance uuid 13099ea1-93dc-4424-b0cf-fbaaf39aaeab {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:09:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0de93ecb-58dc-436a-92df-9ee26e0eae12 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.715s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-906fe7f1-f270-4974-9f37-0e1edf874643 req-4e6adca8-4697-4b76-ae64-cbc47f1f99ad service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received event network-vif-plugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:09:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-906fe7f1-f270-4974-9f37-0e1edf874643 req-4e6adca8-4697-4b76-ae64-cbc47f1f99ad service nova] Acquiring lock "4778c1d7-7248-4449-9743-56d95aab658a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-906fe7f1-f270-4974-9f37-0e1edf874643 req-4e6adca8-4697-4b76-ae64-cbc47f1f99ad service nova] Lock "4778c1d7-7248-4449-9743-56d95aab658a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-906fe7f1-f270-4974-9f37-0e1edf874643 req-4e6adca8-4697-4b76-ae64-cbc47f1f99ad service nova] Lock "4778c1d7-7248-4449-9743-56d95aab658a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-906fe7f1-f270-4974-9f37-0e1edf874643 req-4e6adca8-4697-4b76-ae64-cbc47f1f99ad service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] No waiting events found dispatching network-vif-plugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:09:28 user nova-compute[75083]: WARNING nova.compute.manager [req-906fe7f1-f270-4974-9f37-0e1edf874643 req-4e6adca8-4697-4b76-ae64-cbc47f1f99ad service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received unexpected event network-vif-plugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 for instance with vm_state active and task_state reboot_started.
Nov 29 06:09:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:30 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Instance running successfully.
Nov 29 06:09:30 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-f29cc010-8937-4b5b-9d2d-280c717f7767 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Instance soft rebooted successfully.
Nov 29 06:09:30 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f29cc010-8937-4b5b-9d2d-280c717f7767 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:09:30 user nova-compute[75083]: DEBUG nova.compute.manager [req-8817bc97-bf85-4ed4-9436-bd7212ec5dc4 req-87a67af2-e275-49f6-8217-0a1f6ff3e459 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received event network-vif-plugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:09:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8817bc97-bf85-4ed4-9436-bd7212ec5dc4 req-87a67af2-e275-49f6-8217-0a1f6ff3e459 service nova] Acquiring lock "4778c1d7-7248-4449-9743-56d95aab658a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8817bc97-bf85-4ed4-9436-bd7212ec5dc4 req-87a67af2-e275-49f6-8217-0a1f6ff3e459 service nova] Lock "4778c1d7-7248-4449-9743-56d95aab658a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8817bc97-bf85-4ed4-9436-bd7212ec5dc4 req-87a67af2-e275-49f6-8217-0a1f6ff3e459 service nova] Lock "4778c1d7-7248-4449-9743-56d95aab658a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:30 user nova-compute[75083]: DEBUG nova.compute.manager [req-8817bc97-bf85-4ed4-9436-bd7212ec5dc4 req-87a67af2-e275-49f6-8217-0a1f6ff3e459 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] No waiting events found dispatching network-vif-plugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:09:30 user nova-compute[75083]: WARNING nova.compute.manager [req-8817bc97-bf85-4ed4-9436-bd7212ec5dc4 req-87a67af2-e275-49f6-8217-0a1f6ff3e459 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received unexpected event network-vif-plugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 for instance with vm_state active and task_state reboot_started.
Nov 29 06:09:30 user nova-compute[75083]: DEBUG nova.compute.manager [req-8817bc97-bf85-4ed4-9436-bd7212ec5dc4 req-87a67af2-e275-49f6-8217-0a1f6ff3e459 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received event network-vif-plugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:09:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8817bc97-bf85-4ed4-9436-bd7212ec5dc4 req-87a67af2-e275-49f6-8217-0a1f6ff3e459 service nova] Acquiring lock "4778c1d7-7248-4449-9743-56d95aab658a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8817bc97-bf85-4ed4-9436-bd7212ec5dc4 req-87a67af2-e275-49f6-8217-0a1f6ff3e459 service nova] Lock "4778c1d7-7248-4449-9743-56d95aab658a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8817bc97-bf85-4ed4-9436-bd7212ec5dc4 req-87a67af2-e275-49f6-8217-0a1f6ff3e459 service nova] Lock "4778c1d7-7248-4449-9743-56d95aab658a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:30 user nova-compute[75083]: DEBUG nova.compute.manager [req-8817bc97-bf85-4ed4-9436-bd7212ec5dc4 req-87a67af2-e275-49f6-8217-0a1f6ff3e459 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] No waiting events found dispatching network-vif-plugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:09:30 user nova-compute[75083]: WARNING nova.compute.manager [req-8817bc97-bf85-4ed4-9436-bd7212ec5dc4 req-87a67af2-e275-49f6-8217-0a1f6ff3e459 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received unexpected event network-vif-plugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 for instance with vm_state active and task_state reboot_started.
Nov 29 06:09:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f29cc010-8937-4b5b-9d2d-280c717f7767 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "4778c1d7-7248-4449-9743-56d95aab658a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.323s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "f1a6ae72-f187-4558-a164-49c436e886ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:33 user nova-compute[75083]: INFO nova.compute.manager [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Terminating instance
Nov 29 06:09:33 user nova-compute[75083]: DEBUG nova.compute.manager [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG nova.compute.manager [req-649e2d37-0415-4b80-a1b0-0501c4a4bf5a req-47db5003-718b-4276-9445-4af4c67c2062 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-vif-unplugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-649e2d37-0415-4b80-a1b0-0501c4a4bf5a req-47db5003-718b-4276-9445-4af4c67c2062 service nova] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-649e2d37-0415-4b80-a1b0-0501c4a4bf5a req-47db5003-718b-4276-9445-4af4c67c2062 service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-649e2d37-0415-4b80-a1b0-0501c4a4bf5a req-47db5003-718b-4276-9445-4af4c67c2062 service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG nova.compute.manager [req-649e2d37-0415-4b80-a1b0-0501c4a4bf5a req-47db5003-718b-4276-9445-4af4c67c2062 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] No waiting events found dispatching network-vif-unplugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG nova.compute.manager [req-649e2d37-0415-4b80-a1b0-0501c4a4bf5a req-47db5003-718b-4276-9445-4af4c67c2062 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-vif-unplugged-f90583fd-5231-46cb-9d2b-3534b01e2587 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:33 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Instance destroyed successfully.
Nov 29 06:09:33 user nova-compute[75083]: DEBUG nova.objects.instance [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'resources' on Instance uuid f1a6ae72-f187-4558-a164-49c436e886ee {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1004260723',display_name='tempest-ServerRescueNegativeTestJSON-server-1004260723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1004260723',id=34,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIhawOI/53gDum6SY/PSBpY177FAm4dnAbqg4VEZ3EN5udabCTgS3EuhA8Jx9UUHk6GbAtzw7fXtXVsV8VdTHnHKPMSFfkdXUrGjyeJxMAlBjUpmABKze7F5aFFl/ySwg==',key_name='tempest-keypair-92795995',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:05:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7833259e5df546ba86139af68fcb7906',ramdisk_id='',reservation_id='r-yc7x8yds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1120078925',owner_user_name='tempest-ServerRescueNegativeTestJSON-1120078925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:06:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb74d3aef4664ff8bdec4110c6867056',uuid=f1a6ae72-f187-4558-a164-49c436e886ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f90583fd-5231-46cb-9d2b-3534b01e2587", "address": "fa:16:3e:d7:32:34", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90583fd-52", "ovs_interfaceid": "f90583fd-5231-46cb-9d2b-3534b01e2587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converting VIF {"id": "f90583fd-5231-46cb-9d2b-3534b01e2587", "address": "fa:16:3e:d7:32:34", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90583fd-52", "ovs_interfaceid": "f90583fd-5231-46cb-9d2b-3534b01e2587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:32:34,bridge_name='br-int',has_traffic_filtering=True,id=f90583fd-5231-46cb-9d2b-3534b01e2587,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90583fd-52') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG os_vif [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:32:34,bridge_name='br-int',has_traffic_filtering=True,id=f90583fd-5231-46cb-9d2b-3534b01e2587,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90583fd-52') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf90583fd-52, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3b79da8-6374-40c0-8d53-029317517c10) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:09:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:33 user nova-compute[75083]: INFO os_vif [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:32:34,bridge_name='br-int',has_traffic_filtering=True,id=f90583fd-5231-46cb-9d2b-3534b01e2587,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90583fd-52')
Nov 29 06:09:33 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Deleting instance files /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee_del
Nov 29 06:09:33 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Deletion of /opt/stack/data/nova/instances/f1a6ae72-f187-4558-a164-49c436e886ee_del complete
Nov 29 06:09:34 user nova-compute[75083]: INFO nova.compute.manager [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 29 06:09:34 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:09:34 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:09:34 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:09:34 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:09:34 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Took 0.88 seconds to deallocate network for instance.
Nov 29 06:09:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:35 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:09:35 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:09:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:35 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Deleted allocations for instance f1a6ae72-f187-4558-a164-49c436e886ee
Nov 29 06:09:35 user nova-compute[75083]: DEBUG nova.compute.manager [req-0f69ee75-4fbc-405e-b0c9-26c55736c0c7 req-3c56a402-bb23-40c5-b717-1f25857497f3 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:09:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0f69ee75-4fbc-405e-b0c9-26c55736c0c7 req-3c56a402-bb23-40c5-b717-1f25857497f3 service nova] Acquiring lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0f69ee75-4fbc-405e-b0c9-26c55736c0c7 req-3c56a402-bb23-40c5-b717-1f25857497f3 service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0f69ee75-4fbc-405e-b0c9-26c55736c0c7 req-3c56a402-bb23-40c5-b717-1f25857497f3 service nova] Lock "f1a6ae72-f187-4558-a164-49c436e886ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:35 user nova-compute[75083]: DEBUG nova.compute.manager [req-0f69ee75-4fbc-405e-b0c9-26c55736c0c7 req-3c56a402-bb23-40c5-b717-1f25857497f3 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] No waiting events found dispatching network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:09:35 user nova-compute[75083]: WARNING nova.compute.manager [req-0f69ee75-4fbc-405e-b0c9-26c55736c0c7 req-3c56a402-bb23-40c5-b717-1f25857497f3 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received unexpected event network-vif-plugged-f90583fd-5231-46cb-9d2b-3534b01e2587 for instance with vm_state deleted and task_state None.
Nov 29 06:09:35 user nova-compute[75083]: DEBUG nova.compute.manager [req-0f69ee75-4fbc-405e-b0c9-26c55736c0c7 req-3c56a402-bb23-40c5-b717-1f25857497f3 service nova] [instance: f1a6ae72-f187-4558-a164-49c436e886ee] Received event network-vif-deleted-f90583fd-5231-46cb-9d2b-3534b01e2587 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:09:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-0234448d-1756-46c1-9b02-480a4859d16f tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "f1a6ae72-f187-4558-a164-49c436e886ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.409s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "ae1fbde4-f353-4e9f-ba98-14217e97e370-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:42 user nova-compute[75083]: INFO nova.compute.manager [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Terminating instance
Nov 29 06:09:42 user nova-compute[75083]: DEBUG nova.compute.manager [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:09:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-2133df5d-288d-4cae-a0d9-f02b4e16325f req-4cf13678-2abe-4b34-807a-6b4281f16412 service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Received event network-vif-unplugged-ea463ac1-ea4e-4840-9c9f-2d9ab99e2963 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:09:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2133df5d-288d-4cae-a0d9-f02b4e16325f req-4cf13678-2abe-4b34-807a-6b4281f16412 service nova] Acquiring lock "ae1fbde4-f353-4e9f-ba98-14217e97e370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2133df5d-288d-4cae-a0d9-f02b4e16325f req-4cf13678-2abe-4b34-807a-6b4281f16412 service nova] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2133df5d-288d-4cae-a0d9-f02b4e16325f req-4cf13678-2abe-4b34-807a-6b4281f16412 service nova] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-2133df5d-288d-4cae-a0d9-f02b4e16325f req-4cf13678-2abe-4b34-807a-6b4281f16412 service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] No waiting events found dispatching network-vif-unplugged-ea463ac1-ea4e-4840-9c9f-2d9ab99e2963 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:09:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-2133df5d-288d-4cae-a0d9-f02b4e16325f req-4cf13678-2abe-4b34-807a-6b4281f16412 service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Received event network-vif-unplugged-ea463ac1-ea4e-4840-9c9f-2d9ab99e2963 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:09:43 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Instance destroyed successfully.
Nov 29 06:09:43 user nova-compute[75083]: DEBUG nova.objects.instance [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lazy-loading 'resources' on Instance uuid ae1fbde4-f353-4e9f-ba98-14217e97e370 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:09:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:05:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2104024098',display_name='tempest-TestServerVolumeAttachmentScenario-server-2104024098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2104024098',id=35,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGID0tmXzlMqb7NMTyq96BsdvqdeM9eCXJmxraKJv4mfmi38oHjha2FY+g1vvX5JEIoRHZXQU882YG9OpzPYulAdvfZ3ZuBf5WZrzXImI2F1023JhsmFC+XOtXR6kPBAgw==',key_name='tempest-keypair-291706242',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47937ed2be51456b840d797378c3e520',ramdisk_id='',reservation_id='r-2uxe20aa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1544022826',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1544022826-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:05:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a47297b78304d20aae3c1e7660a8e71',uuid=ae1fbde4-f353-4e9f-ba98-14217e97e370,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "address": "fa:16:3e:7c:f1:4a", "network": {"id": "99b916bd-4b75-423b-a157-f73e647d7440", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852369892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47937ed2be51456b840d797378c3e520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea463ac1-ea", "ovs_interfaceid": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:09:43 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Converting VIF {"id": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "address": "fa:16:3e:7c:f1:4a", "network": {"id": "99b916bd-4b75-423b-a157-f73e647d7440", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852369892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47937ed2be51456b840d797378c3e520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea463ac1-ea", "ovs_interfaceid": "ea463ac1-ea4e-4840-9c9f-2d9ab99e2963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:09:43 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:f1:4a,bridge_name='br-int',has_traffic_filtering=True,id=ea463ac1-ea4e-4840-9c9f-2d9ab99e2963,network=Network(99b916bd-4b75-423b-a157-f73e647d7440),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea463ac1-ea') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:09:43 user nova-compute[75083]: DEBUG os_vif [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:f1:4a,bridge_name='br-int',has_traffic_filtering=True,id=ea463ac1-ea4e-4840-9c9f-2d9ab99e2963,network=Network(99b916bd-4b75-423b-a157-f73e647d7440),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea463ac1-ea') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:09:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea463ac1-ea, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:09:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:09:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c81bc60-384c-4c9c-b88e-bf324a76fc6a) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:09:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:09:43 user nova-compute[75083]: INFO os_vif [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:f1:4a,bridge_name='br-int',has_traffic_filtering=True,id=ea463ac1-ea4e-4840-9c9f-2d9ab99e2963,network=Network(99b916bd-4b75-423b-a157-f73e647d7440),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea463ac1-ea')
Nov 29 06:09:43 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Deleting instance files /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370_del
Nov 29 06:09:43 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Deletion of /opt/stack/data/nova/instances/ae1fbde4-f353-4e9f-ba98-14217e97e370_del complete
Nov 29 06:09:43 user nova-compute[75083]: INFO nova.compute.manager [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 06:09:43 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:09:43 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:09:43 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:09:44 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:09:44 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Took 0.98 seconds to deallocate network for instance.
Nov 29 06:09:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:45 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:09:45 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:09:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-4a821dd2-c624-413e-ae77-407051d9dd5a req-07077709-53ec-406a-9a57-a2e43e9ff2e7 service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Received event network-vif-plugged-ea463ac1-ea4e-4840-9c9f-2d9ab99e2963 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:09:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4a821dd2-c624-413e-ae77-407051d9dd5a req-07077709-53ec-406a-9a57-a2e43e9ff2e7 service nova] Acquiring lock "ae1fbde4-f353-4e9f-ba98-14217e97e370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4a821dd2-c624-413e-ae77-407051d9dd5a req-07077709-53ec-406a-9a57-a2e43e9ff2e7 service nova] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4a821dd2-c624-413e-ae77-407051d9dd5a req-07077709-53ec-406a-9a57-a2e43e9ff2e7 service nova] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-4a821dd2-c624-413e-ae77-407051d9dd5a req-07077709-53ec-406a-9a57-a2e43e9ff2e7 service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] No waiting events found dispatching network-vif-plugged-ea463ac1-ea4e-4840-9c9f-2d9ab99e2963 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:09:45 user nova-compute[75083]: WARNING nova.compute.manager [req-4a821dd2-c624-413e-ae77-407051d9dd5a req-07077709-53ec-406a-9a57-a2e43e9ff2e7 service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Received unexpected event network-vif-plugged-ea463ac1-ea4e-4840-9c9f-2d9ab99e2963 for instance with vm_state deleted and task_state None.
Nov 29 06:09:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-4a821dd2-c624-413e-ae77-407051d9dd5a req-07077709-53ec-406a-9a57-a2e43e9ff2e7 service nova] [instance: ae1fbde4-f353-4e9f-ba98-14217e97e370] Received event network-vif-deleted-ea463ac1-ea4e-4840-9c9f-2d9ab99e2963 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:09:45 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Deleted allocations for instance ae1fbde4-f353-4e9f-ba98-14217e97e370
Nov 29 06:09:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-4efa390b-1391-4fc3-a431-cbb0a36a6ad4 tempest-TestServerVolumeAttachmentScenario-1544022826 tempest-TestServerVolumeAttachmentScenario-1544022826-project-member] Lock "ae1fbde4-f353-4e9f-ba98-14217e97e370" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.425s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:57 user nova-compute[75083]: INFO nova.compute.manager [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Terminating instance
Nov 29 06:09:57 user nova-compute[75083]: DEBUG nova.compute.manager [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:09:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-fca70e51-5374-45e2-9909-a42bc0226708 req-22cfffef-d645-483b-8cf2-853ed24aefc9 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Received event network-vif-unplugged-47704c3e-14b2-4aff-a773-c92babf49bde {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:09:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fca70e51-5374-45e2-9909-a42bc0226708 req-22cfffef-d645-483b-8cf2-853ed24aefc9 service nova] Acquiring lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fca70e51-5374-45e2-9909-a42bc0226708 req-22cfffef-d645-483b-8cf2-853ed24aefc9 service nova] Lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-fca70e51-5374-45e2-9909-a42bc0226708 req-22cfffef-d645-483b-8cf2-853ed24aefc9 service nova] Lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-fca70e51-5374-45e2-9909-a42bc0226708 req-22cfffef-d645-483b-8cf2-853ed24aefc9 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] No waiting events found dispatching network-vif-unplugged-47704c3e-14b2-4aff-a773-c92babf49bde {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:09:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-fca70e51-5374-45e2-9909-a42bc0226708 req-22cfffef-d645-483b-8cf2-853ed24aefc9 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Received event network-vif-unplugged-47704c3e-14b2-4aff-a773-c92babf49bde for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:09:58 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Instance destroyed successfully.
Nov 29 06:09:58 user nova-compute[75083]: DEBUG nova.objects.instance [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lazy-loading 'resources' on Instance uuid 13099ea1-93dc-4424-b0cf-fbaaf39aaeab {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:09:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:07:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-310275406',display_name='tempest-AttachVolumeNegativeTest-server-310275406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-310275406',id=36,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwO16J1BNGOs59eXS2n/ZewLJHA3SebviIYOU8K/grbKzn9lfd5MraNBbyylWWBxEfsXW7Q7sJ0vNsln+EOu2DB4uIxdtIinnHb/EevPOE7AXMhCOc+k/Oj8MwftDviLg==',key_name='tempest-keypair-720654791',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:07:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='112a98f04dc141dfbb0f7a10fd410cae',ramdisk_id='',reservation_id='r-fcj12pt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1387142425',owner_user_name='tempest-AttachVolumeNegativeTest-1387142425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:07:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dc42da0ede8433a827629a68e691658',uuid=13099ea1-93dc-4424-b0cf-fbaaf39aaeab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47704c3e-14b2-4aff-a773-c92babf49bde", "address": "fa:16:3e:0e:e2:84", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47704c3e-14", "ovs_interfaceid": "47704c3e-14b2-4aff-a773-c92babf49bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:09:58 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converting VIF {"id": "47704c3e-14b2-4aff-a773-c92babf49bde", "address": "fa:16:3e:0e:e2:84", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47704c3e-14", "ovs_interfaceid": "47704c3e-14b2-4aff-a773-c92babf49bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:09:58 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:e2:84,bridge_name='br-int',has_traffic_filtering=True,id=47704c3e-14b2-4aff-a773-c92babf49bde,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47704c3e-14') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:09:58 user nova-compute[75083]: DEBUG os_vif [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:e2:84,bridge_name='br-int',has_traffic_filtering=True,id=47704c3e-14b2-4aff-a773-c92babf49bde,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47704c3e-14') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:09:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47704c3e-14, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:09:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:09:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0011c31-90c5-4122-bbd8-a9f413f95cda) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:09:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:09:58 user nova-compute[75083]: INFO os_vif [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:e2:84,bridge_name='br-int',has_traffic_filtering=True,id=47704c3e-14b2-4aff-a773-c92babf49bde,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47704c3e-14')
Nov 29 06:09:58 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Deleting instance files /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab_del
Nov 29 06:09:58 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Deletion of /opt/stack/data/nova/instances/13099ea1-93dc-4424-b0cf-fbaaf39aaeab_del complete
Nov 29 06:09:58 user nova-compute[75083]: INFO nova.compute.manager [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 06:09:58 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:09:58 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:09:58 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:09:58 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:09:58 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Took 0.73 seconds to deallocate network for instance.
Nov 29 06:09:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:59 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:09:59 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:09:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:59 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Deleted allocations for instance 13099ea1-93dc-4424-b0cf-fbaaf39aaeab
Nov 29 06:09:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fd854169-3b5e-4df9-ac02-03f1fb834448 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.038s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:59 user nova-compute[75083]: DEBUG nova.compute.manager [req-2e345393-d97f-46f8-b108-41da10dce3b1 req-ad3d7ece-eee1-4988-ad91-38e9ce8f0d80 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Received event network-vif-plugged-47704c3e-14b2-4aff-a773-c92babf49bde {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:09:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2e345393-d97f-46f8-b108-41da10dce3b1 req-ad3d7ece-eee1-4988-ad91-38e9ce8f0d80 service nova] Acquiring lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:09:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2e345393-d97f-46f8-b108-41da10dce3b1 req-ad3d7ece-eee1-4988-ad91-38e9ce8f0d80 service nova] Lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:09:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2e345393-d97f-46f8-b108-41da10dce3b1 req-ad3d7ece-eee1-4988-ad91-38e9ce8f0d80 service nova] Lock "13099ea1-93dc-4424-b0cf-fbaaf39aaeab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:09:59 user nova-compute[75083]: DEBUG nova.compute.manager [req-2e345393-d97f-46f8-b108-41da10dce3b1 req-ad3d7ece-eee1-4988-ad91-38e9ce8f0d80 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] No waiting events found dispatching network-vif-plugged-47704c3e-14b2-4aff-a773-c92babf49bde {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:09:59 user nova-compute[75083]: WARNING nova.compute.manager [req-2e345393-d97f-46f8-b108-41da10dce3b1 req-ad3d7ece-eee1-4988-ad91-38e9ce8f0d80 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Received unexpected event network-vif-plugged-47704c3e-14b2-4aff-a773-c92babf49bde for instance with vm_state deleted and task_state None.
Nov 29 06:09:59 user nova-compute[75083]: DEBUG nova.compute.manager [req-2e345393-d97f-46f8-b108-41da10dce3b1 req-ad3d7ece-eee1-4988-ad91-38e9ce8f0d80 service nova] [instance: 13099ea1-93dc-4424-b0cf-fbaaf39aaeab] Received event network-vif-deleted-47704c3e-14b2-4aff-a773-c92babf49bde {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:10:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:03 user nova-compute[75083]: DEBUG nova.compute.manager [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:10:03 user nova-compute[75083]: INFO nova.compute.manager [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] instance snapshotting
Nov 29 06:10:03 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Beginning live snapshot process
Nov 29 06:10:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json -f qcow2 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json -f qcow2 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:03 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcbuy7fkd/8e8d911f785447a8aa5ff2201695e415.delta 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcbuy7fkd/8e8d911f785447a8aa5ff2201695e415.delta 1073741824" returned: 0 in 0.048s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:04 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 06:10:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 06:10:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 06:10:05 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 06:10:05 user nova-compute[75083]: DEBUG nova.privsep.utils [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75083) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 06:10:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcbuy7fkd/8e8d911f785447a8aa5ff2201695e415.delta /opt/stack/data/nova/instances/snapshots/tmpcbuy7fkd/8e8d911f785447a8aa5ff2201695e415 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcbuy7fkd/8e8d911f785447a8aa5ff2201695e415.delta /opt/stack/data/nova/instances/snapshots/tmpcbuy7fkd/8e8d911f785447a8aa5ff2201695e415" returned: 0 in 0.531s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:06 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Snapshot extracted, beginning image upload
Nov 29 06:10:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:10:08 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Snapshot image upload complete
Nov 29 06:10:08 user nova-compute[75083]: INFO nova.compute.manager [None req-7aa55e08-a778-4a08-808c-aeaeabb15055 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Took 5.17 seconds to snapshot the instance on the hypervisor.
Nov 29 06:10:12 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:10:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:13 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:10:13 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:10:15 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:10:15 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:10:16 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:10:17 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:10:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:10:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:10:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:10:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:10:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:20 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:10:22 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:10:22 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:10:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:10:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:10:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:10:22 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:10:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:10:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:10:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:25 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:10:25 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:10:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8212MB free_disk=24.92807388305664GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:10:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:10:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:10:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-21a55d47-2cb4-4ba5-953d-e39f61441fc0 req-1a669001-5141-4b16-90a3-24de37f26d62 service nova] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Received event network-changed-fe369aec-feeb-4444-a640-012a5b6eb231 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:10:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-21a55d47-2cb4-4ba5-953d-e39f61441fc0 req-1a669001-5141-4b16-90a3-24de37f26d62 service nova] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Refreshing instance network info cache due to event network-changed-fe369aec-feeb-4444-a640-012a5b6eb231. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:10:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-21a55d47-2cb4-4ba5-953d-e39f61441fc0 req-1a669001-5141-4b16-90a3-24de37f26d62 service nova] Acquiring lock "refresh_cache-08b33e17-334b-4816-bcf6-26a67f132bc1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:10:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-21a55d47-2cb4-4ba5-953d-e39f61441fc0 req-1a669001-5141-4b16-90a3-24de37f26d62 service nova] Acquired lock "refresh_cache-08b33e17-334b-4816-bcf6-26a67f132bc1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:10:25 user nova-compute[75083]: DEBUG nova.network.neutron [req-21a55d47-2cb4-4ba5-953d-e39f61441fc0 req-1a669001-5141-4b16-90a3-24de37f26d62 service nova] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Refreshing network info cache for port fe369aec-feeb-4444-a640-012a5b6eb231 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:10:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4435ed78-e35f-4859-8a4f-9920815d968a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:10:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a34d9d98-be73-4d52-85f0-83e48f60bc12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:10:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:10:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fea64bdc-491c-46ba-9447-c175df432deb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:10:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4778c1d7-7248-4449-9743-56d95aab658a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:10:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance be4598f6-6ee2-4219-b8a2-446ba87b2efd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:10:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 08b33e17-334b-4816-bcf6-26a67f132bc1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:10:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:10:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:10:26 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:10:26 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:10:26 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:10:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:10:26 user nova-compute[75083]: DEBUG nova.network.neutron [req-21a55d47-2cb4-4ba5-953d-e39f61441fc0 req-1a669001-5141-4b16-90a3-24de37f26d62 service nova] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Updated VIF entry in instance network info cache for port fe369aec-feeb-4444-a640-012a5b6eb231. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:10:26 user nova-compute[75083]: DEBUG nova.network.neutron [req-21a55d47-2cb4-4ba5-953d-e39f61441fc0 req-1a669001-5141-4b16-90a3-24de37f26d62 service nova] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Updating instance_info_cache with network_info: [{"id": "fe369aec-feeb-4444-a640-012a5b6eb231", "address": "fa:16:3e:11:81:6e", "network": {"id": "1c5d3b69-0dc0-44fc-8d62-0e184770a31c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-246603725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ff233f7ca74890b5f100ed01b943b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe369aec-fe", "ovs_interfaceid": "fe369aec-feeb-4444-a640-012a5b6eb231", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:10:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-21a55d47-2cb4-4ba5-953d-e39f61441fc0 req-1a669001-5141-4b16-90a3-24de37f26d62 service nova] Releasing lock "refresh_cache-08b33e17-334b-4816-bcf6-26a67f132bc1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:10:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:28 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:10:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:10:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:10:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:10:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:10:28 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:10:28 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lazy-loading 'info_cache' on Instance uuid 4435ed78-e35f-4859-8a4f-9920815d968a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:10:28 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Updating instance_info_cache with network_info: [{"id": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "address": "fa:16:3e:8d:3b:2a", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f259ece-bc", "ovs_interfaceid": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:10:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-4435ed78-e35f-4859-8a4f-9920815d968a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:10:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "08b33e17-334b-4816-bcf6-26a67f132bc1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG nova.objects.instance [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lazy-loading 'flavor' on Instance uuid 08b33e17-334b-4816-bcf6-26a67f132bc1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "08b33e17-334b-4816-bcf6-26a67f132bc1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:10:29 user nova-compute[75083]: INFO nova.compute.manager [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Attaching volume 5a12e4c6-c363-46a5-a678-bd447806b47d to /dev/vdb
Nov 29 06:10:29 user nova-compute[75083]: DEBUG os_brick.utils [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d31bc79-d800-4e34-9c94-e1a904f51044]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae44b32c-86a6-46d6-bfb9-8903e61d4aba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ce4c5b-f771-439f-a78e-b2f857de4735]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[02070981-98c9-4a15-80da-ebc8695f20c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:10:29 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:10:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22622df-29c9-4ecd-9214-983fdb58ee80]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG os_brick.utils [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:10:29 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Updating existing volume attachment record: 395d594f-96f6-4dde-a824-47a5fff9320c {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:10:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "a34d9d98-be73-4d52-85f0-83e48f60bc12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:10:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:10:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:10:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:10:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:10:31 user nova-compute[75083]: INFO nova.compute.manager [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Terminating instance
Nov 29 06:10:31 user nova-compute[75083]: DEBUG nova.compute.manager [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:10:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG nova.compute.manager [req-259938a7-dd89-439b-9262-d6282efb6a4e req-e87a0050-9bc6-4166-b184-a9ff5efb9e61 service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Received event network-vif-unplugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-259938a7-dd89-439b-9262-d6282efb6a4e req-e87a0050-9bc6-4166-b184-a9ff5efb9e61 service nova] Acquiring lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-259938a7-dd89-439b-9262-d6282efb6a4e req-e87a0050-9bc6-4166-b184-a9ff5efb9e61 service nova] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-259938a7-dd89-439b-9262-d6282efb6a4e req-e87a0050-9bc6-4166-b184-a9ff5efb9e61 service nova] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG nova.compute.manager [req-259938a7-dd89-439b-9262-d6282efb6a4e req-e87a0050-9bc6-4166-b184-a9ff5efb9e61 service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] No waiting events found dispatching network-vif-unplugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG nova.compute.manager [req-259938a7-dd89-439b-9262-d6282efb6a4e req-e87a0050-9bc6-4166-b184-a9ff5efb9e61 service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Received event network-vif-unplugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:32 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Instance destroyed successfully.
Nov 29 06:10:32 user nova-compute[75083]: DEBUG nova.objects.instance [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'resources' on Instance uuid a34d9d98-be73-4d52-85f0-83e48f60bc12 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-682698187',display_name='tempest-ServerRescueNegativeTestJSON-server-682698187',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-682698187',id=21,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:56:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7833259e5df546ba86139af68fcb7906',ramdisk_id='',reservation_id='r-et4t7qoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1120078925',owner_user_name='tempest-ServerRescueNegativeTestJSON-1120078925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T05:56:24Z,user_data=None,user_id='eb74d3aef4664ff8bdec4110c6867056',uuid=a34d9d98-be73-4d52-85f0-83e48f60bc12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "address": "fa:16:3e:eb:95:6e", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31b37f5-06", "ovs_interfaceid": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converting VIF {"id": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "address": "fa:16:3e:eb:95:6e", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31b37f5-06", "ovs_interfaceid": "b31b37f5-06db-44ee-a798-37e3a7ea9ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:95:6e,bridge_name='br-int',has_traffic_filtering=True,id=b31b37f5-06db-44ee-a798-37e3a7ea9ab5,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31b37f5-06') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG os_vif [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:95:6e,bridge_name='br-int',has_traffic_filtering=True,id=b31b37f5-06db-44ee-a798-37e3a7ea9ab5,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31b37f5-06') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb31b37f5-06, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e30b6fda-25eb-4667-8418-7e9a6953135c) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:10:32 user nova-compute[75083]: INFO os_vif [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:95:6e,bridge_name='br-int',has_traffic_filtering=True,id=b31b37f5-06db-44ee-a798-37e3a7ea9ab5,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31b37f5-06')
Nov 29 06:10:32 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Deleting instance files /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12_del
Nov 29 06:10:32 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Deletion of /opt/stack/data/nova/instances/a34d9d98-be73-4d52-85f0-83e48f60bc12_del complete
Nov 29 06:10:32 user nova-compute[75083]: INFO nova.compute.manager [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 29 06:10:32 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:10:32 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:10:33 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:10:33 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Took 0.49 seconds to deallocate network for instance.
Nov 29 06:10:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:10:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:10:33 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:10:33 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:10:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:10:33 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Deleted allocations for instance a34d9d98-be73-4d52-85f0-83e48f60bc12
Nov 29 06:10:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-157ae804-6304-42eb-98ad-82cad7af92e3 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.835s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:10:34 user nova-compute[75083]: DEBUG nova.compute.manager [req-c14e6156-7da8-4efb-a30d-b8d73ad00700 req-04894ddb-bf32-4c9e-9fbf-d7909d7f3c22 service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Received event network-vif-plugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:10:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c14e6156-7da8-4efb-a30d-b8d73ad00700 req-04894ddb-bf32-4c9e-9fbf-d7909d7f3c22 service nova] Acquiring lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:10:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c14e6156-7da8-4efb-a30d-b8d73ad00700 req-04894ddb-bf32-4c9e-9fbf-d7909d7f3c22 service nova] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:10:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c14e6156-7da8-4efb-a30d-b8d73ad00700 req-04894ddb-bf32-4c9e-9fbf-d7909d7f3c22 service nova] Lock "a34d9d98-be73-4d52-85f0-83e48f60bc12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:10:34 user nova-compute[75083]: DEBUG nova.compute.manager [req-c14e6156-7da8-4efb-a30d-b8d73ad00700 req-04894ddb-bf32-4c9e-9fbf-d7909d7f3c22 service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] No waiting events found dispatching network-vif-plugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:10:34 user nova-compute[75083]: WARNING nova.compute.manager [req-c14e6156-7da8-4efb-a30d-b8d73ad00700 req-04894ddb-bf32-4c9e-9fbf-d7909d7f3c22 service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Received unexpected event network-vif-plugged-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 for instance with vm_state deleted and task_state None.
Nov 29 06:10:34 user nova-compute[75083]: DEBUG nova.compute.manager [req-c14e6156-7da8-4efb-a30d-b8d73ad00700 req-04894ddb-bf32-4c9e-9fbf-d7909d7f3c22 service nova] [instance: a34d9d98-be73-4d52-85f0-83e48f60bc12] Received event network-vif-deleted-b31b37f5-06db-44ee-a798-37e3a7ea9ab5 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:10:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykqauHOX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:10:37 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:10:37 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:10:37 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:10:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[86eb60b2-fad3-4a75-ad20-e64960a235d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:10:37 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f17fff7-d688-4c11-8774-2a2c8a291e3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d] added
Nov 29 06:10:37 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28b043d-26ca-43b0-b462-cb4f23aa0595]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e127b3b8-73b2-444f-ac42-9b1c2ab72882]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ykqauHOX {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ykqauHOX" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e964e618-c56e-46b0-bb4d-4d0591b63637]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ykqauHOX'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dad0d1-ea4d-4b01-b2bd-5aebedbee1c5]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06308bd-1de4-44b4-a1e1-ceee5769f9d9]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:10:37 user nova-compute[75083]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)
Nov 29 06:10:37 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:10:37 user nova-compute[75083]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)
Nov 29 06:10:37 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[855a0066-b1aa-45cd-98cb-e364a4457489]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d, portal: 172.16.0.220,3260]
Nov 29 06:10:37 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d, portal: 172.16.0.220,3260] successful.
Nov 29 06:10:37 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaf9213-2c46-4752-81b6-701db3f1a2a7]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[498403cb-39c2-4291-bdba-33832b4b4634]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:10:37 user nova-compute[75083]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)
Nov 29 06:10:37 user nova-compute[75083]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d (non-flash)
Nov 29 06:10:37 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:10:37 user nova-compute[75083]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)
Nov 29 06:10:37 user nova-compute[75083]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d (non-flash)
Nov 29 06:10:37 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aade4d-8a84-4963-88b0-56ac781a2822]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:10:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykqauHOX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:10:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:10:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26333356631343866', 'path': '/dev/sdc'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:10:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333356631343866', 'path': '/dev/sdc'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:10:38 user nova-compute[75083]: DEBUG nova.objects.instance [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lazy-loading 'flavor' on Instance uuid 08b33e17-334b-4816-bcf6-26a67f132bc1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:10:38 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 06:10:38 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:10:38 user nova-compute[75083]:   <source dev="/dev/sdc"/>
Nov 29 06:10:38 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:10:38 user nova-compute[75083]:   <serial>5a12e4c6-c363-46a5-a678-bd447806b47d</serial>
Nov 29 06:10:38 user nova-compute[75083]: </disk>
Nov 29 06:10:38 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 06:10:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:10:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:10:39 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] No VIF found with MAC fa:16:3e:11:81:6e, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:10:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-eece5daa-77e5-4de9-9bf6-ccd274294e63 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.779s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:10:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:10:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:10:51 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:10:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:10:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:10:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:10:51 user nova-compute[75083]: INFO nova.compute.claims [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Claim successful on node user
Nov 29 06:10:51 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:10:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:51 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:10:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:10:51 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:10:51 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:10:51 user nova-compute[75083]: DEBUG nova.network.neutron [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:10:51 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:10:51 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:10:51 user nova-compute[75083]: DEBUG nova.policy [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4dc42da0ede8433a827629a68e691658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112a98f04dc141dfbb0f7a10fd410cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:10:51 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:10:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:10:51 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Creating image(s)
Nov 29 06:10:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:10:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "/opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:10:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "/opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:10:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.189s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk 1073741824" returned: 0 in 0.051s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG nova.network.neutron [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Successfully created port: d0dd55dc-570c-40d2-82d1-9330a375972b {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.195s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Cannot resize image /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Ensure instance console log exists: /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:10:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.network.neutron [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Successfully updated port: d0dd55dc-570c-40d2-82d1-9330a375972b {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "refresh_cache-a9111c14-9bfb-4cc1-98ab-eabbf85f9568" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquired lock "refresh_cache-a9111c14-9bfb-4cc1-98ab-eabbf85f9568" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.network.neutron [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.compute.manager [req-e29b76f9-165c-424d-9e0c-fca1cb186f6f req-1cb6e665-ef47-41f5-b721-2aa4d5482892 service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Received event network-changed-d0dd55dc-570c-40d2-82d1-9330a375972b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.compute.manager [req-e29b76f9-165c-424d-9e0c-fca1cb186f6f req-1cb6e665-ef47-41f5-b721-2aa4d5482892 service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Refreshing instance network info cache due to event network-changed-d0dd55dc-570c-40d2-82d1-9330a375972b. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e29b76f9-165c-424d-9e0c-fca1cb186f6f req-1cb6e665-ef47-41f5-b721-2aa4d5482892 service nova] Acquiring lock "refresh_cache-a9111c14-9bfb-4cc1-98ab-eabbf85f9568" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.network.neutron [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.network.neutron [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Updating instance_info_cache with network_info: [{"id": "d0dd55dc-570c-40d2-82d1-9330a375972b", "address": "fa:16:3e:c8:4e:7c", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd55dc-57", "ovs_interfaceid": "d0dd55dc-570c-40d2-82d1-9330a375972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Releasing lock "refresh_cache-a9111c14-9bfb-4cc1-98ab-eabbf85f9568" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Instance network_info: |[{"id": "d0dd55dc-570c-40d2-82d1-9330a375972b", "address": "fa:16:3e:c8:4e:7c", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd55dc-57", "ovs_interfaceid": "d0dd55dc-570c-40d2-82d1-9330a375972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e29b76f9-165c-424d-9e0c-fca1cb186f6f req-1cb6e665-ef47-41f5-b721-2aa4d5482892 service nova] Acquired lock "refresh_cache-a9111c14-9bfb-4cc1-98ab-eabbf85f9568" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.network.neutron [req-e29b76f9-165c-424d-9e0c-fca1cb186f6f req-1cb6e665-ef47-41f5-b721-2aa4d5482892 service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Refreshing network info cache for port d0dd55dc-570c-40d2-82d1-9330a375972b {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Start _get_guest_xml network_info=[{"id": "d0dd55dc-570c-40d2-82d1-9330a375972b", "address": "fa:16:3e:c8:4e:7c", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd55dc-57", "ovs_interfaceid": "d0dd55dc-570c-40d2-82d1-9330a375972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:10:53 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:10:53 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-998422595',display_name='tempest-AttachVolumeNegativeTest-server-998422595',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-998422595',id=40,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4DIaeavRWj4KXGzqpgio+P18KwfFhJ0bmDloZVKv/nTMhFLWiWYkFAyalGSHiwRkLWS/2RySlsji0p7mkhz1y/m+441LUOvj9mMZtR5h93Cs4tYA3tcyHigWek7Tf4qQ==',key_name='tempest-keypair-216188010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112a98f04dc141dfbb0f7a10fd410cae',ramdisk_id='',reservation_id='r-1x960zxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1387142425',owner_user_name='tempest-AttachVolumeNegativeTest-1387142425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dc42da0ede8433a827629a68e691658',uuid=a9111c14-9bfb-4cc1-98ab-eabbf85f9568,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0dd55dc-570c-40d2-82d1-9330a375972b", "address": "fa:16:3e:c8:4e:7c", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd55dc-57", "ovs_interfaceid": "d0dd55dc-570c-40d2-82d1-9330a375972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converting VIF {"id": "d0dd55dc-570c-40d2-82d1-9330a375972b", "address": "fa:16:3e:c8:4e:7c", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd55dc-57", "ovs_interfaceid": "d0dd55dc-570c-40d2-82d1-9330a375972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:4e:7c,bridge_name='br-int',has_traffic_filtering=True,id=d0dd55dc-570c-40d2-82d1-9330a375972b,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dd55dc-57') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.objects.instance [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lazy-loading 'pci_devices' on Instance uuid a9111c14-9bfb-4cc1-98ab-eabbf85f9568 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:10:53 user nova-compute[75083]:   <uuid>a9111c14-9bfb-4cc1-98ab-eabbf85f9568</uuid>
Nov 29 06:10:53 user nova-compute[75083]:   <name>instance-00000028</name>
Nov 29 06:10:53 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:10:53 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:10:53 user nova-compute[75083]:   <metadata>
Nov 29 06:10:53 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:10:53 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:10:53 user nova-compute[75083]:       <nova:name>tempest-AttachVolumeNegativeTest-server-998422595</nova:name>
Nov 29 06:10:53 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:10:53</nova:creationTime>
Nov 29 06:10:53 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:10:53 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:10:53 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:10:53 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:10:53 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:10:53 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:10:53 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:10:53 user nova-compute[75083]:       <nova:owner>
Nov 29 06:10:53 user nova-compute[75083]:         <nova:user uuid="4dc42da0ede8433a827629a68e691658">tempest-AttachVolumeNegativeTest-1387142425-project-member</nova:user>
Nov 29 06:10:53 user nova-compute[75083]:         <nova:project uuid="112a98f04dc141dfbb0f7a10fd410cae">tempest-AttachVolumeNegativeTest-1387142425</nova:project>
Nov 29 06:10:53 user nova-compute[75083]:       </nova:owner>
Nov 29 06:10:53 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 06:10:53 user nova-compute[75083]:       <nova:ports>
Nov 29 06:10:53 user nova-compute[75083]:         <nova:port uuid="d0dd55dc-570c-40d2-82d1-9330a375972b">
Nov 29 06:10:53 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 06:10:53 user nova-compute[75083]:         </nova:port>
Nov 29 06:10:53 user nova-compute[75083]:       </nova:ports>
Nov 29 06:10:53 user nova-compute[75083]:     </nova:instance>
Nov 29 06:10:53 user nova-compute[75083]:   </metadata>
Nov 29 06:10:53 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:10:53 user nova-compute[75083]:     <system>
Nov 29 06:10:53 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:10:53 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:10:53 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:10:53 user nova-compute[75083]:       <entry name="serial">a9111c14-9bfb-4cc1-98ab-eabbf85f9568</entry>
Nov 29 06:10:53 user nova-compute[75083]:       <entry name="uuid">a9111c14-9bfb-4cc1-98ab-eabbf85f9568</entry>
Nov 29 06:10:53 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:10:53 user nova-compute[75083]:     </system>
Nov 29 06:10:53 user nova-compute[75083]:   </sysinfo>
Nov 29 06:10:53 user nova-compute[75083]:   <os>
Nov 29 06:10:53 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:10:53 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:10:53 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:10:53 user nova-compute[75083]:   </os>
Nov 29 06:10:53 user nova-compute[75083]:   <features>
Nov 29 06:10:53 user nova-compute[75083]:     <acpi/>
Nov 29 06:10:53 user nova-compute[75083]:     <apic/>
Nov 29 06:10:53 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:10:53 user nova-compute[75083]:   </features>
Nov 29 06:10:53 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:10:53 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:10:53 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:10:53 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:10:53 user nova-compute[75083]:   </clock>
Nov 29 06:10:53 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:10:53 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:10:53 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:10:53 user nova-compute[75083]:   </cpu>
Nov 29 06:10:53 user nova-compute[75083]:   <devices>
Nov 29 06:10:53 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:10:53 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:10:53 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk"/>
Nov 29 06:10:53 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:10:53 user nova-compute[75083]:     </disk>
Nov 29 06:10:53 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:10:53 user nova-compute[75083]:       <mac address="fa:16:3e:c8:4e:7c"/>
Nov 29 06:10:53 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:10:53 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:10:53 user nova-compute[75083]:       <target dev="tapd0dd55dc-57"/>
Nov 29 06:10:53 user nova-compute[75083]:     </interface>
Nov 29 06:10:53 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:10:53 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/console.log" append="off"/>
Nov 29 06:10:53 user nova-compute[75083]:     </serial>
Nov 29 06:10:53 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:10:53 user nova-compute[75083]:     <video>
Nov 29 06:10:53 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:10:53 user nova-compute[75083]:     </video>
Nov 29 06:10:53 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:10:53 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:10:53 user nova-compute[75083]:     </rng>
Nov 29 06:10:53 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:10:53 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:10:53 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:10:53 user nova-compute[75083]:     </memballoon>
Nov 29 06:10:53 user nova-compute[75083]:   </devices>
Nov 29 06:10:53 user nova-compute[75083]: </domain>
Nov 29 06:10:53 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-998422595',display_name='tempest-AttachVolumeNegativeTest-server-998422595',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-998422595',id=40,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4DIaeavRWj4KXGzqpgio+P18KwfFhJ0bmDloZVKv/nTMhFLWiWYkFAyalGSHiwRkLWS/2RySlsji0p7mkhz1y/m+441LUOvj9mMZtR5h93Cs4tYA3tcyHigWek7Tf4qQ==',key_name='tempest-keypair-216188010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112a98f04dc141dfbb0f7a10fd410cae',ramdisk_id='',reservation_id='r-1x960zxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1387142425',owner_user_name='tempest-AttachVolumeNegativeTest-1387142425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dc42da0ede8433a827629a68e691658',uuid=a9111c14-9bfb-4cc1-98ab-eabbf85f9568,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0dd55dc-570c-40d2-82d1-9330a375972b", "address": "fa:16:3e:c8:4e:7c", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd55dc-57", "ovs_interfaceid": "d0dd55dc-570c-40d2-82d1-9330a375972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converting VIF {"id": "d0dd55dc-570c-40d2-82d1-9330a375972b", "address": "fa:16:3e:c8:4e:7c", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd55dc-57", "ovs_interfaceid": "d0dd55dc-570c-40d2-82d1-9330a375972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:4e:7c,bridge_name='br-int',has_traffic_filtering=True,id=d0dd55dc-570c-40d2-82d1-9330a375972b,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dd55dc-57') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG os_vif [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:4e:7c,bridge_name='br-int',has_traffic_filtering=True,id=d0dd55dc-570c-40d2-82d1-9330a375972b,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dd55dc-57') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb643f8c-6f9d-5eda-ac7c-2d3dcb934e22', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0dd55dc-57, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0dd55dc-57, col_values=(('qos', UUID('0c80b562-ea09-4acb-b07b-3c84c5bfd40e')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0dd55dc-57, col_values=(('external_ids', {'iface-id': 'd0dd55dc-570c-40d2-82d1-9330a375972b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:4e:7c', 'vm-uuid': 'a9111c14-9bfb-4cc1-98ab-eabbf85f9568'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:53 user nova-compute[75083]: INFO os_vif [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:4e:7c,bridge_name='br-int',has_traffic_filtering=True,id=d0dd55dc-570c-40d2-82d1-9330a375972b,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dd55dc-57')
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] No VIF found with MAC fa:16:3e:c8:4e:7c, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "08b33e17-334b-4816-bcf6-26a67f132bc1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:10:53 user nova-compute[75083]: INFO nova.compute.manager [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Detaching volume 5a12e4c6-c363-46a5-a678-bd447806b47d
Nov 29 06:10:53 user nova-compute[75083]: INFO nova.virt.block_device [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Attempting to driver detach volume 5a12e4c6-c363-46a5-a678-bd447806b47d from mountpoint /dev/vdb
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Attempting to detach device vdb from instance 08b33e17-334b-4816-bcf6-26a67f132bc1 from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:10:53 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:10:53 user nova-compute[75083]:   <source dev="/dev/sdc"/>
Nov 29 06:10:53 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:10:53 user nova-compute[75083]:   <serial>5a12e4c6-c363-46a5-a678-bd447806b47d</serial>
Nov 29 06:10:53 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:10:53 user nova-compute[75083]: </disk>
Nov 29 06:10:53 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:10:53 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Successfully detached device vdb from instance 08b33e17-334b-4816-bcf6-26a67f132bc1 from the persistent domain config.
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 08b33e17-334b-4816-bcf6-26a67f132bc1 from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:10:53 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:10:53 user nova-compute[75083]:   <source dev="/dev/sdc"/>
Nov 29 06:10:53 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:10:53 user nova-compute[75083]:   <serial>5a12e4c6-c363-46a5-a678-bd447806b47d</serial>
Nov 29 06:10:53 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:10:53 user nova-compute[75083]: </disk>
Nov 29 06:10:53 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.network.neutron [req-e29b76f9-165c-424d-9e0c-fca1cb186f6f req-1cb6e665-ef47-41f5-b721-2aa4d5482892 service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Updated VIF entry in instance network info cache for port d0dd55dc-570c-40d2-82d1-9330a375972b. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG nova.network.neutron [req-e29b76f9-165c-424d-9e0c-fca1cb186f6f req-1cb6e665-ef47-41f5-b721-2aa4d5482892 service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Updating instance_info_cache with network_info: [{"id": "d0dd55dc-570c-40d2-82d1-9330a375972b", "address": "fa:16:3e:c8:4e:7c", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd55dc-57", "ovs_interfaceid": "d0dd55dc-570c-40d2-82d1-9330a375972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:10:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e29b76f9-165c-424d-9e0c-fca1cb186f6f req-1cb6e665-ef47-41f5-b721-2aa4d5482892 service nova] Releasing lock "refresh_cache-a9111c14-9bfb-4cc1-98ab-eabbf85f9568" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:10:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 08b33e17-334b-4816-bcf6-26a67f132bc1 {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 06:10:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-b80c903f-4abc-46ad-81d9-2fd0a038d38b req-d5bb1caf-dad5-4479-ab20-54d39e8906d4 service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Received event network-vif-plugged-d0dd55dc-570c-40d2-82d1-9330a375972b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:10:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b80c903f-4abc-46ad-81d9-2fd0a038d38b req-d5bb1caf-dad5-4479-ab20-54d39e8906d4 service nova] Acquiring lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:10:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b80c903f-4abc-46ad-81d9-2fd0a038d38b req-d5bb1caf-dad5-4479-ab20-54d39e8906d4 service nova] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:10:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b80c903f-4abc-46ad-81d9-2fd0a038d38b req-d5bb1caf-dad5-4479-ab20-54d39e8906d4 service nova] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:10:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-b80c903f-4abc-46ad-81d9-2fd0a038d38b req-d5bb1caf-dad5-4479-ab20-54d39e8906d4 service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] No waiting events found dispatching network-vif-plugged-d0dd55dc-570c-40d2-82d1-9330a375972b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:10:55 user nova-compute[75083]: WARNING nova.compute.manager [req-b80c903f-4abc-46ad-81d9-2fd0a038d38b req-d5bb1caf-dad5-4479-ab20-54d39e8906d4 service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Received unexpected event network-vif-plugged-d0dd55dc-570c-40d2-82d1-9330a375972b for instance with vm_state building and task_state spawning.
Nov 29 06:10:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:10:57 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:10:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:10:57 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Instance spawned successfully.
Nov 29 06:10:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:10:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:10:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:10:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:10:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:10:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:10:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:10:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-c935ebbf-43b9-4910-820d-10078fb80d2b req-e3d5071a-d748-4e21-b86d-c59ab93b9655 service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Received event network-vif-plugged-d0dd55dc-570c-40d2-82d1-9330a375972b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:10:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c935ebbf-43b9-4910-820d-10078fb80d2b req-e3d5071a-d748-4e21-b86d-c59ab93b9655 service nova] Acquiring lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:10:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c935ebbf-43b9-4910-820d-10078fb80d2b req-e3d5071a-d748-4e21-b86d-c59ab93b9655 service nova] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:10:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c935ebbf-43b9-4910-820d-10078fb80d2b req-e3d5071a-d748-4e21-b86d-c59ab93b9655 service nova] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:10:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-c935ebbf-43b9-4910-820d-10078fb80d2b req-e3d5071a-d748-4e21-b86d-c59ab93b9655 service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] No waiting events found dispatching network-vif-plugged-d0dd55dc-570c-40d2-82d1-9330a375972b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:10:57 user nova-compute[75083]: WARNING nova.compute.manager [req-c935ebbf-43b9-4910-820d-10078fb80d2b req-e3d5071a-d748-4e21-b86d-c59ab93b9655 service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Received unexpected event network-vif-plugged-d0dd55dc-570c-40d2-82d1-9330a375972b for instance with vm_state building and task_state spawning.
Nov 29 06:10:57 user nova-compute[75083]: INFO nova.compute.manager [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 29 06:10:57 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:10:57 user nova-compute[75083]: INFO nova.compute.manager [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Took 6.51 seconds to build instance.
Nov 29 06:10:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d71dd1ae-1bde-494b-8a0b-74952964c347 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.605s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:10:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:11:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:11:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:11:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:11:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "0c2a7205-02b3-488f-b062-f7f676413cc5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:11:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:11:11 user nova-compute[75083]: DEBUG nova.compute.manager [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:11:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:11:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:11:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:11:11 user nova-compute[75083]: INFO nova.compute.claims [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Claim successful on node user
Nov 29 06:11:11 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:11:11 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:11:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:11:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:11:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:11:12 user nova-compute[75083]: DEBUG nova.network.neutron [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:11:12 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:11:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:11:12 user nova-compute[75083]: DEBUG nova.policy [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4145bf5a07ea4d398f1a1e10a976c10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47694ecf400b4d6c952d0c06d0764d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:11:12 user nova-compute[75083]: INFO nova.virt.block_device [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Booting with volume-backed-image 0c1e50f1-5043-4598-be6f-f50133dc7439 at /dev/vda
Nov 29 06:11:12 user nova-compute[75083]: DEBUG nova.network.neutron [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Successfully created port: 9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:11:13 user nova-compute[75083]: DEBUG nova.network.neutron [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Successfully updated port: 9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:11:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "refresh_cache-0c2a7205-02b3-488f-b062-f7f676413cc5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:11:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquired lock "refresh_cache-0c2a7205-02b3-488f-b062-f7f676413cc5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:11:13 user nova-compute[75083]: DEBUG nova.network.neutron [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:11:13 user nova-compute[75083]: DEBUG nova.compute.manager [req-85407662-f68d-4fa0-96d3-c083587ffa8e req-d6df961f-65a4-4c97-a048-9a68c1685574 service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received event network-changed-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:11:13 user nova-compute[75083]: DEBUG nova.compute.manager [req-85407662-f68d-4fa0-96d3-c083587ffa8e req-d6df961f-65a4-4c97-a048-9a68c1685574 service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Refreshing instance network info cache due to event network-changed-9750238c-1417-442c-a71c-9c04bb43388d. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:11:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-85407662-f68d-4fa0-96d3-c083587ffa8e req-d6df961f-65a4-4c97-a048-9a68c1685574 service nova] Acquiring lock "refresh_cache-0c2a7205-02b3-488f-b062-f7f676413cc5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:11:13 user nova-compute[75083]: DEBUG nova.network.neutron [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:11:13 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:11:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:13 user nova-compute[75083]: DEBUG nova.network.neutron [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Updating instance_info_cache with network_info: [{"id": "9750238c-1417-442c-a71c-9c04bb43388d", "address": "fa:16:3e:65:2e:c7", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9750238c-14", "ovs_interfaceid": "9750238c-1417-442c-a71c-9c04bb43388d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:11:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Releasing lock "refresh_cache-0c2a7205-02b3-488f-b062-f7f676413cc5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:11:13 user nova-compute[75083]: DEBUG nova.compute.manager [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Instance network_info: |[{"id": "9750238c-1417-442c-a71c-9c04bb43388d", "address": "fa:16:3e:65:2e:c7", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9750238c-14", "ovs_interfaceid": "9750238c-1417-442c-a71c-9c04bb43388d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:11:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-85407662-f68d-4fa0-96d3-c083587ffa8e req-d6df961f-65a4-4c97-a048-9a68c1685574 service nova] Acquired lock "refresh_cache-0c2a7205-02b3-488f-b062-f7f676413cc5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:11:13 user nova-compute[75083]: DEBUG nova.network.neutron [req-85407662-f68d-4fa0-96d3-c083587ffa8e req-d6df961f-65a4-4c97-a048-9a68c1685574 service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Refreshing network info cache for port 9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG nova.network.neutron [req-85407662-f68d-4fa0-96d3-c083587ffa8e req-d6df961f-65a4-4c97-a048-9a68c1685574 service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Updated VIF entry in instance network info cache for port 9750238c-1417-442c-a71c-9c04bb43388d. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG nova.network.neutron [req-85407662-f68d-4fa0-96d3-c083587ffa8e req-d6df961f-65a4-4c97-a048-9a68c1685574 service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Updating instance_info_cache with network_info: [{"id": "9750238c-1417-442c-a71c-9c04bb43388d", "address": "fa:16:3e:65:2e:c7", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9750238c-14", "ovs_interfaceid": "9750238c-1417-442c-a71c-9c04bb43388d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-85407662-f68d-4fa0-96d3-c083587ffa8e req-d6df961f-65a4-4c97-a048-9a68c1685574 service nova] Releasing lock "refresh_cache-0c2a7205-02b3-488f-b062-f7f676413cc5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:11:14 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 08b33e17-334b-4816-bcf6-26a67f132bc1 is timed out.
Nov 29 06:11:14 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Successfully detached device vdb from instance 08b33e17-334b-4816-bcf6-26a67f132bc1 from the live domain config.
Nov 29 06:11:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykqauHOX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:11:14 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:11:14 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a05e24-f611-4212-bdc2-faa202411db1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2278c75-b543-4ff4-9c7e-a5fefbc87cca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:11:14 user nova-compute[75083]: No targets found.
Nov 29 06:11:14 user nova-compute[75083]: iSNS:
Nov 29 06:11:14 user nova-compute[75083]: No targets found.
Nov 29 06:11:14 user nova-compute[75083]: STATIC:
Nov 29 06:11:14 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:f2278c75-b543-4ff4-9c7e-a5fefbc87cca
Nov 29 06:11:14 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:11:14 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:11:14 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856
Nov 29 06:11:14 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:11:14 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:11:14 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d
Nov 29 06:11:14 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:11:14 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:11:14 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d
Nov 29 06:11:14 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:11:14 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:11:14 user nova-compute[75083]: FIRMWARE:
Nov 29 06:11:14 user nova-compute[75083]: No targets found.
Nov 29 06:11:14 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:11:14 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:11:14 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[166d9f92-5cd1-492b-b70f-f82f0fecf598]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2278c75-b543-4ff4-9c7e-a5fefbc87cca\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55cdb0b-52d1-455b-94da-a4355e5cf746]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2278c75-b543-4ff4-9c7e-a5fefbc87cca (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:11:14 user nova-compute[75083]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)
Nov 29 06:11:14 user nova-compute[75083]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d (non-flash)
Nov 29 06:11:14 user nova-compute[75083]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2278c75-b543-4ff4-9c7e-a5fefbc87cca (non-flash)
Nov 29 06:11:14 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:11:14 user nova-compute[75083]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)
Nov 29 06:11:14 user nova-compute[75083]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d (non-flash)
Nov 29 06:11:14 user nova-compute[75083]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2278c75-b543-4ff4-9c7e-a5fefbc87cca (non-flash)
Nov 29 06:11:14 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0d8334dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d'): ({'sdc'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Removing single pathed devices sdc {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d41922-5c9e-4a3a-b614-734ca4fc36e8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0367bc4f-2fce-422b-89d4-e13b95ffd8d1]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Flushing IO for device /dev/sdc {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cc1328-e086-45e3-b99f-319ae04449e3]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[026b8305-4a90-4b09-bab0-ad37e522e384]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9296812-0b3c-4da0-9ebe-a14614bdc2ce]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ee4076-8fa8-46b5-9ace-85b62320dd97]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d, portal: 172.16.0.220,3260]
Nov 29 06:11:14 user nova-compute[75083]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d, portal: 172.16.0.220,3260] successful.
Nov 29 06:11:14 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:14 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:15 user nova-compute[75083]: DEBUG nova.compute.manager [req-9f4d8730-3242-42cc-94a1-b9f3b0d1223a req-6488d667-879d-4bc7-a1d9-2f8fcbfe4ed8 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received event network-changed-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:11:15 user nova-compute[75083]: DEBUG nova.compute.manager [req-9f4d8730-3242-42cc-94a1-b9f3b0d1223a req-6488d667-879d-4bc7-a1d9-2f8fcbfe4ed8 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Refreshing instance network info cache due to event network-changed-f6e12473-48ac-49f8-ac20-12a3d9e59a56. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:11:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9f4d8730-3242-42cc-94a1-b9f3b0d1223a req-6488d667-879d-4bc7-a1d9-2f8fcbfe4ed8 service nova] Acquiring lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:11:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9f4d8730-3242-42cc-94a1-b9f3b0d1223a req-6488d667-879d-4bc7-a1d9-2f8fcbfe4ed8 service nova] Acquired lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:11:15 user nova-compute[75083]: DEBUG nova.network.neutron [req-9f4d8730-3242-42cc-94a1-b9f3b0d1223a req-6488d667-879d-4bc7-a1d9-2f8fcbfe4ed8 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Refreshing network info cache for port f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:11:15 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a12e4c6-c363-46a5-a678-bd447806b47d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.085s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:15 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4964f16d-cc46-4133-838f-4192f901bb12]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:11:15 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] <== disconnect_volume: return (390ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:11:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:11:15 user nova-compute[75083]: DEBUG nova.network.neutron [req-9f4d8730-3242-42cc-94a1-b9f3b0d1223a req-6488d667-879d-4bc7-a1d9-2f8fcbfe4ed8 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Updated VIF entry in instance network info cache for port f6e12473-48ac-49f8-ac20-12a3d9e59a56. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:11:15 user nova-compute[75083]: DEBUG nova.network.neutron [req-9f4d8730-3242-42cc-94a1-b9f3b0d1223a req-6488d667-879d-4bc7-a1d9-2f8fcbfe4ed8 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Updating instance_info_cache with network_info: [{"id": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "address": "fa:16:3e:b2:03:18", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e12473-48", "ovs_interfaceid": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:11:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9f4d8730-3242-42cc-94a1-b9f3b0d1223a req-6488d667-879d-4bc7-a1d9-2f8fcbfe4ed8 service nova] Releasing lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:11:15 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:11:15 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:11:15 user nova-compute[75083]: DEBUG nova.objects.instance [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lazy-loading 'flavor' on Instance uuid 08b33e17-334b-4816-bcf6-26a67f132bc1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:11:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-61c2af29-42e5-4466-aabe-f753f5b1432f tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.102s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:11:16 user nova-compute[75083]: DEBUG nova.compute.manager [req-7a4f15d2-c128-4155-8580-3c304b3c47da req-9a9438a8-32fc-4c8b-9e78-4cd41fdd9db8 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received event network-changed-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:11:16 user nova-compute[75083]: DEBUG nova.compute.manager [req-7a4f15d2-c128-4155-8580-3c304b3c47da req-9a9438a8-32fc-4c8b-9e78-4cd41fdd9db8 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Refreshing instance network info cache due to event network-changed-f6e12473-48ac-49f8-ac20-12a3d9e59a56. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:11:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7a4f15d2-c128-4155-8580-3c304b3c47da req-9a9438a8-32fc-4c8b-9e78-4cd41fdd9db8 service nova] Acquiring lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:11:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7a4f15d2-c128-4155-8580-3c304b3c47da req-9a9438a8-32fc-4c8b-9e78-4cd41fdd9db8 service nova] Acquired lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:11:16 user nova-compute[75083]: DEBUG nova.network.neutron [req-7a4f15d2-c128-4155-8580-3c304b3c47da req-9a9438a8-32fc-4c8b-9e78-4cd41fdd9db8 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Refreshing network info cache for port f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:11:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:16 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:11:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "4778c1d7-7248-4449-9743-56d95aab658a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:11:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "4778c1d7-7248-4449-9743-56d95aab658a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:11:16 user nova-compute[75083]: INFO nova.compute.manager [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Detaching volume aa7c8f31-9b5b-4bd5-9309-903ae880cf4d
Nov 29 06:11:16 user nova-compute[75083]: INFO nova.virt.block_device [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Attempting to driver detach volume aa7c8f31-9b5b-4bd5-9309-903ae880cf4d from mountpoint /dev/vdb
Nov 29 06:11:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Attempting to detach device vdb from instance 4778c1d7-7248-4449-9743-56d95aab658a from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 06:11:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:11:16 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:11:16 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:11:16 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:11:16 user nova-compute[75083]:   <serial>aa7c8f31-9b5b-4bd5-9309-903ae880cf4d</serial>
Nov 29 06:11:16 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:11:16 user nova-compute[75083]: </disk>
Nov 29 06:11:16 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:11:16 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Successfully detached device vdb from instance 4778c1d7-7248-4449-9743-56d95aab658a from the persistent domain config.
Nov 29 06:11:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4778c1d7-7248-4449-9743-56d95aab658a from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 06:11:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:11:16 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:11:16 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:11:16 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:11:16 user nova-compute[75083]:   <serial>aa7c8f31-9b5b-4bd5-9309-903ae880cf4d</serial>
Nov 29 06:11:16 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:11:16 user nova-compute[75083]: </disk>
Nov 29 06:11:16 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:11:16 user nova-compute[75083]: DEBUG nova.network.neutron [req-7a4f15d2-c128-4155-8580-3c304b3c47da req-9a9438a8-32fc-4c8b-9e78-4cd41fdd9db8 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Updated VIF entry in instance network info cache for port f6e12473-48ac-49f8-ac20-12a3d9e59a56. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:11:16 user nova-compute[75083]: DEBUG nova.network.neutron [req-7a4f15d2-c128-4155-8580-3c304b3c47da req-9a9438a8-32fc-4c8b-9e78-4cd41fdd9db8 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Updating instance_info_cache with network_info: [{"id": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "address": "fa:16:3e:b2:03:18", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e12473-48", "ovs_interfaceid": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:11:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7a4f15d2-c128-4155-8580-3c304b3c47da req-9a9438a8-32fc-4c8b-9e78-4cd41fdd9db8 service nova] Releasing lock "refresh_cache-4778c1d7-7248-4449-9743-56d95aab658a" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:11:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4778c1d7-7248-4449-9743-56d95aab658a {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 06:11:17 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:11:17 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:11:17 user nova-compute[75083]: DEBUG os_brick.utils [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:11:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d29c28e-a18b-4a2c-8bfd-097b6b2399e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5824d6bf-a391-419b-bb78-f5ffffa85a74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbc1d45-da9c-4d6b-a087-ad2c68a5663b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9320d737-ec74-4eed-8e08-21d93e54afd9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:11:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:11:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:11:18 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:11:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9957da-7fb3-42a9-b8b0-77a39b9aaa6c]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:11:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:11:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:11:18 user nova-compute[75083]: DEBUG os_brick.utils [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:11:18 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Updating existing volume attachment record: 1968c3b0-53e7-400f-a37b-11d1234ab1b6 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:11:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:20 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:11:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "4435ed78-e35f-4859-8a4f-9920815d968a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:11:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "4435ed78-e35f-4859-8a4f-9920815d968a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:11:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:11:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:11:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:11:22 user nova-compute[75083]: INFO nova.compute.manager [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Terminating instance
Nov 29 06:11:22 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:11:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:22 user nova-compute[75083]: DEBUG nova.compute.manager [req-84e2e558-b551-4b4b-9f01-34496d12e52c req-4892910f-8e43-42b9-aadd-b4e346d69541 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received event network-vif-unplugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:11:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-84e2e558-b551-4b4b-9f01-34496d12e52c req-4892910f-8e43-42b9-aadd-b4e346d69541 service nova] Acquiring lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:11:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-84e2e558-b551-4b4b-9f01-34496d12e52c req-4892910f-8e43-42b9-aadd-b4e346d69541 service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:11:22 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-84e2e558-b551-4b4b-9f01-34496d12e52c req-4892910f-8e43-42b9-aadd-b4e346d69541 service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:11:22 user nova-compute[75083]: DEBUG nova.compute.manager [req-84e2e558-b551-4b4b-9f01-34496d12e52c req-4892910f-8e43-42b9-aadd-b4e346d69541 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] No waiting events found dispatching network-vif-unplugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:11:22 user nova-compute[75083]: DEBUG nova.compute.manager [req-84e2e558-b551-4b4b-9f01-34496d12e52c req-4892910f-8e43-42b9-aadd-b4e346d69541 service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received event network-vif-unplugged-1f259ece-bce2-4aab-925b-26e4f9619fbf for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:23 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Instance destroyed successfully.
Nov 29 06:11:23 user nova-compute[75083]: DEBUG nova.objects.instance [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lazy-loading 'resources' on Instance uuid 4435ed78-e35f-4859-8a4f-9920815d968a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:54:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-131916452',display_name='tempest-ServerRescueNegativeTestJSON-server-131916452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-131916452',id=20,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:59:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7833259e5df546ba86139af68fcb7906',ramdisk_id='',reservation_id='r-yjx8q1as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1120078925',owner_user_name='tempest-ServerRescueNegativeTestJSON-1120078925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:01:07Z,user_data=None,user_id='eb74d3aef4664ff8bdec4110c6867056',uuid=4435ed78-e35f-4859-8a4f-9920815d968a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "address": "fa:16:3e:8d:3b:2a", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f259ece-bc", "ovs_interfaceid": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converting VIF {"id": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "address": "fa:16:3e:8d:3b:2a", "network": {"id": "13303e0a-4173-42a1-a22f-1aa609d0039f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-932698159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7833259e5df546ba86139af68fcb7906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f259ece-bc", "ovs_interfaceid": "1f259ece-bce2-4aab-925b-26e4f9619fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:3b:2a,bridge_name='br-int',has_traffic_filtering=True,id=1f259ece-bce2-4aab-925b-26e4f9619fbf,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f259ece-bc') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG os_vif [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:3b:2a,bridge_name='br-int',has_traffic_filtering=True,id=1f259ece-bce2-4aab-925b-26e4f9619fbf,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f259ece-bc') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f259ece-bc, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99eb69b8-af32-4f2e-bcf1-b0509c0ad205) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:11:23 user nova-compute[75083]: INFO os_vif [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:3b:2a,bridge_name='br-int',has_traffic_filtering=True,id=1f259ece-bce2-4aab-925b-26e4f9619fbf,network=Network(13303e0a-4173-42a1-a22f-1aa609d0039f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f259ece-bc')
Nov 29 06:11:23 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Deleting instance files /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a_del
Nov 29 06:11:23 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Deletion of /opt/stack/data/nova/instances/4435ed78-e35f-4859-8a4f-9920815d968a_del complete
Nov 29 06:11:23 user nova-compute[75083]: INFO nova.compute.manager [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 29 06:11:23 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:24 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:11:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:24 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Took 0.97 seconds to deallocate network for instance.
Nov 29 06:11:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:11:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:11:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:11:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:24 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:11:24 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:11:24 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea545658-a0c8-4e17-be78-36fb942764c9 req-ca115b2c-8115-4333-adb9-c3a29662983b service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received event network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:11:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea545658-a0c8-4e17-be78-36fb942764c9 req-ca115b2c-8115-4333-adb9-c3a29662983b service nova] Acquiring lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:11:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea545658-a0c8-4e17-be78-36fb942764c9 req-ca115b2c-8115-4333-adb9-c3a29662983b service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:11:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ea545658-a0c8-4e17-be78-36fb942764c9 req-ca115b2c-8115-4333-adb9-c3a29662983b service nova] Lock "4435ed78-e35f-4859-8a4f-9920815d968a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:11:24 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea545658-a0c8-4e17-be78-36fb942764c9 req-ca115b2c-8115-4333-adb9-c3a29662983b service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] No waiting events found dispatching network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:11:24 user nova-compute[75083]: WARNING nova.compute.manager [req-ea545658-a0c8-4e17-be78-36fb942764c9 req-ca115b2c-8115-4333-adb9-c3a29662983b service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received unexpected event network-vif-plugged-1f259ece-bce2-4aab-925b-26e4f9619fbf for instance with vm_state deleted and task_state None.
Nov 29 06:11:24 user nova-compute[75083]: DEBUG nova.compute.manager [req-ea545658-a0c8-4e17-be78-36fb942764c9 req-ca115b2c-8115-4333-adb9-c3a29662983b service nova] [instance: 4435ed78-e35f-4859-8a4f-9920815d968a] Received event network-vif-deleted-1f259ece-bce2-4aab-925b-26e4f9619fbf {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:11:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:11:25 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Deleted allocations for instance 4435ed78-e35f-4859-8a4f-9920815d968a
Nov 29 06:11:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2b40082-786b-4fdf-89b6-718fd41899f0 tempest-ServerRescueNegativeTestJSON-1120078925 tempest-ServerRescueNegativeTestJSON-1120078925-project-member] Lock "4435ed78-e35f-4859-8a4f-9920815d968a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.699s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:11:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:26 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:11:26 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8241MB free_disk=24.95212173461914GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fea64bdc-491c-46ba-9447-c175df432deb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4778c1d7-7248-4449-9743-56d95aab658a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance be4598f6-6ee2-4219-b8a2-446ba87b2efd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 08b33e17-334b-4816-bcf6-26a67f132bc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a9111c14-9bfb-4cc1-98ab-eabbf85f9568 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 0c2a7205-02b3-488f-b062-f7f676413cc5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:11:26 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Creating image(s)
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Did not create local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Ensure instance console log exists: /opt/stack/data/nova/instances/0c2a7205-02b3-488f-b062-f7f676413cc5/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Start _get_guest_xml network_info=[{"id": "9750238c-1417-442c-a71c-9c04bb43388d", "address": "fa:16:3e:65:2e:c7", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9750238c-14", "ovs_interfaceid": "9750238c-1417-442c-a71c-9c04bb43388d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '1968c3b0-53e7-400f-a37b-11d1234ab1b6', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbjVhEQp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0c2a7205-02b3-488f-b062-f7f676413cc5', 'attached_at': '', 'detached_at': '', 'volume_id': '7300b2df-bebb-4f52-8f2f-02866067c406', 'serial': '7300b2df-bebb-4f52-8f2f-02866067c406'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:11:26 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:11:26 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbjVhEQp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:11:26 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:11:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:11:26 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:11:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:11:26 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d337f23b-03c7-4838-bcb8-a8d158925706]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:11:26 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d66d79-389f-45ce-95e1-dd72a58e6a5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406] added
Nov 29 06:11:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[384666ec-dd40-4ce0-b118-11bea6047773]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaf2b6e-ef53-456b-804e-b972a6db9dcf]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbjVhEQp {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbjVhEQp" returned: 0 in 0.027s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[869023b7-a56d-4b1f-ac80-0a9e3a5e8f94]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UbjVhEQp'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[929d7329-0339-4d56-b208-499f43ee148f]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dc2d75-8e32-4cea-9fbd-ed55cd794778]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2278c75-b543-4ff4-9c7e-a5fefbc87cca (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9439b98d-9811-4912-8555-e7ddb18d40c4 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:11:26 user nova-compute[75083]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)
Nov 29 06:11:26 user nova-compute[75083]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2278c75-b543-4ff4-9c7e-a5fefbc87cca (non-flash)
Nov 29 06:11:26 user nova-compute[75083]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9439b98d-9811-4912-8555-e7ddb18d40c4 (non-flash)
Nov 29 06:11:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:11:26 user nova-compute[75083]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)
Nov 29 06:11:26 user nova-compute[75083]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2278c75-b543-4ff4-9c7e-a5fefbc87cca (non-flash)
Nov 29 06:11:26 user nova-compute[75083]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9439b98d-9811-4912-8555-e7ddb18d40c4 (non-flash)
Nov 29 06:11:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09b04ac-b73d-4759-916b-5a861546af26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406, portal: 172.16.0.220,3260]
Nov 29 06:11:26 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406, portal: 172.16.0.220,3260] successful.
Nov 29 06:11:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1056de42-f085-4d72-96c9-d419e7196212]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e639061f-7133-42c4-9f6a-3edac8c356de]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2278c75-b543-4ff4-9c7e-a5fefbc87cca (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9439b98d-9811-4912-8555-e7ddb18d40c4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:11:27 user nova-compute[75083]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)
Nov 29 06:11:27 user nova-compute[75083]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2278c75-b543-4ff4-9c7e-a5fefbc87cca (non-flash)
Nov 29 06:11:27 user nova-compute[75083]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9439b98d-9811-4912-8555-e7ddb18d40c4 (non-flash)
Nov 29 06:11:27 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:11:27 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:11:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:11:27 user nova-compute[75083]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)
Nov 29 06:11:27 user nova-compute[75083]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2278c75-b543-4ff4-9c7e-a5fefbc87cca (non-flash)
Nov 29 06:11:27 user nova-compute[75083]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9439b98d-9811-4912-8555-e7ddb18d40c4 (non-flash)
Nov 29 06:11:27 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:11:27 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:11:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:11:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:11:27 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] HCTL ('37', '-', '-', 0) found on session 48 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:11:27 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:11:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3f9ecf-179e-476c-94d9-d1e622383e62]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:27 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Searching for a device in session 48 and hctl ['37', '*', '*', 0] yield: None {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:11:27 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:11:27 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Searching for a device in session 48 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbjVhEQp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23433646230643761', 'path': '/dev/sdf'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433646230643761', 'path': '/dev/sdf'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-727297675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-727297675',id=41,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47694ecf400b4d6c952d0c06d0764d1b',ramdisk_id='',reservation_id='r-f5vw9m4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:11:12Z,user_data=None,user_id='4145bf5a07ea4d398f1a1e10a976c10f',uuid=0c2a7205-02b3-488f-b062-f7f676413cc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9750238c-1417-442c-a71c-9c04bb43388d", "address": "fa:16:3e:65:2e:c7", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9750238c-14", "ovs_interfaceid": "9750238c-1417-442c-a71c-9c04bb43388d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converting VIF {"id": "9750238c-1417-442c-a71c-9c04bb43388d", "address": "fa:16:3e:65:2e:c7", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9750238c-14", "ovs_interfaceid": "9750238c-1417-442c-a71c-9c04bb43388d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:2e:c7,bridge_name='br-int',has_traffic_filtering=True,id=9750238c-1417-442c-a71c-9c04bb43388d,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9750238c-14') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG nova.objects.instance [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c2a7205-02b3-488f-b062-f7f676413cc5 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:11:28 user nova-compute[75083]:   <uuid>0c2a7205-02b3-488f-b062-f7f676413cc5</uuid>
Nov 29 06:11:28 user nova-compute[75083]:   <name>instance-00000029</name>
Nov 29 06:11:28 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:11:28 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:11:28 user nova-compute[75083]:   <metadata>
Nov 29 06:11:28 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:11:28 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:11:28 user nova-compute[75083]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-727297675</nova:name>
Nov 29 06:11:28 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:11:26</nova:creationTime>
Nov 29 06:11:28 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:11:28 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:11:28 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:11:28 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:11:28 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:11:28 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:11:28 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:11:28 user nova-compute[75083]:       <nova:owner>
Nov 29 06:11:28 user nova-compute[75083]:         <nova:user uuid="4145bf5a07ea4d398f1a1e10a976c10f">tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member</nova:user>
Nov 29 06:11:28 user nova-compute[75083]:         <nova:project uuid="47694ecf400b4d6c952d0c06d0764d1b">tempest-ServerBootFromVolumeStableRescueTest-1530350051</nova:project>
Nov 29 06:11:28 user nova-compute[75083]:       </nova:owner>
Nov 29 06:11:28 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 06:11:28 user nova-compute[75083]:       <nova:ports>
Nov 29 06:11:28 user nova-compute[75083]:         <nova:port uuid="9750238c-1417-442c-a71c-9c04bb43388d">
Nov 29 06:11:28 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 06:11:28 user nova-compute[75083]:         </nova:port>
Nov 29 06:11:28 user nova-compute[75083]:       </nova:ports>
Nov 29 06:11:28 user nova-compute[75083]:     </nova:instance>
Nov 29 06:11:28 user nova-compute[75083]:   </metadata>
Nov 29 06:11:28 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:11:28 user nova-compute[75083]:     <system>
Nov 29 06:11:28 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:11:28 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:11:28 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:11:28 user nova-compute[75083]:       <entry name="serial">0c2a7205-02b3-488f-b062-f7f676413cc5</entry>
Nov 29 06:11:28 user nova-compute[75083]:       <entry name="uuid">0c2a7205-02b3-488f-b062-f7f676413cc5</entry>
Nov 29 06:11:28 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:11:28 user nova-compute[75083]:     </system>
Nov 29 06:11:28 user nova-compute[75083]:   </sysinfo>
Nov 29 06:11:28 user nova-compute[75083]:   <os>
Nov 29 06:11:28 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:11:28 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:11:28 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:11:28 user nova-compute[75083]:   </os>
Nov 29 06:11:28 user nova-compute[75083]:   <features>
Nov 29 06:11:28 user nova-compute[75083]:     <acpi/>
Nov 29 06:11:28 user nova-compute[75083]:     <apic/>
Nov 29 06:11:28 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:11:28 user nova-compute[75083]:   </features>
Nov 29 06:11:28 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:11:28 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:11:28 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:11:28 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:11:28 user nova-compute[75083]:   </clock>
Nov 29 06:11:28 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:11:28 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:11:28 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:11:28 user nova-compute[75083]:   </cpu>
Nov 29 06:11:28 user nova-compute[75083]:   <devices>
Nov 29 06:11:28 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 06:11:28 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:11:28 user nova-compute[75083]:       <source dev="/dev/sdf"/>
Nov 29 06:11:28 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:11:28 user nova-compute[75083]:       <serial>7300b2df-bebb-4f52-8f2f-02866067c406</serial>
Nov 29 06:11:28 user nova-compute[75083]:     </disk>
Nov 29 06:11:28 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:11:28 user nova-compute[75083]:       <mac address="fa:16:3e:65:2e:c7"/>
Nov 29 06:11:28 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:11:28 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:11:28 user nova-compute[75083]:       <target dev="tap9750238c-14"/>
Nov 29 06:11:28 user nova-compute[75083]:     </interface>
Nov 29 06:11:28 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:11:28 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/0c2a7205-02b3-488f-b062-f7f676413cc5/console.log" append="off"/>
Nov 29 06:11:28 user nova-compute[75083]:     </serial>
Nov 29 06:11:28 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:11:28 user nova-compute[75083]:     <video>
Nov 29 06:11:28 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:11:28 user nova-compute[75083]:     </video>
Nov 29 06:11:28 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:11:28 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:11:28 user nova-compute[75083]:     </rng>
Nov 29 06:11:28 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:11:28 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:11:28 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:11:28 user nova-compute[75083]:     </memballoon>
Nov 29 06:11:28 user nova-compute[75083]:   </devices>
Nov 29 06:11:28 user nova-compute[75083]: </domain>
Nov 29 06:11:28 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-727297675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-727297675',id=41,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47694ecf400b4d6c952d0c06d0764d1b',ramdisk_id='',reservation_id='r-f5vw9m4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:11:12Z,user_data=None,user_id='4145bf5a07ea4d398f1a1e10a976c10f',uuid=0c2a7205-02b3-488f-b062-f7f676413cc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9750238c-1417-442c-a71c-9c04bb43388d", "address": "fa:16:3e:65:2e:c7", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9750238c-14", "ovs_interfaceid": "9750238c-1417-442c-a71c-9c04bb43388d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converting VIF {"id": "9750238c-1417-442c-a71c-9c04bb43388d", "address": "fa:16:3e:65:2e:c7", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9750238c-14", "ovs_interfaceid": "9750238c-1417-442c-a71c-9c04bb43388d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:2e:c7,bridge_name='br-int',has_traffic_filtering=True,id=9750238c-1417-442c-a71c-9c04bb43388d,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9750238c-14') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG os_vif [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:2e:c7,bridge_name='br-int',has_traffic_filtering=True,id=9750238c-1417-442c-a71c-9c04bb43388d,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9750238c-14') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e81220d8-3c3d-52ab-8c73-61f777893564', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9750238c-14, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9750238c-14, col_values=(('qos', UUID('33360c40-00c1-4bad-8fbf-bc9259abb723')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9750238c-14, col_values=(('external_ids', {'iface-id': '9750238c-1417-442c-a71c-9c04bb43388d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:2e:c7', 'vm-uuid': '0c2a7205-02b3-488f-b062-f7f676413cc5'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:28 user nova-compute[75083]: INFO os_vif [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:2e:c7,bridge_name='br-int',has_traffic_filtering=True,id=9750238c-1417-442c-a71c-9c04bb43388d,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9750238c-14')
Nov 29 06:11:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] No VIF found with MAC fa:16:3e:65:2e:c7, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Updating instance_info_cache with network_info: [{"id": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "address": "fa:16:3e:8a:f0:ed", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb2c35d-ef", "ovs_interfaceid": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:11:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:11:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:29 user nova-compute[75083]: DEBUG nova.compute.manager [req-a77d2967-deb9-4c5b-bc55-8846d52c3e72 req-b6eb228a-ec9d-41e3-b92e-2d104346e88b service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received event network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:11:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a77d2967-deb9-4c5b-bc55-8846d52c3e72 req-b6eb228a-ec9d-41e3-b92e-2d104346e88b service nova] Acquiring lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:11:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a77d2967-deb9-4c5b-bc55-8846d52c3e72 req-b6eb228a-ec9d-41e3-b92e-2d104346e88b service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:11:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a77d2967-deb9-4c5b-bc55-8846d52c3e72 req-b6eb228a-ec9d-41e3-b92e-2d104346e88b service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:11:29 user nova-compute[75083]: DEBUG nova.compute.manager [req-a77d2967-deb9-4c5b-bc55-8846d52c3e72 req-b6eb228a-ec9d-41e3-b92e-2d104346e88b service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] No waiting events found dispatching network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:11:29 user nova-compute[75083]: WARNING nova.compute.manager [req-a77d2967-deb9-4c5b-bc55-8846d52c3e72 req-b6eb228a-ec9d-41e3-b92e-2d104346e88b service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received unexpected event network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d for instance with vm_state building and task_state spawning.
Nov 29 06:11:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:31 user nova-compute[75083]: DEBUG nova.compute.manager [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:11:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:11:31 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Instance spawned successfully.
Nov 29 06:11:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:11:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:11:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:11:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:11:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:11:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:11:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:11:31 user nova-compute[75083]: INFO nova.compute.manager [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Took 5.15 seconds to spawn the instance on the hypervisor.
Nov 29 06:11:31 user nova-compute[75083]: DEBUG nova.compute.manager [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:11:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-d886d1be-2e46-4edd-9f9b-e83597d36690 req-7e9de2af-9db4-4c13-b3bb-2a8f4c5f14dc service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received event network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:11:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d886d1be-2e46-4edd-9f9b-e83597d36690 req-7e9de2af-9db4-4c13-b3bb-2a8f4c5f14dc service nova] Acquiring lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:11:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d886d1be-2e46-4edd-9f9b-e83597d36690 req-7e9de2af-9db4-4c13-b3bb-2a8f4c5f14dc service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:11:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d886d1be-2e46-4edd-9f9b-e83597d36690 req-7e9de2af-9db4-4c13-b3bb-2a8f4c5f14dc service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:11:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-d886d1be-2e46-4edd-9f9b-e83597d36690 req-7e9de2af-9db4-4c13-b3bb-2a8f4c5f14dc service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] No waiting events found dispatching network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:11:31 user nova-compute[75083]: WARNING nova.compute.manager [req-d886d1be-2e46-4edd-9f9b-e83597d36690 req-7e9de2af-9db4-4c13-b3bb-2a8f4c5f14dc service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received unexpected event network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d for instance with vm_state building and task_state spawning.
Nov 29 06:11:31 user nova-compute[75083]: INFO nova.compute.manager [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Took 20.21 seconds to build instance.
Nov 29 06:11:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dead4d3e-d7cf-4628-bb88-8bac5f8bb13a tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.300s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:11:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:37 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4778c1d7-7248-4449-9743-56d95aab658a is timed out.
Nov 29 06:11:37 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Successfully detached device vdb from instance 4778c1d7-7248-4449-9743-56d95aab658a from the live domain config.
Nov 29 06:11:37 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWfTMkYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:11:37 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:11:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bed29c-519a-4d20-9e8f-bbd921dc5c93]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:11:37 user nova-compute[75083]: No targets found.
Nov 29 06:11:37 user nova-compute[75083]: iSNS:
Nov 29 06:11:37 user nova-compute[75083]: No targets found.
Nov 29 06:11:37 user nova-compute[75083]: STATIC:
Nov 29 06:11:37 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856
Nov 29 06:11:37 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:11:37 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:11:37 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406
Nov 29 06:11:37 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:11:37 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:11:37 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d
Nov 29 06:11:37 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:11:37 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:11:37 user nova-compute[75083]: FIRMWARE:
Nov 29 06:11:37 user nova-compute[75083]: No targets found.
Nov 29 06:11:37 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:11:37 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:11:37 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec9a27a-488d-4f68-9dd1-f6079fb2df58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bba3be-b6e5-475a-8602-87aff1b1736c]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:11:37 user nova-compute[75083]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)
Nov 29 06:11:37 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:11:37 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:11:37 user nova-compute[75083]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d (non-flash)
Nov 29 06:11:37 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:11:37 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b84df9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9236016-b02a-4eb9-a237-d309b723d0dd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[998f58b2-4f5d-4b2a-91b6-e454e94c9475]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f6405e-4d4d-4058-b878-c57e5701ddff]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbc9aa8-8da1-443f-ae68-e5baab502e1e]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[80761362-874f-4265-92e9-01dd9e243fcd]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff1f399-7ad8-4e3c-84fb-d3ff797ea659]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d, portal: 172.16.0.220,3260]
Nov 29 06:11:37 user nova-compute[75083]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d, portal: 172.16.0.220,3260] successful.
Nov 29 06:11:37 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7c8f31-9b5b-4bd5-9309-903ae880cf4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fa2dbd-4aca-42df-9f40-10d4046f7e6b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] <== disconnect_volume: return (299ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:11:37 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:11:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:11:38 user nova-compute[75083]: DEBUG nova.objects.instance [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lazy-loading 'flavor' on Instance uuid 4778c1d7-7248-4449-9743-56d95aab658a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:11:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5217e776-3fb7-4c18-9372-2743adfcbd93 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "4778c1d7-7248-4449-9743-56d95aab658a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.693s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:11:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:11:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:11:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:11:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:11:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "08b33e17-334b-4816-bcf6-26a67f132bc1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:11:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:11:47 user nova-compute[75083]: DEBUG nova.objects.instance [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lazy-loading 'flavor' on Instance uuid 08b33e17-334b-4816-bcf6-26a67f132bc1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:11:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "08b33e17-334b-4816-bcf6-26a67f132bc1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:11:48 user nova-compute[75083]: INFO nova.compute.manager [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Attaching volume 90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f to /dev/vdb
Nov 29 06:11:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG os_brick.utils [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1907e93b-123c-4586-aad3-61f5f9a84b4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a541ba4-5d91-4f97-a6fa-2eb456c6c26d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3d2493-40b7-4a7d-92b5-418319663b94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8926b9-d9be-4f6e-8799-66bfb087403d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:11:48 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:11:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfffada-8c50-463a-a48c-ff76535ea838]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG os_brick.utils [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:11:48 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Updating existing volume attachment record: 86092bed-f4b8-4129-8b81-ed773cd92a23 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:11:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syGIWbmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:11:55 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:11:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:11:55 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:11:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:11:55 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d907e1-9de1-41bb-be98-faf1f9f42d6b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:11:55 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9557f102-1d59-4c23-acc6-ce6fba2534e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f] added
Nov 29 06:11:55 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6f5dcb-d9e8-4995-829f-db353d58e270]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[946e7f35-0799-40e5-b497-52bfe3b4916e]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v syGIWbmL {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v syGIWbmL" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4b5b7f-a2b1-4046-82b8-d790a258cf3f]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'syGIWbmL'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c33c20-e9bb-4534-ab5e-8a67e2306e14]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27e28ba-7b39-45d8-b009-124ab4292d25]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:11:55 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:11:55 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:11:55 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:11:55 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:11:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5862422f-1164-44cc-8e23-f7c95f810ea4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f, portal: 172.16.0.220,3260]
Nov 29 06:11:56 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f, portal: 172.16.0.220,3260] successful.
Nov 29 06:11:56 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fe4575-b447-4ab2-a3c1-cc16246b0c2b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[67af96ba-8f20-4c01-bb30-fa7126280cfc]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:11:56 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:11:56 user nova-compute[75083]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f (non-flash)
Nov 29 06:11:56 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:11:56 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:11:56 user nova-compute[75083]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f (non-flash)
Nov 29 06:11:56 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[70156313-e9c0-40b0-b605-232a0b547900]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:11:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:57 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:11:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syGIWbmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:11:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:11:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26565396465356237', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:11:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565396465356237', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:11:57 user nova-compute[75083]: DEBUG nova.objects.instance [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lazy-loading 'flavor' on Instance uuid 08b33e17-334b-4816-bcf6-26a67f132bc1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:11:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 06:11:57 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:11:57 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:11:57 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:11:57 user nova-compute[75083]:   <serial>90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f</serial>
Nov 29 06:11:57 user nova-compute[75083]: </disk>
Nov 29 06:11:57 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 06:11:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:11:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:11:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] No VIF found with MAC fa:16:3e:11:81:6e, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:11:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b2ff56c4-88a8-438b-82a6-11b1c5fa34ab tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.624s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:11:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:11:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "08b33e17-334b-4816-bcf6-26a67f132bc1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:11:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:11:59 user nova-compute[75083]: INFO nova.compute.manager [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Detaching volume 90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f
Nov 29 06:11:59 user nova-compute[75083]: INFO nova.virt.block_device [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Attempting to driver detach volume 90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f from mountpoint /dev/vdb
Nov 29 06:11:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Attempting to detach device vdb from instance 08b33e17-334b-4816-bcf6-26a67f132bc1 from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 06:11:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:11:59 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:11:59 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:11:59 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:11:59 user nova-compute[75083]:   <serial>90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f</serial>
Nov 29 06:11:59 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:11:59 user nova-compute[75083]: </disk>
Nov 29 06:11:59 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:11:59 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Successfully detached device vdb from instance 08b33e17-334b-4816-bcf6-26a67f132bc1 from the persistent domain config.
Nov 29 06:11:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 08b33e17-334b-4816-bcf6-26a67f132bc1 from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 06:11:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:11:59 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:11:59 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:11:59 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:11:59 user nova-compute[75083]:   <serial>90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f</serial>
Nov 29 06:11:59 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:11:59 user nova-compute[75083]: </disk>
Nov 29 06:11:59 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:12:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 08b33e17-334b-4816-bcf6-26a67f132bc1 {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 06:12:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "4778c1d7-7248-4449-9743-56d95aab658a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:12:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "4778c1d7-7248-4449-9743-56d95aab658a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:12:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "4778c1d7-7248-4449-9743-56d95aab658a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:12:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "4778c1d7-7248-4449-9743-56d95aab658a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:12:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "4778c1d7-7248-4449-9743-56d95aab658a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:12:10 user nova-compute[75083]: INFO nova.compute.manager [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Terminating instance
Nov 29 06:12:10 user nova-compute[75083]: DEBUG nova.compute.manager [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:12:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-a95ae147-387b-4835-b05f-bb002c95b08a req-9b573c74-09b7-4533-b892-710b6576802e service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received event network-vif-unplugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:12:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a95ae147-387b-4835-b05f-bb002c95b08a req-9b573c74-09b7-4533-b892-710b6576802e service nova] Acquiring lock "4778c1d7-7248-4449-9743-56d95aab658a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:12:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a95ae147-387b-4835-b05f-bb002c95b08a req-9b573c74-09b7-4533-b892-710b6576802e service nova] Lock "4778c1d7-7248-4449-9743-56d95aab658a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:12:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a95ae147-387b-4835-b05f-bb002c95b08a req-9b573c74-09b7-4533-b892-710b6576802e service nova] Lock "4778c1d7-7248-4449-9743-56d95aab658a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:12:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-a95ae147-387b-4835-b05f-bb002c95b08a req-9b573c74-09b7-4533-b892-710b6576802e service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] No waiting events found dispatching network-vif-unplugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:12:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-a95ae147-387b-4835-b05f-bb002c95b08a req-9b573c74-09b7-4533-b892-710b6576802e service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received event network-vif-unplugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:12:11 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Instance destroyed successfully.
Nov 29 06:12:11 user nova-compute[75083]: DEBUG nova.objects.instance [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lazy-loading 'resources' on Instance uuid 4778c1d7-7248-4449-9743-56d95aab658a {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:12:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1196933813',display_name='tempest-TestMinimumBasicScenario-server-1196933813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1196933813',id=37,image_ref='3369687c-be1f-4764-a66e-a30d90e3560a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNX5DKDRwMOdT2gJ7zxJs99EoHSy7Ya/opoGPgZqjC3/D2mNeldvd8HQ3YuuVj1eMJIrbJ2TTot5Ys4Uh6Fg/WjBS34zl9yNXEoKlsVjbAM0EeJPyfspLxNeUO2WZE1WmA==',key_name='tempest-TestMinimumBasicScenario-235294968',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:07:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0801cbd66c8457b887d383721d95915',ramdisk_id='',reservation_id='r-h363mm50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3369687c-be1f-4764-a66e-a30d90e3560a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2019017585',owner_user_name='tempest-TestMinimumBasicScenario-2019017585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:09:31Z,user_data=None,user_id='eb526efdda0c4ca2ba8e739ecbe9e148',uuid=4778c1d7-7248-4449-9743-56d95aab658a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "address": "fa:16:3e:b2:03:18", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e12473-48", "ovs_interfaceid": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:12:11 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Converting VIF {"id": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "address": "fa:16:3e:b2:03:18", "network": {"id": "d6e1190c-e1ad-410d-9f43-6176a9e6ef0c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2129106432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0801cbd66c8457b887d383721d95915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e12473-48", "ovs_interfaceid": "f6e12473-48ac-49f8-ac20-12a3d9e59a56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:12:11 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:03:18,bridge_name='br-int',has_traffic_filtering=True,id=f6e12473-48ac-49f8-ac20-12a3d9e59a56,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e12473-48') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:12:11 user nova-compute[75083]: DEBUG os_vif [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:03:18,bridge_name='br-int',has_traffic_filtering=True,id=f6e12473-48ac-49f8-ac20-12a3d9e59a56,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e12473-48') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:12:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6e12473-48, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:12:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:12:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67b8e24d-3fcc-4bb1-88e7-f129707e8e53) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:12:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:12:11 user nova-compute[75083]: INFO os_vif [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:03:18,bridge_name='br-int',has_traffic_filtering=True,id=f6e12473-48ac-49f8-ac20-12a3d9e59a56,network=Network(d6e1190c-e1ad-410d-9f43-6176a9e6ef0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e12473-48')
Nov 29 06:12:11 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Deleting instance files /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a_del
Nov 29 06:12:11 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Deletion of /opt/stack/data/nova/instances/4778c1d7-7248-4449-9743-56d95aab658a_del complete
Nov 29 06:12:11 user nova-compute[75083]: INFO nova.compute.manager [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 06:12:11 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:12:11 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:12:11 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:12:11 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:12:11 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Took 0.59 seconds to deallocate network for instance.
Nov 29 06:12:11 user nova-compute[75083]: DEBUG nova.compute.manager [req-ce2d710f-7f63-4a65-8c9c-c988a1814e7c req-011faf82-1c36-4c7d-9f8c-3c59d4cd5fe2 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received event network-vif-deleted-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:12:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:12:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:12:12 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:12:12 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:12:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:12:12 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Deleted allocations for instance 4778c1d7-7248-4449-9743-56d95aab658a
Nov 29 06:12:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-44057ba0-0899-45f4-9cef-7c5c70a370d9 tempest-TestMinimumBasicScenario-2019017585 tempest-TestMinimumBasicScenario-2019017585-project-member] Lock "4778c1d7-7248-4449-9743-56d95aab658a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.933s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:12:12 user nova-compute[75083]: DEBUG nova.compute.manager [req-eda0d211-d8f6-4e57-8ca6-94343eef87b9 req-695671d6-b98e-4e9f-ad82-159214437c85 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received event network-vif-plugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:12:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-eda0d211-d8f6-4e57-8ca6-94343eef87b9 req-695671d6-b98e-4e9f-ad82-159214437c85 service nova] Acquiring lock "4778c1d7-7248-4449-9743-56d95aab658a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:12:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-eda0d211-d8f6-4e57-8ca6-94343eef87b9 req-695671d6-b98e-4e9f-ad82-159214437c85 service nova] Lock "4778c1d7-7248-4449-9743-56d95aab658a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:12:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-eda0d211-d8f6-4e57-8ca6-94343eef87b9 req-695671d6-b98e-4e9f-ad82-159214437c85 service nova] Lock "4778c1d7-7248-4449-9743-56d95aab658a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:12:12 user nova-compute[75083]: DEBUG nova.compute.manager [req-eda0d211-d8f6-4e57-8ca6-94343eef87b9 req-695671d6-b98e-4e9f-ad82-159214437c85 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] No waiting events found dispatching network-vif-plugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:12:12 user nova-compute[75083]: WARNING nova.compute.manager [req-eda0d211-d8f6-4e57-8ca6-94343eef87b9 req-695671d6-b98e-4e9f-ad82-159214437c85 service nova] [instance: 4778c1d7-7248-4449-9743-56d95aab658a] Received unexpected event network-vif-plugged-f6e12473-48ac-49f8-ac20-12a3d9e59a56 for instance with vm_state deleted and task_state None.
Nov 29 06:12:13 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:12:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:15 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:12:15 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:12:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:16 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:12:16 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:12:17 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:12:19 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:12:20 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 08b33e17-334b-4816-bcf6-26a67f132bc1 is timed out.
Nov 29 06:12:20 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Successfully detached device vdb from instance 08b33e17-334b-4816-bcf6-26a67f132bc1 from the live domain config.
Nov 29 06:12:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syGIWbmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:12:20 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:12:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a4d03f-11f4-4e8a-b31c-6798f734660e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:12:20 user nova-compute[75083]: No targets found.
Nov 29 06:12:20 user nova-compute[75083]: iSNS:
Nov 29 06:12:20 user nova-compute[75083]: No targets found.
Nov 29 06:12:20 user nova-compute[75083]: STATIC:
Nov 29 06:12:20 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f
Nov 29 06:12:20 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:12:20 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:12:20 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856
Nov 29 06:12:20 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:12:20 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:12:20 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406
Nov 29 06:12:20 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:12:20 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:12:20 user nova-compute[75083]: FIRMWARE:
Nov 29 06:12:20 user nova-compute[75083]: No targets found.
Nov 29 06:12:20 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:12:20 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:12:20 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[987dd864-0e18-46c5-8ff0-6666dea1e563]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b72dd7-c67f-4a89-b7c0-a1ea255eeb15]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:12:20 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:12:20 user nova-compute[75083]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f (non-flash)
Nov 29 06:12:20 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:12:20 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:12:20 user nova-compute[75083]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f (non-flash)
Nov 29 06:12:20 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b8326e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[059323e1-94e4-4864-950b-cac65626f32e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f632024-7c05-470d-8008-59f94316c7f6]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[68777b88-8c0c-4815-bffe-0405d7066bde]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5621a91-2e77-44e6-815e-a2ab4d2ce406]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e348a038-c152-420a-af6c-b97aa63fda5d]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7823f5bd-eba7-431f-ba1b-c27d1b40d87d]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f, portal: 172.16.0.220,3260]
Nov 29 06:12:20 user nova-compute[75083]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f, portal: 172.16.0.220,3260] successful.
Nov 29 06:12:20 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f4f299-4ac2-4c7f-b07d-01cae9cf8f6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9843c060-a9d6-48ac-8625-48b2b84989f2]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] <== disconnect_volume: return (288ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:12:20 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75083) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 06:12:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:12:21 user nova-compute[75083]: DEBUG nova.objects.instance [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lazy-loading 'flavor' on Instance uuid 08b33e17-334b-4816-bcf6-26a67f132bc1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:12:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-34a9c018-3128-4061-a5d6-6b3b360c7642 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.745s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:12:21 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:12:23 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:12:23 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:12:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:12:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:12:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:12:23 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:12:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:12:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:12:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:25 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:12:25 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:12:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8369MB free_disk=24.968868255615234GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:12:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:12:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:12:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:12:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fea64bdc-491c-46ba-9447-c175df432deb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:12:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance be4598f6-6ee2-4219-b8a2-446ba87b2efd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:12:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 08b33e17-334b-4816-bcf6-26a67f132bc1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:12:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a9111c14-9bfb-4cc1-98ab-eabbf85f9568 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:12:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 0c2a7205-02b3-488f-b062-f7f676413cc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:12:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:12:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:12:25 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing inventories for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 06:12:25 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Updating ProviderTree inventory for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 06:12:25 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Updating inventory in ProviderTree for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 06:12:25 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing aggregate associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, aggregates: None {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 06:12:26 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing trait associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, traits: HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 06:12:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:12:26 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:12:26 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:12:26 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:12:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.635s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:12:26 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:12:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 06:12:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] There are 0 instances to clean {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 06:12:28 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:12:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:12:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:12:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:12:28 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:12:28 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Updating instance_info_cache with network_info: [{"id": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "address": "fa:16:3e:e1:f6:16", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feebf60-26", "ovs_interfaceid": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:12:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:12:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:12:29 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:12:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:12:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:12:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:12:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:12:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:35 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:12:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:12:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:12:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:12:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:12:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-19a96a74-cdbf-43bc-bccf-785672beef8f req-96492706-e2b1-4d7c-89c7-c37924b37e1f service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Received event network-changed-d0dd55dc-570c-40d2-82d1-9330a375972b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:12:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-19a96a74-cdbf-43bc-bccf-785672beef8f req-96492706-e2b1-4d7c-89c7-c37924b37e1f service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Refreshing instance network info cache due to event network-changed-d0dd55dc-570c-40d2-82d1-9330a375972b. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:12:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-19a96a74-cdbf-43bc-bccf-785672beef8f req-96492706-e2b1-4d7c-89c7-c37924b37e1f service nova] Acquiring lock "refresh_cache-a9111c14-9bfb-4cc1-98ab-eabbf85f9568" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:12:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-19a96a74-cdbf-43bc-bccf-785672beef8f req-96492706-e2b1-4d7c-89c7-c37924b37e1f service nova] Acquired lock "refresh_cache-a9111c14-9bfb-4cc1-98ab-eabbf85f9568" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:12:42 user nova-compute[75083]: DEBUG nova.network.neutron [req-19a96a74-cdbf-43bc-bccf-785672beef8f req-96492706-e2b1-4d7c-89c7-c37924b37e1f service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Refreshing network info cache for port d0dd55dc-570c-40d2-82d1-9330a375972b {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:12:42 user nova-compute[75083]: DEBUG nova.network.neutron [req-19a96a74-cdbf-43bc-bccf-785672beef8f req-96492706-e2b1-4d7c-89c7-c37924b37e1f service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Updated VIF entry in instance network info cache for port d0dd55dc-570c-40d2-82d1-9330a375972b. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:12:42 user nova-compute[75083]: DEBUG nova.network.neutron [req-19a96a74-cdbf-43bc-bccf-785672beef8f req-96492706-e2b1-4d7c-89c7-c37924b37e1f service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Updating instance_info_cache with network_info: [{"id": "d0dd55dc-570c-40d2-82d1-9330a375972b", "address": "fa:16:3e:c8:4e:7c", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd55dc-57", "ovs_interfaceid": "d0dd55dc-570c-40d2-82d1-9330a375972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:12:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-19a96a74-cdbf-43bc-bccf-785672beef8f req-96492706-e2b1-4d7c-89c7-c37924b37e1f service nova] Releasing lock "refresh_cache-a9111c14-9bfb-4cc1-98ab-eabbf85f9568" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:12:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:12:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:12:45 user nova-compute[75083]: DEBUG nova.objects.instance [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lazy-loading 'flavor' on Instance uuid a9111c14-9bfb-4cc1-98ab-eabbf85f9568 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:12:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:12:46 user nova-compute[75083]: INFO nova.compute.manager [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Attaching volume f6000bef-41c8-4495-a1b3-0b9fd65f75fc to /dev/vdb
Nov 29 06:12:46 user nova-compute[75083]: DEBUG os_brick.utils [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce04b0e-af01-434a-86dc-55fc140dc1ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b57fb5f-113b-489b-8392-e9392a709223]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82be463-8a74-415b-b0b6-cdff19d8bff1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5089c8-6fcb-4ea7-a7b1-9e9e2dee1e2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:12:46 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:12:46 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1603fe-52bc-46a6-a49e-5db2057c7db3]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG os_brick.utils [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Updating existing volume attachment record: 50510bfb-f11b-40c0-bcdd-c05447bc5f40 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:12:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "08b33e17-334b-4816-bcf6-26a67f132bc1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG nova.objects.instance [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lazy-loading 'flavor' on Instance uuid 08b33e17-334b-4816-bcf6-26a67f132bc1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "08b33e17-334b-4816-bcf6-26a67f132bc1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:12:52 user nova-compute[75083]: INFO nova.compute.manager [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Attaching volume 74b56f7f-d843-4ee1-91f4-9331a0af2417 to /dev/vdb
Nov 29 06:12:52 user nova-compute[75083]: DEBUG os_brick.utils [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f89580-4b45-48a0-93a5-a71efaa10fa2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabe4017-061d-41ea-83f5-c53267387262]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e976174b-2b10-46bb-a6d7-a020a0469a52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[523bc388-7e2e-48bb-ad8b-d1a1c9324790]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:12:52 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:12:52 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffb0103-e8af-46ec-a787-513e682c2815]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG os_brick.utils [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:12:52 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Updating existing volume attachment record: 70a810d5-6f18-419b-9710-c9aec3a391b4 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlVWPsJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:12:53 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:12:53 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:12:53 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7472d4-b2f9-4f1e-8274-1167697c487a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:12:53 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a98c023-b3c7-4100-a7f3-e2e9686b5bed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc] added
Nov 29 06:12:53 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[66addb2d-96b7-4270-bcae-de56c4d338a6]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0673ca-f5d0-44b0-a19e-10f7909d68ad]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QlVWPsJC {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QlVWPsJC" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab21cda4-b5f0-491d-8733-bc79326aa101]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QlVWPsJC'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fe909d-adf6-4e67-961d-8e460d01150a]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1c9906-6a0f-4f70-853c-91d6fee333b9]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:12:53 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:12:53 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:12:53 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:12:53 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fee5f2-debf-4313-8d65-0cb27f676b1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc, portal: 172.16.0.220,3260]
Nov 29 06:12:53 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc, portal: 172.16.0.220,3260] successful.
Nov 29 06:12:53 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[095514cd-c087-4bfe-abf3-b229569dd58c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[05323911-f70a-4915-afec-3cd9d3c85735]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:12:53 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:12:53 user nova-compute[75083]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc (non-flash)
Nov 29 06:12:53 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:12:53 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:12:53 user nova-compute[75083]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc (non-flash)
Nov 29 06:12:53 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94e5d65-8080-4d23-879d-d1f924b19731]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:12:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlVWPsJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:12:54 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:12:54 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23038333234643236', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:12:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038333234643236', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:12:54 user nova-compute[75083]: DEBUG nova.objects.instance [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lazy-loading 'flavor' on Instance uuid a9111c14-9bfb-4cc1-98ab-eabbf85f9568 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:12:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 06:12:54 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:12:54 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:12:54 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:12:54 user nova-compute[75083]:   <serial>f6000bef-41c8-4495-a1b3-0b9fd65f75fc</serial>
Nov 29 06:12:54 user nova-compute[75083]: </disk>
Nov 29 06:12:54 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 06:12:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:12:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:12:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] No VIF found with MAC fa:16:3e:c8:4e:7c, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:12:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-186a6097-c081-4a62-b7a7-994b9e7effa5 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.221s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:12:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:12:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:12:56 user nova-compute[75083]: INFO nova.compute.manager [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Detaching volume f6000bef-41c8-4495-a1b3-0b9fd65f75fc
Nov 29 06:12:56 user nova-compute[75083]: INFO nova.virt.block_device [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Attempting to driver detach volume f6000bef-41c8-4495-a1b3-0b9fd65f75fc from mountpoint /dev/vdb
Nov 29 06:12:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Attempting to detach device vdb from instance a9111c14-9bfb-4cc1-98ab-eabbf85f9568 from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 06:12:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:12:56 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:12:56 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:12:56 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:12:56 user nova-compute[75083]:   <serial>f6000bef-41c8-4495-a1b3-0b9fd65f75fc</serial>
Nov 29 06:12:56 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:12:56 user nova-compute[75083]: </disk>
Nov 29 06:12:56 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:12:56 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Successfully detached device vdb from instance a9111c14-9bfb-4cc1-98ab-eabbf85f9568 from the persistent domain config.
Nov 29 06:12:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9111c14-9bfb-4cc1-98ab-eabbf85f9568 from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 06:12:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:12:56 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:12:56 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:12:56 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:12:56 user nova-compute[75083]:   <serial>f6000bef-41c8-4495-a1b3-0b9fd65f75fc</serial>
Nov 29 06:12:56 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:12:56 user nova-compute[75083]: </disk>
Nov 29 06:12:56 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:12:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:12:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9111c14-9bfb-4cc1-98ab-eabbf85f9568 {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 06:12:59 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid fea64bdc-491c-46ba-9447-c175df432deb {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid be4598f6-6ee2-4219-b8a2-446ba87b2efd {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid 08b33e17-334b-4816-bcf6-26a67f132bc1 {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid a9111c14-9bfb-4cc1-98ab-eabbf85f9568 {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid 0c2a7205-02b3-488f-b062-f7f676413cc5 {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "fea64bdc-491c-46ba-9447-c175df432deb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "fea64bdc-491c-46ba-9447-c175df432deb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "08b33e17-334b-4816-bcf6-26a67f132bc1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "0c2a7205-02b3-488f-b062-f7f676413cc5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "fea64bdc-491c-46ba-9447-c175df432deb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmupvWIT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:13:00 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:13:00 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:13:00 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e8f9bb-d46e-4a11-a8f0-0fe58a262012]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:13:00 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7031d70e-50ee-45fc-8af9-6652617ba16e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417] added
Nov 29 06:13:00 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[598dc424-b176-4027-b470-cb9947e00b1d]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d700675-9a44-49c6-bcda-f59d9c2415c4]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LmupvWIT {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LmupvWIT" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dfc8c5-2974-4501-a0b7-13b89e8fbcb1]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LmupvWIT'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb42020d-22f1-400a-853a-0d3a990da6bd]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f77c1b6-b9c1-4562-badc-e0ba5112c41e]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:13:00 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:13:00 user nova-compute[75083]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc (non-flash)
Nov 29 06:13:00 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:13:00 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:13:00 user nova-compute[75083]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc (non-flash)
Nov 29 06:13:00 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4139524-50f2-45a0-83be-fc41a72fee73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417, portal: 172.16.0.220,3260]
Nov 29 06:13:00 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417, portal: 172.16.0.220,3260] successful.
Nov 29 06:13:00 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ca69dd-ee6b-4263-b4ea-cc674ed364ab]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8e3d8b-7c75-45e8-a513-fae7d99ea570]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:13:00 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:13:00 user nova-compute[75083]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc (non-flash)
Nov 29 06:13:00 user nova-compute[75083]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 (non-flash)
Nov 29 06:13:00 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:13:00 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:13:00 user nova-compute[75083]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc (non-flash)
Nov 29 06:13:00 user nova-compute[75083]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 (non-flash)
Nov 29 06:13:00 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4622ef2-568d-419f-bbdc-a17820c59413]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:00 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:13:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:01 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:13:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmupvWIT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:13:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:13:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23962626266373135', 'path': '/dev/sdc'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:13:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962626266373135', 'path': '/dev/sdc'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:13:01 user nova-compute[75083]: DEBUG nova.objects.instance [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lazy-loading 'flavor' on Instance uuid 08b33e17-334b-4816-bcf6-26a67f132bc1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:13:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 06:13:01 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:13:01 user nova-compute[75083]:   <source dev="/dev/sdc"/>
Nov 29 06:13:01 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:13:01 user nova-compute[75083]:   <serial>74b56f7f-d843-4ee1-91f4-9331a0af2417</serial>
Nov 29 06:13:01 user nova-compute[75083]: </disk>
Nov 29 06:13:01 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 06:13:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:13:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:13:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] No VIF found with MAC fa:16:3e:11:81:6e, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:13:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-671133e2-3bb7-4b45-b86a-fc35d677ed77 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.211s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.004s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:02 user nova-compute[75083]: INFO nova.compute.manager [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Rescuing
Nov 29 06:13:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "refresh_cache-0c2a7205-02b3-488f-b062-f7f676413cc5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:13:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquired lock "refresh_cache-0c2a7205-02b3-488f-b062-f7f676413cc5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:13:02 user nova-compute[75083]: DEBUG nova.network.neutron [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:13:03 user nova-compute[75083]: DEBUG nova.network.neutron [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Updating instance_info_cache with network_info: [{"id": "9750238c-1417-442c-a71c-9c04bb43388d", "address": "fa:16:3e:65:2e:c7", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9750238c-14", "ovs_interfaceid": "9750238c-1417-442c-a71c-9c04bb43388d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:13:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Releasing lock "refresh_cache-0c2a7205-02b3-488f-b062-f7f676413cc5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:13:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:03 user nova-compute[75083]: DEBUG nova.compute.manager [req-59551fe6-0a90-4ced-8e2c-c909bead7a98 req-523d1af2-ee5e-4a7e-ac1b-8bd99a788199 service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received event network-vif-unplugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:13:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-59551fe6-0a90-4ced-8e2c-c909bead7a98 req-523d1af2-ee5e-4a7e-ac1b-8bd99a788199 service nova] Acquiring lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-59551fe6-0a90-4ced-8e2c-c909bead7a98 req-523d1af2-ee5e-4a7e-ac1b-8bd99a788199 service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-59551fe6-0a90-4ced-8e2c-c909bead7a98 req-523d1af2-ee5e-4a7e-ac1b-8bd99a788199 service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:03 user nova-compute[75083]: DEBUG nova.compute.manager [req-59551fe6-0a90-4ced-8e2c-c909bead7a98 req-523d1af2-ee5e-4a7e-ac1b-8bd99a788199 service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] No waiting events found dispatching network-vif-unplugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:13:03 user nova-compute[75083]: WARNING nova.compute.manager [req-59551fe6-0a90-4ced-8e2c-c909bead7a98 req-523d1af2-ee5e-4a7e-ac1b-8bd99a788199 service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received unexpected event network-vif-unplugged-9750238c-1417-442c-a71c-9c04bb43388d for instance with vm_state active and task_state rescuing.
Nov 29 06:13:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:03 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Instance destroyed successfully.
Nov 29 06:13:03 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Attempting a stable device rescue
Nov 29 06:13:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75083) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 06:13:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Instance directory exists: not creating {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 06:13:03 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Creating image(s)
Nov 29 06:13:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c2a7205-02b3-488f-b062-f7f676413cc5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "/opt/stack/data/nova/instances/0c2a7205-02b3-488f-b062-f7f676413cc5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "/opt/stack/data/nova/instances/0c2a7205-02b3-488f-b062-f7f676413cc5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:03 user nova-compute[75083]: DEBUG nova.objects.instance [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0c2a7205-02b3-488f-b062-f7f676413cc5 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:13:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "1c1c514aee71e41d2fd2c682f0e95530806cc53d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "1c1c514aee71e41d2fd2c682f0e95530806cc53d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c1c514aee71e41d2fd2c682f0e95530806cc53d.part --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "08b33e17-334b-4816-bcf6-26a67f132bc1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:05 user nova-compute[75083]: INFO nova.compute.manager [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Detaching volume 74b56f7f-d843-4ee1-91f4-9331a0af2417
Nov 29 06:13:05 user nova-compute[75083]: INFO nova.virt.block_device [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Attempting to driver detach volume 74b56f7f-d843-4ee1-91f4-9331a0af2417 from mountpoint /dev/vdb
Nov 29 06:13:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Attempting to detach device vdb from instance 08b33e17-334b-4816-bcf6-26a67f132bc1 from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 06:13:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:13:05 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:13:05 user nova-compute[75083]:   <source dev="/dev/sdc"/>
Nov 29 06:13:05 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:13:05 user nova-compute[75083]:   <serial>74b56f7f-d843-4ee1-91f4-9331a0af2417</serial>
Nov 29 06:13:05 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:13:05 user nova-compute[75083]: </disk>
Nov 29 06:13:05 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:13:05 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Successfully detached device vdb from instance 08b33e17-334b-4816-bcf6-26a67f132bc1 from the persistent domain config.
Nov 29 06:13:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 08b33e17-334b-4816-bcf6-26a67f132bc1 from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 06:13:05 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:13:05 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:13:05 user nova-compute[75083]:   <source dev="/dev/sdc"/>
Nov 29 06:13:05 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:13:05 user nova-compute[75083]:   <serial>74b56f7f-d843-4ee1-91f4-9331a0af2417</serial>
Nov 29 06:13:05 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:13:05 user nova-compute[75083]: </disk>
Nov 29 06:13:05 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:13:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c1c514aee71e41d2fd2c682f0e95530806cc53d.part --force-share --output=json" returned: 0 in 0.209s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:05 user nova-compute[75083]: DEBUG nova.virt.images [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] aa9b5958-7360-4c9d-a13a-985a112d2224 was qcow2, converting to raw {{(pid=75083) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 06:13:05 user nova-compute[75083]: DEBUG nova.privsep.utils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75083) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 06:13:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1c1c514aee71e41d2fd2c682f0e95530806cc53d.part /opt/stack/data/nova/instances/_base/1c1c514aee71e41d2fd2c682f0e95530806cc53d.converted {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:05 user nova-compute[75083]: DEBUG nova.compute.manager [req-2215994a-f642-4a13-9822-8bd5dfd68bf8 req-002da4c2-f917-4494-8f96-0ca227a7d5cb service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received event network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:13:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2215994a-f642-4a13-9822-8bd5dfd68bf8 req-002da4c2-f917-4494-8f96-0ca227a7d5cb service nova] Acquiring lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2215994a-f642-4a13-9822-8bd5dfd68bf8 req-002da4c2-f917-4494-8f96-0ca227a7d5cb service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2215994a-f642-4a13-9822-8bd5dfd68bf8 req-002da4c2-f917-4494-8f96-0ca227a7d5cb service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:05 user nova-compute[75083]: DEBUG nova.compute.manager [req-2215994a-f642-4a13-9822-8bd5dfd68bf8 req-002da4c2-f917-4494-8f96-0ca227a7d5cb service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] No waiting events found dispatching network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:13:05 user nova-compute[75083]: WARNING nova.compute.manager [req-2215994a-f642-4a13-9822-8bd5dfd68bf8 req-002da4c2-f917-4494-8f96-0ca227a7d5cb service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received unexpected event network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d for instance with vm_state active and task_state rescuing.
Nov 29 06:13:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 08b33e17-334b-4816-bcf6-26a67f132bc1 {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1c1c514aee71e41d2fd2c682f0e95530806cc53d.part /opt/stack/data/nova/instances/_base/1c1c514aee71e41d2fd2c682f0e95530806cc53d.converted" returned: 0 in 0.740s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c1c514aee71e41d2fd2c682f0e95530806cc53d.converted --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c1c514aee71e41d2fd2c682f0e95530806cc53d.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "1c1c514aee71e41d2fd2c682f0e95530806cc53d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.509s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "1c1c514aee71e41d2fd2c682f0e95530806cc53d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "1c1c514aee71e41d2fd2c682f0e95530806cc53d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c1c514aee71e41d2fd2c682f0e95530806cc53d --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c1c514aee71e41d2fd2c682f0e95530806cc53d --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1c1c514aee71e41d2fd2c682f0e95530806cc53d,backing_fmt=raw /opt/stack/data/nova/instances/0c2a7205-02b3-488f-b062-f7f676413cc5/disk.rescue {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1c1c514aee71e41d2fd2c682f0e95530806cc53d,backing_fmt=raw /opt/stack/data/nova/instances/0c2a7205-02b3-488f-b062-f7f676413cc5/disk.rescue" returned: 0 in 0.053s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "1c1c514aee71e41d2fd2c682f0e95530806cc53d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.objects.instance [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'migration_context' on Instance uuid 0c2a7205-02b3-488f-b062-f7f676413cc5 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.objects.base [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Object Instance<0c2a7205-02b3-488f-b062-f7f676413cc5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Start _get_guest_xml network_info=[{"id": "9750238c-1417-442c-a71c-9c04bb43388d", "address": "fa:16:3e:65:2e:c7", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "vif_mac": "fa:16:3e:65:2e:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9750238c-14", "ovs_interfaceid": "9750238c-1417-442c-a71c-9c04bb43388d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'aa9b5958-7360-4c9d-a13a-985a112d2224', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '1968c3b0-53e7-400f-a37b-11d1234ab1b6', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbjVhEQp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '0c2a7205-02b3-488f-b062-f7f676413cc5', 'attached_at': '', 'detached_at': '', 'volume_id': '7300b2df-bebb-4f52-8f2f-02866067c406', 'serial': '7300b2df-bebb-4f52-8f2f-02866067c406'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.objects.instance [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'resources' on Instance uuid 0c2a7205-02b3-488f-b062-f7f676413cc5 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.objects.base [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Object Instance<0c2a7205-02b3-488f-b062-f7f676413cc5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.objects.instance [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'numa_topology' on Instance uuid 0c2a7205-02b3-488f-b062-f7f676413cc5 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.objects.base [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Object Instance<0c2a7205-02b3-488f-b062-f7f676413cc5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 06:13:06 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:13:06 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.objects.instance [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0c2a7205-02b3-488f-b062-f7f676413cc5 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.objects.base [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Object Instance<0c2a7205-02b3-488f-b062-f7f676413cc5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbjVhEQp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:13:06 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:13:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:13:06 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:13:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:13:06 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c86fd6-ea22-46bf-8673-5d5e9a36bf9c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = UbjVhEQp\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 06:13:06 user nova-compute[75083]: node.name = iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406
Nov 29 06:13:06 user nova-compute[75083]: node.tpgt = -1
Nov 29 06:13:06 user nova-compute[75083]: node.startup = automatic
Nov 29 06:13:06 user nova-compute[75083]: node.leading_login = No
Nov 29 06:13:06 user nova-compute[75083]: iface.iscsi_ifacename = default
Nov 29 06:13:06 user nova-compute[75083]: iface.net_ifacename = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.ipaddress = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.prefix_len = 0
Nov 29 06:13:06 user nova-compute[75083]: iface.hwaddress = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.transport_name = tcp
Nov 29 06:13:06 user nova-compute[75083]: iface.initiatorname = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.state = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.vlan_id = 0
Nov 29 06:13:06 user nova-compute[75083]: iface.vlan_priority = 0
Nov 29 06:13:06 user nova-compute[75083]: iface.vlan_state = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.iface_num = 0
Nov 29 06:13:06 user nova-compute[75083]: iface.mtu = 0
Nov 29 06:13:06 user nova-compute[75083]: iface.port = 0
Nov 29 06:13:06 user nova-compute[75083]: iface.bootproto = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.subnet_mask = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.gateway = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.dhcp_alt_client_id = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.dhcp_dns = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.dhcp_learn_iqn = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.dhcp_vendor_id_state = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.dhcp_vendor_id = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.dhcp_slp_da = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.fragmentation = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.gratuitous_arp = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.incoming_forwarding = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.tos_state = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.tos = 0
Nov 29 06:13:06 user nova-compute[75083]: iface.ttl = 0
Nov 29 06:13:06 user nova-compute[75083]: iface.delayed_ack = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.tcp_nagle = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.tcp_wsf_state = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.tcp_wsf = 0
Nov 29 06:13:06 user nova-compute[75083]: iface.tcp_timer_scale = 0
Nov 29 06:13:06 user nova-compute[75083]: iface.tcp_timestamp = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.redirect = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.def_task_mgmt_timeout = 0
Nov 29 06:13:06 user nova-compute[75083]: iface.header_digest = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.data_digest = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.immediate_data = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.initial_r2t = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.data_seq_inorder = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.data_pdu_inorder = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.erl = 0
Nov 29 06:13:06 user nova-compute[75083]: iface.max_receive_data_len = 0
Nov 29 06:13:06 user nova-compute[75083]: iface.first_burst_len = 0
Nov 29 06:13:06 user nova-compute[75083]: iface.max_outstanding_r2t = 0
Nov 29 06:13:06 user nova-compute[75083]: iface.max_burst_len = 0
Nov 29 06:13:06 user nova-compute[75083]: iface.chap_auth = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.bidi_chap = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.strict_login_compliance = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.discovery_auth = <empty>
Nov 29 06:13:06 user nova-compute[75083]: iface.discovery_logout = <empty>
Nov 29 06:13:06 user nova-compute[75083]: node.discovery_address = <empty>
Nov 29 06:13:06 user nova-compute[75083]: node.discovery_port = 0
Nov 29 06:13:06 user nova-compute[75083]: node.discovery_type = static
Nov 29 06:13:06 user nova-compute[75083]: node.session.initial_cmdsn = 0
Nov 29 06:13:06 user nova-compute[75083]: node.session.initial_login_retry_max = 8
Nov 29 06:13:06 user nova-compute[75083]: node.session.xmit_thread_priority = -20
Nov 29 06:13:06 user nova-compute[75083]: node.session.cmds_max = 128
Nov 29 06:13:06 user nova-compute[75083]: node.session.queue_depth = 32
Nov 29 06:13:06 user nova-compute[75083]: node.session.nr_sessions = 1
Nov 29 06:13:06 user nova-compute[75083]: node.session.auth.authmethod = CHAP
Nov 29 06:13:06 user nova-compute[75083]: node.session.auth.username = UbjVhEQp
Nov 29 06:13:06 user nova-compute[75083]: node.session.auth.password = ***
Nov 29 06:13:06 user nova-compute[75083]: node.session.auth.username_in = <empty>
Nov 29 06:13:06 user nova-compute[75083]: node.session.auth.password_in = <empty>
Nov 29 06:13:06 user nova-compute[75083]: node.session.auth.chap_algs = MD5
Nov 29 06:13:06 user nova-compute[75083]: node.session.timeo.replacement_timeout = 120
Nov 29 06:13:06 user nova-compute[75083]: node.session.err_timeo.abort_timeout = 15
Nov 29 06:13:06 user nova-compute[75083]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 06:13:06 user nova-compute[75083]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 06:13:06 user nova-compute[75083]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 06:13:06 user nova-compute[75083]: node.session.iscsi.FastAbort = Yes
Nov 29 06:13:06 user nova-compute[75083]: node.session.iscsi.InitialR2T = No
Nov 29 06:13:06 user nova-compute[75083]: node.session.iscsi.ImmediateData = Yes
Nov 29 06:13:06 user nova-compute[75083]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 06:13:06 user nova-compute[75083]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 06:13:06 user nova-compute[75083]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 06:13:06 user nova-compute[75083]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 06:13:06 user nova-compute[75083]: node.session.iscsi.MaxConnections = 1
Nov 29 06:13:06 user nova-compute[75083]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 06:13:06 user nova-compute[75083]: node.session.iscsi.ERL = 0
Nov 29 06:13:06 user nova-compute[75083]: node.session.scan = manual
Nov 29 06:13:06 user nova-compute[75083]: node.session.reopen_max = 0
Nov 29 06:13:06 user nova-compute[75083]: node.conn[0].address = 172.16.0.220
Nov 29 06:13:06 user nova-compute[75083]: node.conn[0].port = 3260
Nov 29 06:13:06 user nova-compute[75083]: node.conn[0].startup = manual
Nov 29 06:13:06 user nova-compute[75083]: node.conn[0].tcp.window_size = 524288
Nov 29 06:13:06 user nova-compute[75083]: node.conn[0].tcp.type_of_service = 0
Nov 29 06:13:06 user nova-compute[75083]: node.conn[0].timeo.logout_timeout = 15
Nov 29 06:13:06 user nova-compute[75083]: node.conn[0].timeo.login_timeout = 15
Nov 29 06:13:06 user nova-compute[75083]: node.conn[0].timeo.auth_timeout = 45
Nov 29 06:13:06 user nova-compute[75083]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 06:13:06 user nova-compute[75083]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 06:13:06 user nova-compute[75083]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 06:13:06 user nova-compute[75083]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 06:13:06 user nova-compute[75083]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 06:13:06 user nova-compute[75083]: node.conn[0].iscsi.DataDigest = None
Nov 29 06:13:06 user nova-compute[75083]: node.conn[0].iscsi.IFMarker = No
Nov 29 06:13:06 user nova-compute[75083]: node.conn[0].iscsi.OFMarker = No
Nov 29 06:13:06 user nova-compute[75083]: # END RECORD
Nov 29 06:13:06 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a96216-3cce-496c-90c4-377b7ad96f9a]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f0eb21-c67e-4d18-80b8-b7d0fba5be95]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbjVhEQp {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbjVhEQp" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc971312-0a6b-49cb-8650-e9fa78e7dd37]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UbjVhEQp'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff539292-3b72-4a72-ab40-645f4f3ed4f2]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:13:06 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b780fe-7dc5-4ac1-a874-23b9c73f4168]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:13:07 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:13:07 user nova-compute[75083]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc (non-flash)
Nov 29 06:13:07 user nova-compute[75083]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 (non-flash)
Nov 29 06:13:07 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:13:07 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:13:07 user nova-compute[75083]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc (non-flash)
Nov 29 06:13:07 user nova-compute[75083]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 (non-flash)
Nov 29 06:13:07 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.161s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] HCTL ('37', '0', '0', 0) found on session 48 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[553d69a2-7412-4b61-a739-b096e5050084]: (4, ('0 0 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Searching for a device in session 48 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbjVhEQp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.184s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] <== connect_volume: return (186ms) {'type': 'block', 'scsi_wwn': '23433646230643761', 'path': '/dev/sdf'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433646230643761', 'path': '/dev/sdf'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-727297675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-727297675',id=41,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:11:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47694ecf400b4d6c952d0c06d0764d1b',ramdisk_id='',reservation_id='r-f5vw9m4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:11:32Z,user_data=None,user_id='4145bf5a07ea4d398f1a1e10a976c10f',uuid=0c2a7205-02b3-488f-b062-f7f676413cc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9750238c-1417-442c-a71c-9c04bb43388d", "address": "fa:16:3e:65:2e:c7", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "vif_mac": "fa:16:3e:65:2e:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9750238c-14", "ovs_interfaceid": "9750238c-1417-442c-a71c-9c04bb43388d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converting VIF {"id": "9750238c-1417-442c-a71c-9c04bb43388d", "address": "fa:16:3e:65:2e:c7", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "vif_mac": "fa:16:3e:65:2e:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9750238c-14", "ovs_interfaceid": "9750238c-1417-442c-a71c-9c04bb43388d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:2e:c7,bridge_name='br-int',has_traffic_filtering=True,id=9750238c-1417-442c-a71c-9c04bb43388d,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9750238c-14') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG nova.objects.instance [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c2a7205-02b3-488f-b062-f7f676413cc5 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG nova.objects.base [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Object Instance<0c2a7205-02b3-488f-b062-f7f676413cc5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75083) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:13:07 user nova-compute[75083]:   <uuid>0c2a7205-02b3-488f-b062-f7f676413cc5</uuid>
Nov 29 06:13:07 user nova-compute[75083]:   <name>instance-00000029</name>
Nov 29 06:13:07 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:13:07 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:13:07 user nova-compute[75083]:   <metadata>
Nov 29 06:13:07 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:13:07 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:13:07 user nova-compute[75083]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-727297675</nova:name>
Nov 29 06:13:07 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:13:06</nova:creationTime>
Nov 29 06:13:07 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:13:07 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:13:07 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:13:07 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:13:07 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:13:07 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:13:07 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:13:07 user nova-compute[75083]:       <nova:owner>
Nov 29 06:13:07 user nova-compute[75083]:         <nova:user uuid="4145bf5a07ea4d398f1a1e10a976c10f">tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member</nova:user>
Nov 29 06:13:07 user nova-compute[75083]:         <nova:project uuid="47694ecf400b4d6c952d0c06d0764d1b">tempest-ServerBootFromVolumeStableRescueTest-1530350051</nova:project>
Nov 29 06:13:07 user nova-compute[75083]:       </nova:owner>
Nov 29 06:13:07 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 06:13:07 user nova-compute[75083]:       <nova:ports>
Nov 29 06:13:07 user nova-compute[75083]:         <nova:port uuid="9750238c-1417-442c-a71c-9c04bb43388d">
Nov 29 06:13:07 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 06:13:07 user nova-compute[75083]:         </nova:port>
Nov 29 06:13:07 user nova-compute[75083]:       </nova:ports>
Nov 29 06:13:07 user nova-compute[75083]:     </nova:instance>
Nov 29 06:13:07 user nova-compute[75083]:   </metadata>
Nov 29 06:13:07 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:13:07 user nova-compute[75083]:     <system>
Nov 29 06:13:07 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:13:07 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:13:07 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:13:07 user nova-compute[75083]:       <entry name="serial">0c2a7205-02b3-488f-b062-f7f676413cc5</entry>
Nov 29 06:13:07 user nova-compute[75083]:       <entry name="uuid">0c2a7205-02b3-488f-b062-f7f676413cc5</entry>
Nov 29 06:13:07 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:13:07 user nova-compute[75083]:     </system>
Nov 29 06:13:07 user nova-compute[75083]:   </sysinfo>
Nov 29 06:13:07 user nova-compute[75083]:   <os>
Nov 29 06:13:07 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:13:07 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:13:07 user nova-compute[75083]:   </os>
Nov 29 06:13:07 user nova-compute[75083]:   <features>
Nov 29 06:13:07 user nova-compute[75083]:     <acpi/>
Nov 29 06:13:07 user nova-compute[75083]:     <apic/>
Nov 29 06:13:07 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:13:07 user nova-compute[75083]:   </features>
Nov 29 06:13:07 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:13:07 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:13:07 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:13:07 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:13:07 user nova-compute[75083]:   </clock>
Nov 29 06:13:07 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:13:07 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:13:07 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:13:07 user nova-compute[75083]:   </cpu>
Nov 29 06:13:07 user nova-compute[75083]:   <devices>
Nov 29 06:13:07 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 06:13:07 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:13:07 user nova-compute[75083]:       <source dev="/dev/sdf"/>
Nov 29 06:13:07 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:13:07 user nova-compute[75083]:       <serial>7300b2df-bebb-4f52-8f2f-02866067c406</serial>
Nov 29 06:13:07 user nova-compute[75083]:     </disk>
Nov 29 06:13:07 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:13:07 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:13:07 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/0c2a7205-02b3-488f-b062-f7f676413cc5/disk.rescue"/>
Nov 29 06:13:07 user nova-compute[75083]:       <target dev="vdb" bus="virtio"/>
Nov 29 06:13:07 user nova-compute[75083]:       <boot order="1"/>
Nov 29 06:13:07 user nova-compute[75083]:     </disk>
Nov 29 06:13:07 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:13:07 user nova-compute[75083]:       <mac address="fa:16:3e:65:2e:c7"/>
Nov 29 06:13:07 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:13:07 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:13:07 user nova-compute[75083]:       <target dev="tap9750238c-14"/>
Nov 29 06:13:07 user nova-compute[75083]:     </interface>
Nov 29 06:13:07 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:13:07 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/0c2a7205-02b3-488f-b062-f7f676413cc5/console.log" append="off"/>
Nov 29 06:13:07 user nova-compute[75083]:     </serial>
Nov 29 06:13:07 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:13:07 user nova-compute[75083]:     <video>
Nov 29 06:13:07 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:13:07 user nova-compute[75083]:     </video>
Nov 29 06:13:07 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:13:07 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:13:07 user nova-compute[75083]:     </rng>
Nov 29 06:13:07 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:13:07 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:13:07 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:13:07 user nova-compute[75083]:     </memballoon>
Nov 29 06:13:07 user nova-compute[75083]:   </devices>
Nov 29 06:13:07 user nova-compute[75083]: </domain>
Nov 29 06:13:07 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:13:07 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Instance destroyed successfully.
Nov 29 06:13:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] No VIF found with MAC fa:16:3e:65:2e:c7, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:13:07 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:08 user nova-compute[75083]: DEBUG nova.compute.manager [req-c3d81f65-1259-40d1-a32c-13d4b5013715 req-418fe9ae-36fb-40a5-9e0d-0545601ec1db service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received event network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:13:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c3d81f65-1259-40d1-a32c-13d4b5013715 req-418fe9ae-36fb-40a5-9e0d-0545601ec1db service nova] Acquiring lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c3d81f65-1259-40d1-a32c-13d4b5013715 req-418fe9ae-36fb-40a5-9e0d-0545601ec1db service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c3d81f65-1259-40d1-a32c-13d4b5013715 req-418fe9ae-36fb-40a5-9e0d-0545601ec1db service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:08 user nova-compute[75083]: DEBUG nova.compute.manager [req-c3d81f65-1259-40d1-a32c-13d4b5013715 req-418fe9ae-36fb-40a5-9e0d-0545601ec1db service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] No waiting events found dispatching network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:13:08 user nova-compute[75083]: WARNING nova.compute.manager [req-c3d81f65-1259-40d1-a32c-13d4b5013715 req-418fe9ae-36fb-40a5-9e0d-0545601ec1db service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received unexpected event network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d for instance with vm_state active and task_state rescuing.
Nov 29 06:13:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:10 user nova-compute[75083]: DEBUG nova.compute.manager [None req-445019a4-947a-4735-9fa9-a545a65d14cd tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:13:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-4b75c94f-286f-4554-aa7a-01c226abb724 req-5cbb5ada-3ba5-4a35-9089-dc814cb8dd42 service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received event network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:13:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4b75c94f-286f-4554-aa7a-01c226abb724 req-5cbb5ada-3ba5-4a35-9089-dc814cb8dd42 service nova] Acquiring lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4b75c94f-286f-4554-aa7a-01c226abb724 req-5cbb5ada-3ba5-4a35-9089-dc814cb8dd42 service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4b75c94f-286f-4554-aa7a-01c226abb724 req-5cbb5ada-3ba5-4a35-9089-dc814cb8dd42 service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:10 user nova-compute[75083]: DEBUG nova.compute.manager [req-4b75c94f-286f-4554-aa7a-01c226abb724 req-5cbb5ada-3ba5-4a35-9089-dc814cb8dd42 service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] No waiting events found dispatching network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:13:10 user nova-compute[75083]: WARNING nova.compute.manager [req-4b75c94f-286f-4554-aa7a-01c226abb724 req-5cbb5ada-3ba5-4a35-9089-dc814cb8dd42 service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received unexpected event network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d for instance with vm_state active and task_state rescuing.
Nov 29 06:13:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:13 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:16 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a9111c14-9bfb-4cc1-98ab-eabbf85f9568 is timed out.
Nov 29 06:13:16 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Successfully detached device vdb from instance a9111c14-9bfb-4cc1-98ab-eabbf85f9568 from the live domain config.
Nov 29 06:13:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlVWPsJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:13:16 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:13:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f69c75-9e0d-4a9d-91d9-080a680178bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:13:16 user nova-compute[75083]: No targets found.
Nov 29 06:13:16 user nova-compute[75083]: iSNS:
Nov 29 06:13:16 user nova-compute[75083]: No targets found.
Nov 29 06:13:16 user nova-compute[75083]: STATIC:
Nov 29 06:13:16 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856
Nov 29 06:13:16 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:13:16 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:13:16 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406
Nov 29 06:13:16 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:13:16 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:13:16 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417
Nov 29 06:13:16 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:13:16 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:13:16 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc
Nov 29 06:13:16 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:13:16 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:13:16 user nova-compute[75083]: FIRMWARE:
Nov 29 06:13:16 user nova-compute[75083]: No targets found.
Nov 29 06:13:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:13:16 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:13:16 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8d86c4-0bca-43af-9930-a111cff46565]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8674d22a-148a-4533-a699-b1afb67ccc8e]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:13:16 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:13:16 user nova-compute[75083]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc (non-flash)
Nov 29 06:13:16 user nova-compute[75083]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 (non-flash)
Nov 29 06:13:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:13:16 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:13:16 user nova-compute[75083]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc (non-flash)
Nov 29 06:13:16 user nova-compute[75083]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 (non-flash)
Nov 29 06:13:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b8170940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a503c28-8cc1-4440-aa0a-ec1a4fdf67ef]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5c156e-84e6-4c39-a18e-a008cc94300e]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[15406957-2a4b-4e6d-ad95-108a552488d8]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f17fe5-600f-46df-9dd5-39a714073369]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc65b0e-fe23-4512-a2f9-3de1de9b8fd7]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbb6cad-497f-4994-b29e-f58e1750e5cf]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc, portal: 172.16.0.220,3260]
Nov 29 06:13:16 user nova-compute[75083]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc, portal: 172.16.0.220,3260] successful.
Nov 29 06:13:16 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:13:16 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6000bef-41c8-4495-a1b3-0b9fd65f75fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7ee48e-d356-406e-873f-31b5c1d631dd]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:13:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:13:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] <== disconnect_volume: return (321ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:13:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:13:17 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:13:17 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:13:17 user nova-compute[75083]: DEBUG nova.objects.instance [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lazy-loading 'flavor' on Instance uuid a9111c14-9bfb-4cc1-98ab-eabbf85f9568 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:13:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-fdc0280a-70fb-4828-afac-39b1da4e95bb tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.884s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 17.990s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:18 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:13:18 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:13:20 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:13:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:22 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:13:25 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:13:25 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:13:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:25 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:13:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:26 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 08b33e17-334b-4816-bcf6-26a67f132bc1 is timed out.
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:26 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Successfully detached device vdb from instance 08b33e17-334b-4816-bcf6-26a67f132bc1 from the live domain config.
Nov 29 06:13:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmupvWIT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:13:26 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:13:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6937eb-b160-4465-a393-299650abd4f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:13:26 user nova-compute[75083]: No targets found.
Nov 29 06:13:26 user nova-compute[75083]: iSNS:
Nov 29 06:13:26 user nova-compute[75083]: No targets found.
Nov 29 06:13:26 user nova-compute[75083]: STATIC:
Nov 29 06:13:26 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856
Nov 29 06:13:26 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:13:26 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:13:26 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406
Nov 29 06:13:26 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:13:26 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:13:26 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417
Nov 29 06:13:26 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:13:26 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:13:26 user nova-compute[75083]: FIRMWARE:
Nov 29 06:13:26 user nova-compute[75083]: No targets found.
Nov 29 06:13:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:13:26 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:13:26 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6721de47-af34-4476-b30e-4656df272937]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6136a4-4d17-4614-9ffa-b54e4d2d7142]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:13:26 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:13:26 user nova-compute[75083]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 (non-flash)
Nov 29 06:13:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:13:26 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:13:26 user nova-compute[75083]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 (non-flash)
Nov 29 06:13:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b8173490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417'): ({'sdc'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Removing single pathed devices sdc {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f7140f-cf2c-4cf7-945b-727c96e45671]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[525654e4-5553-40ea-b1a2-98bd4c6c33a2]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Flushing IO for device /dev/sdc {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[416bf3c4-a358-4674-a7ae-894e2a116f58]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cfc641-d699-4dc6-9518-33d688d9b732]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[57afd59b-70d9-421e-a69c-a7c602d7ce1a]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[600f21a5-9e30-4666-a2a7-9434112750ec]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417, portal: 172.16.0.220,3260]
Nov 29 06:13:26 user nova-compute[75083]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417, portal: 172.16.0.220,3260] successful.
Nov 29 06:13:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2a7205-02b3-488f-b062-f7f676413cc5/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b56f7f-d843-4ee1-91f4-9331a0af2417 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c7484f-051d-4d0c-8620-74729de71eae]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] <== disconnect_volume: return (378ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2a7205-02b3-488f-b062-f7f676413cc5/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2a7205-02b3-488f-b062-f7f676413cc5/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2a7205-02b3-488f-b062-f7f676413cc5/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:27 user nova-compute[75083]: DEBUG nova.objects.instance [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lazy-loading 'flavor' on Instance uuid 08b33e17-334b-4816-bcf6-26a67f132bc1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:13:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e97aebcf-f34c-48b6-9394-088813147575 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.033s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:28 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:13:28 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:13:28 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8324MB free_disk=24.908733367919922GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:13:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:28 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:13:28 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fea64bdc-491c-46ba-9447-c175df432deb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:13:28 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance be4598f6-6ee2-4219-b8a2-446ba87b2efd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:13:28 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 08b33e17-334b-4816-bcf6-26a67f132bc1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:13:28 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance a9111c14-9bfb-4cc1-98ab-eabbf85f9568 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:13:28 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 0c2a7205-02b3-488f-b062-f7f676413cc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:13:28 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:13:28 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:13:28 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:13:28 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:13:28 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:13:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:30 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:13:30 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:13:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-be4598f6-6ee2-4219-b8a2-446ba87b2efd" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:13:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-be4598f6-6ee2-4219-b8a2-446ba87b2efd" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:13:30 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:13:31 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Updating instance_info_cache with network_info: [{"id": "f38c71e9-810f-4add-b8cb-1a41f2146304", "address": "fa:16:3e:70:3d:40", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38c71e9-81", "ovs_interfaceid": "f38c71e9-810f-4add-b8cb-1a41f2146304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:13:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-be4598f6-6ee2-4219-b8a2-446ba87b2efd" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:13:31 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:13:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:46 user nova-compute[75083]: INFO nova.compute.manager [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Terminating instance
Nov 29 06:13:46 user nova-compute[75083]: DEBUG nova.compute.manager [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:13:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:47 user nova-compute[75083]: DEBUG nova.compute.manager [req-5f7ae1d3-7f4a-4912-924e-fa9449aa6900 req-d4bdf65a-bde3-4b12-92d0-7179098e2f05 service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Received event network-vif-unplugged-d0dd55dc-570c-40d2-82d1-9330a375972b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:13:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5f7ae1d3-7f4a-4912-924e-fa9449aa6900 req-d4bdf65a-bde3-4b12-92d0-7179098e2f05 service nova] Acquiring lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5f7ae1d3-7f4a-4912-924e-fa9449aa6900 req-d4bdf65a-bde3-4b12-92d0-7179098e2f05 service nova] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-5f7ae1d3-7f4a-4912-924e-fa9449aa6900 req-d4bdf65a-bde3-4b12-92d0-7179098e2f05 service nova] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:47 user nova-compute[75083]: DEBUG nova.compute.manager [req-5f7ae1d3-7f4a-4912-924e-fa9449aa6900 req-d4bdf65a-bde3-4b12-92d0-7179098e2f05 service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] No waiting events found dispatching network-vif-unplugged-d0dd55dc-570c-40d2-82d1-9330a375972b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:13:47 user nova-compute[75083]: DEBUG nova.compute.manager [req-5f7ae1d3-7f4a-4912-924e-fa9449aa6900 req-d4bdf65a-bde3-4b12-92d0-7179098e2f05 service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Received event network-vif-unplugged-d0dd55dc-570c-40d2-82d1-9330a375972b for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:13:47 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Instance destroyed successfully.
Nov 29 06:13:47 user nova-compute[75083]: DEBUG nova.objects.instance [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lazy-loading 'resources' on Instance uuid a9111c14-9bfb-4cc1-98ab-eabbf85f9568 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:13:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-998422595',display_name='tempest-AttachVolumeNegativeTest-server-998422595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-998422595',id=40,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4DIaeavRWj4KXGzqpgio+P18KwfFhJ0bmDloZVKv/nTMhFLWiWYkFAyalGSHiwRkLWS/2RySlsji0p7mkhz1y/m+441LUOvj9mMZtR5h93Cs4tYA3tcyHigWek7Tf4qQ==',key_name='tempest-keypair-216188010',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:10:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='112a98f04dc141dfbb0f7a10fd410cae',ramdisk_id='',reservation_id='r-1x960zxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1387142425',owner_user_name='tempest-AttachVolumeNegativeTest-1387142425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dc42da0ede8433a827629a68e691658',uuid=a9111c14-9bfb-4cc1-98ab-eabbf85f9568,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0dd55dc-570c-40d2-82d1-9330a375972b", "address": "fa:16:3e:c8:4e:7c", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd55dc-57", "ovs_interfaceid": "d0dd55dc-570c-40d2-82d1-9330a375972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:13:47 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converting VIF {"id": "d0dd55dc-570c-40d2-82d1-9330a375972b", "address": "fa:16:3e:c8:4e:7c", "network": {"id": "ca761f59-1fe8-419e-99e2-2786fa41ca1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1892056340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112a98f04dc141dfbb0f7a10fd410cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd55dc-57", "ovs_interfaceid": "d0dd55dc-570c-40d2-82d1-9330a375972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:13:47 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:4e:7c,bridge_name='br-int',has_traffic_filtering=True,id=d0dd55dc-570c-40d2-82d1-9330a375972b,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dd55dc-57') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:13:47 user nova-compute[75083]: DEBUG os_vif [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:4e:7c,bridge_name='br-int',has_traffic_filtering=True,id=d0dd55dc-570c-40d2-82d1-9330a375972b,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dd55dc-57') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:13:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0dd55dc-57, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:13:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:13:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c80b562-ea09-4acb-b07b-3c84c5bfd40e) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:13:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:13:47 user nova-compute[75083]: INFO os_vif [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:4e:7c,bridge_name='br-int',has_traffic_filtering=True,id=d0dd55dc-570c-40d2-82d1-9330a375972b,network=Network(ca761f59-1fe8-419e-99e2-2786fa41ca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dd55dc-57')
Nov 29 06:13:47 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Deleting instance files /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568_del
Nov 29 06:13:47 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Deletion of /opt/stack/data/nova/instances/a9111c14-9bfb-4cc1-98ab-eabbf85f9568_del complete
Nov 29 06:13:47 user nova-compute[75083]: INFO nova.compute.manager [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 29 06:13:47 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:13:47 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:13:47 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "5277c58c-3078-44ba-85b3-2b4b7e16b760" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "5277c58c-3078-44ba-85b3-2b4b7e16b760" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG nova.compute.manager [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:13:48 user nova-compute[75083]: INFO nova.compute.claims [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Claim successful on node user
Nov 29 06:13:48 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:13:48 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Took 0.80 seconds to deallocate network for instance.
Nov 29 06:13:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG nova.compute.manager [req-7f7f2f8f-ebf8-4cf2-ad7d-4a9865a13285 req-14fb24e8-2de3-4093-a912-911a777f18c1 service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Received event network-vif-deleted-d0dd55dc-570c-40d2-82d1-9330a375972b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG nova.compute.manager [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.206s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG nova.compute.manager [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG nova.network.neutron [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:13:48 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:13:48 user nova-compute[75083]: DEBUG nova.compute.manager [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG nova.policy [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '131cbc1c58fb486eb2ba0740ecfaa7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b12e29dfdde4ed4b8a9f17ea146509e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG nova.compute.manager [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:13:48 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Creating image(s)
Nov 29 06:13:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "/opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "/opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "/opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:48 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG nova.compute.manager [req-bed46780-26b0-44f8-935b-4f431bb3bfea req-9d86659a-537b-4b85-8f3b-33af91a5431b service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Received event network-vif-plugged-d0dd55dc-570c-40d2-82d1-9330a375972b {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bed46780-26b0-44f8-935b-4f431bb3bfea req-9d86659a-537b-4b85-8f3b-33af91a5431b service nova] Acquiring lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bed46780-26b0-44f8-935b-4f431bb3bfea req-9d86659a-537b-4b85-8f3b-33af91a5431b service nova] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bed46780-26b0-44f8-935b-4f431bb3bfea req-9d86659a-537b-4b85-8f3b-33af91a5431b service nova] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG nova.compute.manager [req-bed46780-26b0-44f8-935b-4f431bb3bfea req-9d86659a-537b-4b85-8f3b-33af91a5431b service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] No waiting events found dispatching network-vif-plugged-d0dd55dc-570c-40d2-82d1-9330a375972b {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:13:49 user nova-compute[75083]: WARNING nova.compute.manager [req-bed46780-26b0-44f8-935b-4f431bb3bfea req-9d86659a-537b-4b85-8f3b-33af91a5431b service nova] [instance: a9111c14-9bfb-4cc1-98ab-eabbf85f9568] Received unexpected event network-vif-plugged-d0dd55dc-570c-40d2-82d1-9330a375972b for instance with vm_state deleted and task_state None.
Nov 29 06:13:49 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Deleted allocations for instance a9111c14-9bfb-4cc1-98ab-eabbf85f9568
Nov 29 06:13:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.199s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a7dda2d3-35ce-49b4-9778-ca3a3b3fcf59 tempest-AttachVolumeNegativeTest-1387142425 tempest-AttachVolumeNegativeTest-1387142425-project-member] Lock "a9111c14-9bfb-4cc1-98ab-eabbf85f9568" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.682s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.201s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk 1073741824" returned: 0 in 0.056s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG nova.network.neutron [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Successfully created port: 373b7d49-10c9-46ca-a1e5-6a20d1712035 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.202s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Cannot resize image /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Ensure instance console log exists: /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.network.neutron [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Successfully updated port: 373b7d49-10c9-46ca-a1e5-6a20d1712035 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "refresh_cache-5277c58c-3078-44ba-85b3-2b4b7e16b760" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquired lock "refresh_cache-5277c58c-3078-44ba-85b3-2b4b7e16b760" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.network.neutron [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.network.neutron [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.network.neutron [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Updating instance_info_cache with network_info: [{"id": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "address": "fa:16:3e:0e:0a:1d", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373b7d49-10", "ovs_interfaceid": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Releasing lock "refresh_cache-5277c58c-3078-44ba-85b3-2b4b7e16b760" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.compute.manager [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Instance network_info: |[{"id": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "address": "fa:16:3e:0e:0a:1d", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373b7d49-10", "ovs_interfaceid": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Start _get_guest_xml network_info=[{"id": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "address": "fa:16:3e:0e:0a:1d", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373b7d49-10", "ovs_interfaceid": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:13:50 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:13:50 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-153210734',display_name='tempest-TestStampPattern-server-153210734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-153210734',id=42,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0r9XpGMZ9H/Y4I/0x8bzbOcE6fHNK54Wz8ou6+Qs3mulslzYO8Mrt2NyEGfqnGboyoLwXwwDgzi9WtBLtWKKBOjYUhnhNK5lWoSf+vBunDq+fymy+tZb2F3uviDT9Mjg==',key_name='tempest-TestStampPattern-774953284',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b12e29dfdde4ed4b8a9f17ea146509e',ramdisk_id='',reservation_id='r-4u8tkqpt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1336384366',owner_user_name='tempest-TestStampPattern-1336384366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:13:49Z,user_data=None,user_id='131cbc1c58fb486eb2ba0740ecfaa7a9',uuid=5277c58c-3078-44ba-85b3-2b4b7e16b760,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "address": "fa:16:3e:0e:0a:1d", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373b7d49-10", "ovs_interfaceid": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Converting VIF {"id": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "address": "fa:16:3e:0e:0a:1d", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373b7d49-10", "ovs_interfaceid": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:0a:1d,bridge_name='br-int',has_traffic_filtering=True,id=373b7d49-10c9-46ca-a1e5-6a20d1712035,network=Network(6a21050c-13c7-40b5-a1c5-f93ddc74e7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373b7d49-10') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.objects.instance [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lazy-loading 'pci_devices' on Instance uuid 5277c58c-3078-44ba-85b3-2b4b7e16b760 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:13:50 user nova-compute[75083]:   <uuid>5277c58c-3078-44ba-85b3-2b4b7e16b760</uuid>
Nov 29 06:13:50 user nova-compute[75083]:   <name>instance-0000002a</name>
Nov 29 06:13:50 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:13:50 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:13:50 user nova-compute[75083]:   <metadata>
Nov 29 06:13:50 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:13:50 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:13:50 user nova-compute[75083]:       <nova:name>tempest-TestStampPattern-server-153210734</nova:name>
Nov 29 06:13:50 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:13:50</nova:creationTime>
Nov 29 06:13:50 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:13:50 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:13:50 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:13:50 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:13:50 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:13:50 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:13:50 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:13:50 user nova-compute[75083]:       <nova:owner>
Nov 29 06:13:50 user nova-compute[75083]:         <nova:user uuid="131cbc1c58fb486eb2ba0740ecfaa7a9">tempest-TestStampPattern-1336384366-project-member</nova:user>
Nov 29 06:13:50 user nova-compute[75083]:         <nova:project uuid="4b12e29dfdde4ed4b8a9f17ea146509e">tempest-TestStampPattern-1336384366</nova:project>
Nov 29 06:13:50 user nova-compute[75083]:       </nova:owner>
Nov 29 06:13:50 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 06:13:50 user nova-compute[75083]:       <nova:ports>
Nov 29 06:13:50 user nova-compute[75083]:         <nova:port uuid="373b7d49-10c9-46ca-a1e5-6a20d1712035">
Nov 29 06:13:50 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 06:13:50 user nova-compute[75083]:         </nova:port>
Nov 29 06:13:50 user nova-compute[75083]:       </nova:ports>
Nov 29 06:13:50 user nova-compute[75083]:     </nova:instance>
Nov 29 06:13:50 user nova-compute[75083]:   </metadata>
Nov 29 06:13:50 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:13:50 user nova-compute[75083]:     <system>
Nov 29 06:13:50 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:13:50 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:13:50 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:13:50 user nova-compute[75083]:       <entry name="serial">5277c58c-3078-44ba-85b3-2b4b7e16b760</entry>
Nov 29 06:13:50 user nova-compute[75083]:       <entry name="uuid">5277c58c-3078-44ba-85b3-2b4b7e16b760</entry>
Nov 29 06:13:50 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:13:50 user nova-compute[75083]:     </system>
Nov 29 06:13:50 user nova-compute[75083]:   </sysinfo>
Nov 29 06:13:50 user nova-compute[75083]:   <os>
Nov 29 06:13:50 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:13:50 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:13:50 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:13:50 user nova-compute[75083]:   </os>
Nov 29 06:13:50 user nova-compute[75083]:   <features>
Nov 29 06:13:50 user nova-compute[75083]:     <acpi/>
Nov 29 06:13:50 user nova-compute[75083]:     <apic/>
Nov 29 06:13:50 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:13:50 user nova-compute[75083]:   </features>
Nov 29 06:13:50 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:13:50 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:13:50 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:13:50 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:13:50 user nova-compute[75083]:   </clock>
Nov 29 06:13:50 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:13:50 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:13:50 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:13:50 user nova-compute[75083]:   </cpu>
Nov 29 06:13:50 user nova-compute[75083]:   <devices>
Nov 29 06:13:50 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:13:50 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:13:50 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk"/>
Nov 29 06:13:50 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:13:50 user nova-compute[75083]:     </disk>
Nov 29 06:13:50 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:13:50 user nova-compute[75083]:       <mac address="fa:16:3e:0e:0a:1d"/>
Nov 29 06:13:50 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:13:50 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:13:50 user nova-compute[75083]:       <target dev="tap373b7d49-10"/>
Nov 29 06:13:50 user nova-compute[75083]:     </interface>
Nov 29 06:13:50 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:13:50 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/console.log" append="off"/>
Nov 29 06:13:50 user nova-compute[75083]:     </serial>
Nov 29 06:13:50 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:13:50 user nova-compute[75083]:     <video>
Nov 29 06:13:50 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:13:50 user nova-compute[75083]:     </video>
Nov 29 06:13:50 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:13:50 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:13:50 user nova-compute[75083]:     </rng>
Nov 29 06:13:50 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:13:50 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:13:50 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:13:50 user nova-compute[75083]:     </memballoon>
Nov 29 06:13:50 user nova-compute[75083]:   </devices>
Nov 29 06:13:50 user nova-compute[75083]: </domain>
Nov 29 06:13:50 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-153210734',display_name='tempest-TestStampPattern-server-153210734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-153210734',id=42,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0r9XpGMZ9H/Y4I/0x8bzbOcE6fHNK54Wz8ou6+Qs3mulslzYO8Mrt2NyEGfqnGboyoLwXwwDgzi9WtBLtWKKBOjYUhnhNK5lWoSf+vBunDq+fymy+tZb2F3uviDT9Mjg==',key_name='tempest-TestStampPattern-774953284',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b12e29dfdde4ed4b8a9f17ea146509e',ramdisk_id='',reservation_id='r-4u8tkqpt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1336384366',owner_user_name='tempest-TestStampPattern-1336384366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:13:49Z,user_data=None,user_id='131cbc1c58fb486eb2ba0740ecfaa7a9',uuid=5277c58c-3078-44ba-85b3-2b4b7e16b760,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "address": "fa:16:3e:0e:0a:1d", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373b7d49-10", "ovs_interfaceid": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Converting VIF {"id": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "address": "fa:16:3e:0e:0a:1d", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373b7d49-10", "ovs_interfaceid": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:0a:1d,bridge_name='br-int',has_traffic_filtering=True,id=373b7d49-10c9-46ca-a1e5-6a20d1712035,network=Network(6a21050c-13c7-40b5-a1c5-f93ddc74e7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373b7d49-10') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG os_vif [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:0a:1d,bridge_name='br-int',has_traffic_filtering=True,id=373b7d49-10c9-46ca-a1e5-6a20d1712035,network=Network(6a21050c-13c7-40b5-a1c5-f93ddc74e7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373b7d49-10') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8df2187a-63ce-5791-bc14-f6a9ec08f3aa', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap373b7d49-10, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap373b7d49-10, col_values=(('qos', UUID('e7467dc3-924d-4b3a-8cf4-af48695ab205')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap373b7d49-10, col_values=(('external_ids', {'iface-id': '373b7d49-10c9-46ca-a1e5-6a20d1712035', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:0a:1d', 'vm-uuid': '5277c58c-3078-44ba-85b3-2b4b7e16b760'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:50 user nova-compute[75083]: INFO os_vif [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:0a:1d,bridge_name='br-int',has_traffic_filtering=True,id=373b7d49-10c9-46ca-a1e5-6a20d1712035,network=Network(6a21050c-13c7-40b5-a1c5-f93ddc74e7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373b7d49-10')
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.compute.manager [req-afd8fbf1-f596-4cb4-970a-7d6366532396 req-53275a81-eaea-4724-9a22-252452d564bd service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Received event network-changed-373b7d49-10c9-46ca-a1e5-6a20d1712035 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.compute.manager [req-afd8fbf1-f596-4cb4-970a-7d6366532396 req-53275a81-eaea-4724-9a22-252452d564bd service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Refreshing instance network info cache due to event network-changed-373b7d49-10c9-46ca-a1e5-6a20d1712035. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-afd8fbf1-f596-4cb4-970a-7d6366532396 req-53275a81-eaea-4724-9a22-252452d564bd service nova] Acquiring lock "refresh_cache-5277c58c-3078-44ba-85b3-2b4b7e16b760" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-afd8fbf1-f596-4cb4-970a-7d6366532396 req-53275a81-eaea-4724-9a22-252452d564bd service nova] Acquired lock "refresh_cache-5277c58c-3078-44ba-85b3-2b4b7e16b760" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.network.neutron [req-afd8fbf1-f596-4cb4-970a-7d6366532396 req-53275a81-eaea-4724-9a22-252452d564bd service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Refreshing network info cache for port 373b7d49-10c9-46ca-a1e5-6a20d1712035 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] No VIF found with MAC fa:16:3e:0e:0a:1d, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.network.neutron [req-afd8fbf1-f596-4cb4-970a-7d6366532396 req-53275a81-eaea-4724-9a22-252452d564bd service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Updated VIF entry in instance network info cache for port 373b7d49-10c9-46ca-a1e5-6a20d1712035. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:13:50 user nova-compute[75083]: DEBUG nova.network.neutron [req-afd8fbf1-f596-4cb4-970a-7d6366532396 req-53275a81-eaea-4724-9a22-252452d564bd service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Updating instance_info_cache with network_info: [{"id": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "address": "fa:16:3e:0e:0a:1d", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373b7d49-10", "ovs_interfaceid": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:13:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-afd8fbf1-f596-4cb4-970a-7d6366532396 req-53275a81-eaea-4724-9a22-252452d564bd service nova] Releasing lock "refresh_cache-5277c58c-3078-44ba-85b3-2b4b7e16b760" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:13:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:52 user nova-compute[75083]: DEBUG nova.compute.manager [req-9d40b468-d5e6-4444-ba66-7ec20f5d1b96 req-8dd09484-4218-4a6d-a9b4-be39fd1e53e4 service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Received event network-vif-plugged-373b7d49-10c9-46ca-a1e5-6a20d1712035 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:13:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9d40b468-d5e6-4444-ba66-7ec20f5d1b96 req-8dd09484-4218-4a6d-a9b4-be39fd1e53e4 service nova] Acquiring lock "5277c58c-3078-44ba-85b3-2b4b7e16b760-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9d40b468-d5e6-4444-ba66-7ec20f5d1b96 req-8dd09484-4218-4a6d-a9b4-be39fd1e53e4 service nova] Lock "5277c58c-3078-44ba-85b3-2b4b7e16b760-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9d40b468-d5e6-4444-ba66-7ec20f5d1b96 req-8dd09484-4218-4a6d-a9b4-be39fd1e53e4 service nova] Lock "5277c58c-3078-44ba-85b3-2b4b7e16b760-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:52 user nova-compute[75083]: DEBUG nova.compute.manager [req-9d40b468-d5e6-4444-ba66-7ec20f5d1b96 req-8dd09484-4218-4a6d-a9b4-be39fd1e53e4 service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] No waiting events found dispatching network-vif-plugged-373b7d49-10c9-46ca-a1e5-6a20d1712035 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:13:52 user nova-compute[75083]: WARNING nova.compute.manager [req-9d40b468-d5e6-4444-ba66-7ec20f5d1b96 req-8dd09484-4218-4a6d-a9b4-be39fd1e53e4 service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Received unexpected event network-vif-plugged-373b7d49-10c9-46ca-a1e5-6a20d1712035 for instance with vm_state building and task_state spawning.
Nov 29 06:13:52 user nova-compute[75083]: DEBUG nova.compute.manager [req-9d40b468-d5e6-4444-ba66-7ec20f5d1b96 req-8dd09484-4218-4a6d-a9b4-be39fd1e53e4 service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Received event network-vif-plugged-373b7d49-10c9-46ca-a1e5-6a20d1712035 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:13:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9d40b468-d5e6-4444-ba66-7ec20f5d1b96 req-8dd09484-4218-4a6d-a9b4-be39fd1e53e4 service nova] Acquiring lock "5277c58c-3078-44ba-85b3-2b4b7e16b760-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9d40b468-d5e6-4444-ba66-7ec20f5d1b96 req-8dd09484-4218-4a6d-a9b4-be39fd1e53e4 service nova] Lock "5277c58c-3078-44ba-85b3-2b4b7e16b760-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9d40b468-d5e6-4444-ba66-7ec20f5d1b96 req-8dd09484-4218-4a6d-a9b4-be39fd1e53e4 service nova] Lock "5277c58c-3078-44ba-85b3-2b4b7e16b760-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:52 user nova-compute[75083]: DEBUG nova.compute.manager [req-9d40b468-d5e6-4444-ba66-7ec20f5d1b96 req-8dd09484-4218-4a6d-a9b4-be39fd1e53e4 service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] No waiting events found dispatching network-vif-plugged-373b7d49-10c9-46ca-a1e5-6a20d1712035 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:13:52 user nova-compute[75083]: WARNING nova.compute.manager [req-9d40b468-d5e6-4444-ba66-7ec20f5d1b96 req-8dd09484-4218-4a6d-a9b4-be39fd1e53e4 service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Received unexpected event network-vif-plugged-373b7d49-10c9-46ca-a1e5-6a20d1712035 for instance with vm_state building and task_state spawning.
Nov 29 06:13:54 user nova-compute[75083]: DEBUG nova.compute.manager [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:13:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:13:54 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Instance spawned successfully.
Nov 29 06:13:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:13:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:13:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:13:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:13:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:13:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:13:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:13:54 user nova-compute[75083]: INFO nova.compute.manager [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 29 06:13:54 user nova-compute[75083]: DEBUG nova.compute.manager [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:13:54 user nova-compute[75083]: INFO nova.compute.manager [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Took 6.02 seconds to build instance.
Nov 29 06:13:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-e6c2d228-02df-4d6b-988b-76b16e16fc10 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "5277c58c-3078-44ba-85b3-2b4b7e16b760" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.153s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "08b33e17-334b-4816-bcf6-26a67f132bc1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG nova.objects.instance [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lazy-loading 'flavor' on Instance uuid 08b33e17-334b-4816-bcf6-26a67f132bc1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "08b33e17-334b-4816-bcf6-26a67f132bc1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:13:57 user nova-compute[75083]: INFO nova.compute.manager [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Attaching volume ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 to /dev/vdb
Nov 29 06:13:57 user nova-compute[75083]: DEBUG os_brick.utils [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c222cc8d-acf7-4846-a185-fd8d84e3b87c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebbbc60-30b4-4f1e-be30-e8fde0bf9db0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfcbea8-88da-4f40-a2b4-e3fb45ab625a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98b494e-387f-4560-89a6-5d118f45ab5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:13:57 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:13:57 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1f4b95-7f4c-4ac1-b8cb-f58bd0cf2941]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG os_brick.utils [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:13:57 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Updating existing volume attachment record: 227cdad5-a5fb-4d61-b657-f21d9f3c5e08 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:14:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MycropPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:14:04 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:14:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:14:04 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:14:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:14:04 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93cb5e1-ae44-426d-bd1e-94786941bb34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:14:04 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ba1c6d-958d-41d0-8b99-4bc3f2d64fec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6] added
Nov 29 06:14:04 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8368ad9-42d2-461b-8af3-34ff4d4d2f5e]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[de04513c-b0f4-43b2-bd7c-09f6b90037b3]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MycropPe {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MycropPe" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e635ae-717e-4d0b-af2e-c54d98867d79]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MycropPe'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[84044898-d44e-47f8-a3fd-27d8bac282bd]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[09765d76-0372-4952-a379-89a25e2ce0c3]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:04 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:14:04 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:14:04 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:14:05 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:14:05 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b12b301-3532-4c0f-b5d9-cce3200d9c06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6, portal: 172.16.0.220,3260]
Nov 29 06:14:05 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6, portal: 172.16.0.220,3260] successful.
Nov 29 06:14:05 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9662a2b7-1ba9-489a-94d6-85139f70b54c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f80fb4-985e-4d71-b9c7-7e38722178ee]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:14:05 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:14:05 user nova-compute[75083]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 (non-flash)
Nov 29 06:14:05 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:14:05 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:14:05 user nova-compute[75083]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 (non-flash)
Nov 29 06:14:05 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[747471c9-5bff-496c-ab0e-1a88f3a8cf92]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MycropPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:14:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:14:06 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23035306639313231', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:14:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035306639313231', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:14:06 user nova-compute[75083]: DEBUG nova.objects.instance [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lazy-loading 'flavor' on Instance uuid 08b33e17-334b-4816-bcf6-26a67f132bc1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:14:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 06:14:06 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:14:06 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:14:06 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:14:06 user nova-compute[75083]:   <serial>ed8f3a63-8d4d-4f12-83cc-09a41e7347e6</serial>
Nov 29 06:14:06 user nova-compute[75083]: </disk>
Nov 29 06:14:06 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 06:14:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:14:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:14:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] No VIF found with MAC fa:16:3e:11:81:6e, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:14:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-2618ee3e-00b0-4e68-9fc9-16efaebfb71a tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.256s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:14:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "08b33e17-334b-4816-bcf6-26a67f132bc1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:14:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:14:08 user nova-compute[75083]: INFO nova.compute.manager [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Detaching volume ed8f3a63-8d4d-4f12-83cc-09a41e7347e6
Nov 29 06:14:08 user nova-compute[75083]: INFO nova.virt.block_device [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Attempting to driver detach volume ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 from mountpoint /dev/vdb
Nov 29 06:14:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Attempting to detach device vdb from instance 08b33e17-334b-4816-bcf6-26a67f132bc1 from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 06:14:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:14:08 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:14:08 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:14:08 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:14:08 user nova-compute[75083]:   <serial>ed8f3a63-8d4d-4f12-83cc-09a41e7347e6</serial>
Nov 29 06:14:08 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:14:08 user nova-compute[75083]: </disk>
Nov 29 06:14:08 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:14:08 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Successfully detached device vdb from instance 08b33e17-334b-4816-bcf6-26a67f132bc1 from the persistent domain config.
Nov 29 06:14:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 08b33e17-334b-4816-bcf6-26a67f132bc1 from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 06:14:08 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:14:08 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:14:08 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:14:08 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:14:08 user nova-compute[75083]:   <serial>ed8f3a63-8d4d-4f12-83cc-09a41e7347e6</serial>
Nov 29 06:14:08 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:14:08 user nova-compute[75083]: </disk>
Nov 29 06:14:08 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:14:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 08b33e17-334b-4816-bcf6-26a67f132bc1 {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 06:14:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:14:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:15 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:14:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:16 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:14:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:18 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:14:18 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:14:19 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:14:20 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:14:20 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:14:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:23 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:14:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:26 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:14:26 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:14:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:14:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:14:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:14:26 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:14:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:14:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:14:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2a7205-02b3-488f-b062-f7f676413cc5/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2a7205-02b3-488f-b062-f7f676413cc5/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2a7205-02b3-488f-b062-f7f676413cc5/disk.rescue --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2a7205-02b3-488f-b062-f7f676413cc5/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:29 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:14:29 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:14:29 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8350MB free_disk=24.888816833496094GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fea64bdc-491c-46ba-9447-c175df432deb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance be4598f6-6ee2-4219-b8a2-446ba87b2efd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 08b33e17-334b-4816-bcf6-26a67f132bc1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 0c2a7205-02b3-488f-b062-f7f676413cc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 5277c58c-3078-44ba-85b3-2b4b7e16b760 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:14:29 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 08b33e17-334b-4816-bcf6-26a67f132bc1 is timed out.
Nov 29 06:14:29 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Successfully detached device vdb from instance 08b33e17-334b-4816-bcf6-26a67f132bc1 from the live domain config.
Nov 29 06:14:29 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MycropPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:14:29 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:14:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[44adbe85-f9cb-4a10-bd13-3710bc066a2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:14:29 user nova-compute[75083]: No targets found.
Nov 29 06:14:29 user nova-compute[75083]: iSNS:
Nov 29 06:14:29 user nova-compute[75083]: No targets found.
Nov 29 06:14:29 user nova-compute[75083]: STATIC:
Nov 29 06:14:29 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6
Nov 29 06:14:29 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:14:29 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:14:29 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856
Nov 29 06:14:29 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:14:29 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:14:29 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406
Nov 29 06:14:29 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:14:29 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:14:29 user nova-compute[75083]: FIRMWARE:
Nov 29 06:14:29 user nova-compute[75083]: No targets found.
Nov 29 06:14:29 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:14:29 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:14:29 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0269df81-2d12-4a51-b899-7dd56280dea6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1623f5e1-6e53-4b10-a700-0f9afa81afb0]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:14:29 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:14:29 user nova-compute[75083]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 (non-flash)
Nov 29 06:14:29 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:14:29 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:14:29 user nova-compute[75083]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 (non-flash)
Nov 29 06:14:29 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0d83f1990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e1a65f-cc40-48b6-894b-30915839101f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82bcf6e-7732-4667-8968-f4ee7ccf156e]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1443cf0d-c15b-45dc-82ee-b6049ce6438f]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[81159b54-dc86-447c-9704-5e6941469144]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b1c4dd-39dc-4dc2-ba7d-db3ca53d2b4e]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e106e0-8892-44cb-bb49-9f58092e3f78]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6, portal: 172.16.0.220,3260]
Nov 29 06:14:29 user nova-compute[75083]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6, portal: 172.16.0.220,3260] successful.
Nov 29 06:14:29 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed8f3a63-8d4d-4f12-83cc-09a41e7347e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[de735881-ab9e-4c9b-9bc6-879c646c0457]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] <== disconnect_volume: return (312ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:14:29 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:14:30 user nova-compute[75083]: DEBUG nova.objects.instance [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lazy-loading 'flavor' on Instance uuid 08b33e17-334b-4816-bcf6-26a67f132bc1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:14:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a5f22c64-d063-4e90-ac16-a6f01483f4af tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.682s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:14:30 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:14:30 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:14:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-08b33e17-334b-4816-bcf6-26a67f132bc1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:14:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-08b33e17-334b-4816-bcf6-26a67f132bc1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:14:30 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:14:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:14:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:14:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:14:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:14:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:14:30 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Updating instance_info_cache with network_info: [{"id": "fe369aec-feeb-4444-a640-012a5b6eb231", "address": "fa:16:3e:11:81:6e", "network": {"id": "1c5d3b69-0dc0-44fc-8d62-0e184770a31c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-246603725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ff233f7ca74890b5f100ed01b943b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe369aec-fe", "ovs_interfaceid": "fe369aec-feeb-4444-a640-012a5b6eb231", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:14:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-08b33e17-334b-4816-bcf6-26a67f132bc1" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:14:30 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:14:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:14:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:14:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:14:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:14:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:14:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:14:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:53 user nova-compute[75083]: INFO nova.compute.manager [None req-d37e7af3-3be2-4179-8286-e2b79e88cc7f tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Unrescuing
Nov 29 06:14:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d37e7af3-3be2-4179-8286-e2b79e88cc7f tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "refresh_cache-0c2a7205-02b3-488f-b062-f7f676413cc5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:14:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d37e7af3-3be2-4179-8286-e2b79e88cc7f tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquired lock "refresh_cache-0c2a7205-02b3-488f-b062-f7f676413cc5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:14:53 user nova-compute[75083]: DEBUG nova.network.neutron [None req-d37e7af3-3be2-4179-8286-e2b79e88cc7f tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:14:53 user nova-compute[75083]: DEBUG nova.network.neutron [None req-d37e7af3-3be2-4179-8286-e2b79e88cc7f tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Updating instance_info_cache with network_info: [{"id": "9750238c-1417-442c-a71c-9c04bb43388d", "address": "fa:16:3e:65:2e:c7", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9750238c-14", "ovs_interfaceid": "9750238c-1417-442c-a71c-9c04bb43388d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:14:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d37e7af3-3be2-4179-8286-e2b79e88cc7f tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Releasing lock "refresh_cache-0c2a7205-02b3-488f-b062-f7f676413cc5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:14:53 user nova-compute[75083]: DEBUG nova.objects.instance [None req-d37e7af3-3be2-4179-8286-e2b79e88cc7f tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'flavor' on Instance uuid 0c2a7205-02b3-488f-b062-f7f676413cc5 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:14:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:54 user nova-compute[75083]: DEBUG nova.compute.manager [req-a7965893-7519-483c-8d32-39553665d56f req-214b04b8-073a-4c33-8190-713d285c8c6f service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received event network-vif-unplugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:14:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a7965893-7519-483c-8d32-39553665d56f req-214b04b8-073a-4c33-8190-713d285c8c6f service nova] Acquiring lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:14:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a7965893-7519-483c-8d32-39553665d56f req-214b04b8-073a-4c33-8190-713d285c8c6f service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:14:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a7965893-7519-483c-8d32-39553665d56f req-214b04b8-073a-4c33-8190-713d285c8c6f service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:14:54 user nova-compute[75083]: DEBUG nova.compute.manager [req-a7965893-7519-483c-8d32-39553665d56f req-214b04b8-073a-4c33-8190-713d285c8c6f service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] No waiting events found dispatching network-vif-unplugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:14:54 user nova-compute[75083]: WARNING nova.compute.manager [req-a7965893-7519-483c-8d32-39553665d56f req-214b04b8-073a-4c33-8190-713d285c8c6f service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received unexpected event network-vif-unplugged-9750238c-1417-442c-a71c-9c04bb43388d for instance with vm_state rescued and task_state unrescuing.
Nov 29 06:14:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:54 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Instance destroyed successfully.
Nov 29 06:14:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:56 user nova-compute[75083]: DEBUG nova.compute.manager [req-bd35eebe-5438-4258-be91-3474b252dfca req-120d62c4-f9f3-47a4-9bac-db638c8c258f service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received event network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:14:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bd35eebe-5438-4258-be91-3474b252dfca req-120d62c4-f9f3-47a4-9bac-db638c8c258f service nova] Acquiring lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:14:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bd35eebe-5438-4258-be91-3474b252dfca req-120d62c4-f9f3-47a4-9bac-db638c8c258f service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:14:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bd35eebe-5438-4258-be91-3474b252dfca req-120d62c4-f9f3-47a4-9bac-db638c8c258f service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:14:56 user nova-compute[75083]: DEBUG nova.compute.manager [req-bd35eebe-5438-4258-be91-3474b252dfca req-120d62c4-f9f3-47a4-9bac-db638c8c258f service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] No waiting events found dispatching network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:14:56 user nova-compute[75083]: WARNING nova.compute.manager [req-bd35eebe-5438-4258-be91-3474b252dfca req-120d62c4-f9f3-47a4-9bac-db638c8c258f service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received unexpected event network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d for instance with vm_state rescued and task_state unrescuing.
Nov 29 06:14:56 user nova-compute[75083]: DEBUG nova.compute.manager [req-bd35eebe-5438-4258-be91-3474b252dfca req-120d62c4-f9f3-47a4-9bac-db638c8c258f service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received event network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:14:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bd35eebe-5438-4258-be91-3474b252dfca req-120d62c4-f9f3-47a4-9bac-db638c8c258f service nova] Acquiring lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:14:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bd35eebe-5438-4258-be91-3474b252dfca req-120d62c4-f9f3-47a4-9bac-db638c8c258f service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:14:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-bd35eebe-5438-4258-be91-3474b252dfca req-120d62c4-f9f3-47a4-9bac-db638c8c258f service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:14:56 user nova-compute[75083]: DEBUG nova.compute.manager [req-bd35eebe-5438-4258-be91-3474b252dfca req-120d62c4-f9f3-47a4-9bac-db638c8c258f service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] No waiting events found dispatching network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:14:56 user nova-compute[75083]: WARNING nova.compute.manager [req-bd35eebe-5438-4258-be91-3474b252dfca req-120d62c4-f9f3-47a4-9bac-db638c8c258f service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received unexpected event network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d for instance with vm_state rescued and task_state unrescuing.
Nov 29 06:14:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:14:58 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d37e7af3-3be2-4179-8286-e2b79e88cc7f tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:14:58 user nova-compute[75083]: DEBUG nova.compute.manager [req-3cd90ae9-dbd0-4aae-981b-1f80f6ab0527 req-a93422f9-a195-4ff0-98d6-6ca0f8066637 service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received event network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:14:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3cd90ae9-dbd0-4aae-981b-1f80f6ab0527 req-a93422f9-a195-4ff0-98d6-6ca0f8066637 service nova] Acquiring lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:14:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3cd90ae9-dbd0-4aae-981b-1f80f6ab0527 req-a93422f9-a195-4ff0-98d6-6ca0f8066637 service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:14:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3cd90ae9-dbd0-4aae-981b-1f80f6ab0527 req-a93422f9-a195-4ff0-98d6-6ca0f8066637 service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:14:58 user nova-compute[75083]: DEBUG nova.compute.manager [req-3cd90ae9-dbd0-4aae-981b-1f80f6ab0527 req-a93422f9-a195-4ff0-98d6-6ca0f8066637 service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] No waiting events found dispatching network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:14:58 user nova-compute[75083]: WARNING nova.compute.manager [req-3cd90ae9-dbd0-4aae-981b-1f80f6ab0527 req-a93422f9-a195-4ff0-98d6-6ca0f8066637 service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received unexpected event network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d for instance with vm_state active and task_state None.
Nov 29 06:15:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:15:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:15:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:15:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:15:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:17 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:15:18 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:15:18 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:15:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:21 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:15:21 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:15:21 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:15:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:24 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:15:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:27 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:15:27 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:15:27 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:15:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:15:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:15:27 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:15:27 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lazy-loading 'info_cache' on Instance uuid b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:15:28 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Updating instance_info_cache with network_info: [{"id": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "address": "fa:16:3e:8a:f0:ed", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb2c35d-ef", "ovs_interfaceid": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:15:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:15:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:15:28 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:15:28 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:15:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:15:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:15:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:15:28 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:15:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:29 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:15:29 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:15:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:30 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:15:30 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:15:30 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8367MB free_disk=24.878982543945312GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:15:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:15:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:15:30 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:15:30 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fea64bdc-491c-46ba-9447-c175df432deb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:15:30 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance be4598f6-6ee2-4219-b8a2-446ba87b2efd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:15:30 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 08b33e17-334b-4816-bcf6-26a67f132bc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:15:30 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 0c2a7205-02b3-488f-b062-f7f676413cc5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:15:30 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 5277c58c-3078-44ba-85b3-2b4b7e16b760 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:15:30 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:15:30 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:15:31 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:15:31 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:15:31 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:15:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:15:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "08b33e17-334b-4816-bcf6-26a67f132bc1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:15:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:15:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "08b33e17-334b-4816-bcf6-26a67f132bc1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:15:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:15:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:15:33 user nova-compute[75083]: INFO nova.compute.manager [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Terminating instance
Nov 29 06:15:33 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:15:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:34 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Instance destroyed successfully.
Nov 29 06:15:34 user nova-compute[75083]: DEBUG nova.objects.instance [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lazy-loading 'resources' on Instance uuid 08b33e17-334b-4816-bcf6-26a67f132bc1 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:15:34 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:08:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-39080786',display_name='tempest-SnapshotDataIntegrityTests-server-39080786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-39080786',id=39,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6jQs3Kut7TxWq2uauoulDgrCuCRVMKegYKDfSzhHH2p48Q15Vkx3Zy65C7CafFPSlWOErU2M7xH7WG6YACf7Kv/2zkdHarZcSIPFbN/OvbGMs2UZAFkE1HHqdEaLlRRw==',key_name='tempest-keypair-398955017',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:08:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07ff233f7ca74890b5f100ed01b943b6',ramdisk_id='',reservation_id='r-5ag8zeh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-44492845',owner_user_name='tempest-SnapshotDataIntegrityTests-44492845-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f54a8c7ddf47e2b386fb54427ea74c',uuid=08b33e17-334b-4816-bcf6-26a67f132bc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe369aec-feeb-4444-a640-012a5b6eb231", "address": "fa:16:3e:11:81:6e", "network": {"id": "1c5d3b69-0dc0-44fc-8d62-0e184770a31c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-246603725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ff233f7ca74890b5f100ed01b943b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe369aec-fe", "ovs_interfaceid": "fe369aec-feeb-4444-a640-012a5b6eb231", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:15:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Converting VIF {"id": "fe369aec-feeb-4444-a640-012a5b6eb231", "address": "fa:16:3e:11:81:6e", "network": {"id": "1c5d3b69-0dc0-44fc-8d62-0e184770a31c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-246603725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ff233f7ca74890b5f100ed01b943b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe369aec-fe", "ovs_interfaceid": "fe369aec-feeb-4444-a640-012a5b6eb231", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:15:34 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:81:6e,bridge_name='br-int',has_traffic_filtering=True,id=fe369aec-feeb-4444-a640-012a5b6eb231,network=Network(1c5d3b69-0dc0-44fc-8d62-0e184770a31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe369aec-fe') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:15:34 user nova-compute[75083]: DEBUG os_vif [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:81:6e,bridge_name='br-int',has_traffic_filtering=True,id=fe369aec-feeb-4444-a640-012a5b6eb231,network=Network(1c5d3b69-0dc0-44fc-8d62-0e184770a31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe369aec-fe') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:15:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe369aec-fe, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:15:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:15:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c32c33d-df20-4ab8-9acf-6a4029c27dee) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:15:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:15:34 user nova-compute[75083]: INFO os_vif [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:81:6e,bridge_name='br-int',has_traffic_filtering=True,id=fe369aec-feeb-4444-a640-012a5b6eb231,network=Network(1c5d3b69-0dc0-44fc-8d62-0e184770a31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe369aec-fe')
Nov 29 06:15:34 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Deleting instance files /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1_del
Nov 29 06:15:34 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Deletion of /opt/stack/data/nova/instances/08b33e17-334b-4816-bcf6-26a67f132bc1_del complete
Nov 29 06:15:34 user nova-compute[75083]: INFO nova.compute.manager [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 29 06:15:34 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:15:34 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:15:34 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:15:35 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:15:35 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Took 0.77 seconds to deallocate network for instance.
Nov 29 06:15:35 user nova-compute[75083]: DEBUG nova.compute.manager [req-dbc4b90b-699c-411b-8643-6615a5c97dd8 req-024a430d-9a40-4eb0-ab20-ea965d566141 service nova] [instance: 08b33e17-334b-4816-bcf6-26a67f132bc1] Received event network-vif-deleted-fe369aec-feeb-4444-a640-012a5b6eb231 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:15:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:15:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:15:35 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:15:35 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:15:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:15:36 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Deleted allocations for instance 08b33e17-334b-4816-bcf6-26a67f132bc1
Nov 29 06:15:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ef070523-b6b5-4b41-b44e-55f95f690d70 tempest-SnapshotDataIntegrityTests-44492845 tempest-SnapshotDataIntegrityTests-44492845-project-member] Lock "08b33e17-334b-4816-bcf6-26a67f132bc1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.192s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:15:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Acquiring lock "29c870eb-05fb-42a0-a60b-1c8b969475a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:15:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Lock "29c870eb-05fb-42a0-a60b-1c8b969475a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:15:39 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:15:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:15:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:15:39 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:15:39 user nova-compute[75083]: INFO nova.compute.claims [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Claim successful on node user
Nov 29 06:15:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG nova.network.neutron [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:15:40 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:15:40 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-e20292b8-ae7e-4b72-bf06-517499a8df29 req-d47ec5ac-395e-49f1-b53e-ca3eb48893c6 service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Received event network-changed-373b7d49-10c9-46ca-a1e5-6a20d1712035 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-e20292b8-ae7e-4b72-bf06-517499a8df29 req-d47ec5ac-395e-49f1-b53e-ca3eb48893c6 service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Refreshing instance network info cache due to event network-changed-373b7d49-10c9-46ca-a1e5-6a20d1712035. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e20292b8-ae7e-4b72-bf06-517499a8df29 req-d47ec5ac-395e-49f1-b53e-ca3eb48893c6 service nova] Acquiring lock "refresh_cache-5277c58c-3078-44ba-85b3-2b4b7e16b760" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e20292b8-ae7e-4b72-bf06-517499a8df29 req-d47ec5ac-395e-49f1-b53e-ca3eb48893c6 service nova] Acquired lock "refresh_cache-5277c58c-3078-44ba-85b3-2b4b7e16b760" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG nova.network.neutron [req-e20292b8-ae7e-4b72-bf06-517499a8df29 req-d47ec5ac-395e-49f1-b53e-ca3eb48893c6 service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Refreshing network info cache for port 373b7d49-10c9-46ca-a1e5-6a20d1712035 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG nova.policy [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9286b85756504e1f8b10b73cd5523fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f36b7fb29d0489686d0f353b456a562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:15:40 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Creating image(s)
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Acquiring lock "/opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Lock "/opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Lock "/opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3/disk 1073741824" returned: 0 in 0.052s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "5277c58c-3078-44ba-85b3-2b4b7e16b760" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "5277c58c-3078-44ba-85b3-2b4b7e16b760" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG nova.network.neutron [req-e20292b8-ae7e-4b72-bf06-517499a8df29 req-d47ec5ac-395e-49f1-b53e-ca3eb48893c6 service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Updated VIF entry in instance network info cache for port 373b7d49-10c9-46ca-a1e5-6a20d1712035. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG nova.network.neutron [req-e20292b8-ae7e-4b72-bf06-517499a8df29 req-d47ec5ac-395e-49f1-b53e-ca3eb48893c6 service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Updating instance_info_cache with network_info: [{"id": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "address": "fa:16:3e:0e:0a:1d", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373b7d49-10", "ovs_interfaceid": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG nova.objects.instance [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lazy-loading 'flavor' on Instance uuid 5277c58c-3078-44ba-85b3-2b4b7e16b760 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e20292b8-ae7e-4b72-bf06-517499a8df29 req-d47ec5ac-395e-49f1-b53e-ca3eb48893c6 service nova] Releasing lock "refresh_cache-5277c58c-3078-44ba-85b3-2b4b7e16b760" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "5277c58c-3078-44ba-85b3-2b4b7e16b760" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 06:15:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "5277c58c-3078-44ba-85b3-2b4b7e16b760" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "5277c58c-3078-44ba-85b3-2b4b7e16b760" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:15:41 user nova-compute[75083]: INFO nova.compute.manager [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Attaching volume c4c078ee-b0be-46d7-83d5-83381d3bc64f to /dev/vdb
Nov 29 06:15:41 user nova-compute[75083]: DEBUG os_brick.utils [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d49915-5554-49ab-a277-23004ff52001]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Cannot resize image /opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Ensure instance console log exists: /opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aaf091-2dd3-4be0-9bfe-7c2e91c626a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[866175d9-fbbf-4dd9-98e4-a021476c9969]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7947bf-1582-457a-9191-1e9ea3aa80c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:15:41 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d1c820-5e57-4c9c-8eb5-ecbd9119d539]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG os_brick.utils [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Updating existing volume attachment record: 0dd49237-7672-4e50-9ebe-95282012a636 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG nova.network.neutron [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Successfully created port: 085ffb03-ee8f-4e4e-b2b0-7031941871fc {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG nova.network.neutron [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Successfully updated port: 085ffb03-ee8f-4e4e-b2b0-7031941871fc {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Acquiring lock "refresh_cache-29c870eb-05fb-42a0-a60b-1c8b969475a3" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Acquired lock "refresh_cache-29c870eb-05fb-42a0-a60b-1c8b969475a3" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:15:41 user nova-compute[75083]: DEBUG nova.network.neutron [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.network.neutron [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.network.neutron [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Updating instance_info_cache with network_info: [{"id": "085ffb03-ee8f-4e4e-b2b0-7031941871fc", "address": "fa:16:3e:c0:a1:30", "network": {"id": "7409ab19-2185-4987-a5a3-fcbdaeb0851a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-581706745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36b7fb29d0489686d0f353b456a562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085ffb03-ee", "ovs_interfaceid": "085ffb03-ee8f-4e4e-b2b0-7031941871fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-8a8ddc36-815a-4f4b-af47-c25d2726a4bd req-0074d034-f9ab-494d-80e2-4cf8ea1874b1 service nova] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Received event network-changed-085ffb03-ee8f-4e4e-b2b0-7031941871fc {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-8a8ddc36-815a-4f4b-af47-c25d2726a4bd req-0074d034-f9ab-494d-80e2-4cf8ea1874b1 service nova] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Refreshing instance network info cache due to event network-changed-085ffb03-ee8f-4e4e-b2b0-7031941871fc. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8a8ddc36-815a-4f4b-af47-c25d2726a4bd req-0074d034-f9ab-494d-80e2-4cf8ea1874b1 service nova] Acquiring lock "refresh_cache-29c870eb-05fb-42a0-a60b-1c8b969475a3" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Releasing lock "refresh_cache-29c870eb-05fb-42a0-a60b-1c8b969475a3" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Instance network_info: |[{"id": "085ffb03-ee8f-4e4e-b2b0-7031941871fc", "address": "fa:16:3e:c0:a1:30", "network": {"id": "7409ab19-2185-4987-a5a3-fcbdaeb0851a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-581706745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36b7fb29d0489686d0f353b456a562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085ffb03-ee", "ovs_interfaceid": "085ffb03-ee8f-4e4e-b2b0-7031941871fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8a8ddc36-815a-4f4b-af47-c25d2726a4bd req-0074d034-f9ab-494d-80e2-4cf8ea1874b1 service nova] Acquired lock "refresh_cache-29c870eb-05fb-42a0-a60b-1c8b969475a3" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.network.neutron [req-8a8ddc36-815a-4f4b-af47-c25d2726a4bd req-0074d034-f9ab-494d-80e2-4cf8ea1874b1 service nova] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Refreshing network info cache for port 085ffb03-ee8f-4e4e-b2b0-7031941871fc {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Start _get_guest_xml network_info=[{"id": "085ffb03-ee8f-4e4e-b2b0-7031941871fc", "address": "fa:16:3e:c0:a1:30", "network": {"id": "7409ab19-2185-4987-a5a3-fcbdaeb0851a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-581706745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36b7fb29d0489686d0f353b456a562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085ffb03-ee", "ovs_interfaceid": "085ffb03-ee8f-4e4e-b2b0-7031941871fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:15:42 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:15:42 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1537802510',display_name='tempest-VolumesActionsTest-instance-1537802510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1537802510',id=43,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f36b7fb29d0489686d0f353b456a562',ramdisk_id='',reservation_id='r-befll07z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-200283495',owner_user_name='tempest-VolumesActionsTest-200283495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:15:40Z,user_data=None,user_id='9286b85756504e1f8b10b73cd5523fbe',uuid=29c870eb-05fb-42a0-a60b-1c8b969475a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "085ffb03-ee8f-4e4e-b2b0-7031941871fc", "address": "fa:16:3e:c0:a1:30", "network": {"id": "7409ab19-2185-4987-a5a3-fcbdaeb0851a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-581706745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36b7fb29d0489686d0f353b456a562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085ffb03-ee", "ovs_interfaceid": "085ffb03-ee8f-4e4e-b2b0-7031941871fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Converting VIF {"id": "085ffb03-ee8f-4e4e-b2b0-7031941871fc", "address": "fa:16:3e:c0:a1:30", "network": {"id": "7409ab19-2185-4987-a5a3-fcbdaeb0851a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-581706745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36b7fb29d0489686d0f353b456a562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085ffb03-ee", "ovs_interfaceid": "085ffb03-ee8f-4e4e-b2b0-7031941871fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:a1:30,bridge_name='br-int',has_traffic_filtering=True,id=085ffb03-ee8f-4e4e-b2b0-7031941871fc,network=Network(7409ab19-2185-4987-a5a3-fcbdaeb0851a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085ffb03-ee') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.objects.instance [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Lazy-loading 'pci_devices' on Instance uuid 29c870eb-05fb-42a0-a60b-1c8b969475a3 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:15:42 user nova-compute[75083]:   <uuid>29c870eb-05fb-42a0-a60b-1c8b969475a3</uuid>
Nov 29 06:15:42 user nova-compute[75083]:   <name>instance-0000002b</name>
Nov 29 06:15:42 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:15:42 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:15:42 user nova-compute[75083]:   <metadata>
Nov 29 06:15:42 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:15:42 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:15:42 user nova-compute[75083]:       <nova:name>tempest-VolumesActionsTest-instance-1537802510</nova:name>
Nov 29 06:15:42 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:15:42</nova:creationTime>
Nov 29 06:15:42 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:15:42 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:15:42 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:15:42 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:15:42 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:15:42 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:15:42 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:15:42 user nova-compute[75083]:       <nova:owner>
Nov 29 06:15:42 user nova-compute[75083]:         <nova:user uuid="9286b85756504e1f8b10b73cd5523fbe">tempest-VolumesActionsTest-200283495-project-member</nova:user>
Nov 29 06:15:42 user nova-compute[75083]:         <nova:project uuid="6f36b7fb29d0489686d0f353b456a562">tempest-VolumesActionsTest-200283495</nova:project>
Nov 29 06:15:42 user nova-compute[75083]:       </nova:owner>
Nov 29 06:15:42 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 06:15:42 user nova-compute[75083]:       <nova:ports>
Nov 29 06:15:42 user nova-compute[75083]:         <nova:port uuid="085ffb03-ee8f-4e4e-b2b0-7031941871fc">
Nov 29 06:15:42 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 06:15:42 user nova-compute[75083]:         </nova:port>
Nov 29 06:15:42 user nova-compute[75083]:       </nova:ports>
Nov 29 06:15:42 user nova-compute[75083]:     </nova:instance>
Nov 29 06:15:42 user nova-compute[75083]:   </metadata>
Nov 29 06:15:42 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:15:42 user nova-compute[75083]:     <system>
Nov 29 06:15:42 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:15:42 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:15:42 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:15:42 user nova-compute[75083]:       <entry name="serial">29c870eb-05fb-42a0-a60b-1c8b969475a3</entry>
Nov 29 06:15:42 user nova-compute[75083]:       <entry name="uuid">29c870eb-05fb-42a0-a60b-1c8b969475a3</entry>
Nov 29 06:15:42 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:15:42 user nova-compute[75083]:     </system>
Nov 29 06:15:42 user nova-compute[75083]:   </sysinfo>
Nov 29 06:15:42 user nova-compute[75083]:   <os>
Nov 29 06:15:42 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:15:42 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:15:42 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:15:42 user nova-compute[75083]:   </os>
Nov 29 06:15:42 user nova-compute[75083]:   <features>
Nov 29 06:15:42 user nova-compute[75083]:     <acpi/>
Nov 29 06:15:42 user nova-compute[75083]:     <apic/>
Nov 29 06:15:42 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:15:42 user nova-compute[75083]:   </features>
Nov 29 06:15:42 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:15:42 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:15:42 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:15:42 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:15:42 user nova-compute[75083]:   </clock>
Nov 29 06:15:42 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:15:42 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:15:42 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:15:42 user nova-compute[75083]:   </cpu>
Nov 29 06:15:42 user nova-compute[75083]:   <devices>
Nov 29 06:15:42 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:15:42 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:15:42 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3/disk"/>
Nov 29 06:15:42 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:15:42 user nova-compute[75083]:     </disk>
Nov 29 06:15:42 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:15:42 user nova-compute[75083]:       <mac address="fa:16:3e:c0:a1:30"/>
Nov 29 06:15:42 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:15:42 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:15:42 user nova-compute[75083]:       <target dev="tap085ffb03-ee"/>
Nov 29 06:15:42 user nova-compute[75083]:     </interface>
Nov 29 06:15:42 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:15:42 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3/console.log" append="off"/>
Nov 29 06:15:42 user nova-compute[75083]:     </serial>
Nov 29 06:15:42 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:15:42 user nova-compute[75083]:     <video>
Nov 29 06:15:42 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:15:42 user nova-compute[75083]:     </video>
Nov 29 06:15:42 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:15:42 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:15:42 user nova-compute[75083]:     </rng>
Nov 29 06:15:42 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:15:42 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:15:42 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:15:42 user nova-compute[75083]:     </memballoon>
Nov 29 06:15:42 user nova-compute[75083]:   </devices>
Nov 29 06:15:42 user nova-compute[75083]: </domain>
Nov 29 06:15:42 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1537802510',display_name='tempest-VolumesActionsTest-instance-1537802510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1537802510',id=43,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f36b7fb29d0489686d0f353b456a562',ramdisk_id='',reservation_id='r-befll07z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-200283495',owner_user_name='tempest-VolumesActionsTest-200283495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:15:40Z,user_data=None,user_id='9286b85756504e1f8b10b73cd5523fbe',uuid=29c870eb-05fb-42a0-a60b-1c8b969475a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "085ffb03-ee8f-4e4e-b2b0-7031941871fc", "address": "fa:16:3e:c0:a1:30", "network": {"id": "7409ab19-2185-4987-a5a3-fcbdaeb0851a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-581706745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36b7fb29d0489686d0f353b456a562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085ffb03-ee", "ovs_interfaceid": "085ffb03-ee8f-4e4e-b2b0-7031941871fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Converting VIF {"id": "085ffb03-ee8f-4e4e-b2b0-7031941871fc", "address": "fa:16:3e:c0:a1:30", "network": {"id": "7409ab19-2185-4987-a5a3-fcbdaeb0851a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-581706745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36b7fb29d0489686d0f353b456a562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085ffb03-ee", "ovs_interfaceid": "085ffb03-ee8f-4e4e-b2b0-7031941871fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:a1:30,bridge_name='br-int',has_traffic_filtering=True,id=085ffb03-ee8f-4e4e-b2b0-7031941871fc,network=Network(7409ab19-2185-4987-a5a3-fcbdaeb0851a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085ffb03-ee') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG os_vif [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:a1:30,bridge_name='br-int',has_traffic_filtering=True,id=085ffb03-ee8f-4e4e-b2b0-7031941871fc,network=Network(7409ab19-2185-4987-a5a3-fcbdaeb0851a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085ffb03-ee') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3bf1eeec-160a-5b29-b036-22a187f08140', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap085ffb03-ee, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap085ffb03-ee, col_values=(('qos', UUID('c8787b85-1553-4d4d-832d-2c3cf0ee6a3c')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap085ffb03-ee, col_values=(('external_ids', {'iface-id': '085ffb03-ee8f-4e4e-b2b0-7031941871fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:a1:30', 'vm-uuid': '29c870eb-05fb-42a0-a60b-1c8b969475a3'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:42 user nova-compute[75083]: INFO os_vif [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:a1:30,bridge_name='br-int',has_traffic_filtering=True,id=085ffb03-ee8f-4e4e-b2b0-7031941871fc,network=Network(7409ab19-2185-4987-a5a3-fcbdaeb0851a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085ffb03-ee')
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] No VIF found with MAC fa:16:3e:c0:a1:30, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.network.neutron [req-8a8ddc36-815a-4f4b-af47-c25d2726a4bd req-0074d034-f9ab-494d-80e2-4cf8ea1874b1 service nova] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Updated VIF entry in instance network info cache for port 085ffb03-ee8f-4e4e-b2b0-7031941871fc. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG nova.network.neutron [req-8a8ddc36-815a-4f4b-af47-c25d2726a4bd req-0074d034-f9ab-494d-80e2-4cf8ea1874b1 service nova] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Updating instance_info_cache with network_info: [{"id": "085ffb03-ee8f-4e4e-b2b0-7031941871fc", "address": "fa:16:3e:c0:a1:30", "network": {"id": "7409ab19-2185-4987-a5a3-fcbdaeb0851a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-581706745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36b7fb29d0489686d0f353b456a562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085ffb03-ee", "ovs_interfaceid": "085ffb03-ee8f-4e4e-b2b0-7031941871fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:15:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8a8ddc36-815a-4f4b-af47-c25d2726a4bd req-0074d034-f9ab-494d-80e2-4cf8ea1874b1 service nova] Releasing lock "refresh_cache-29c870eb-05fb-42a0-a60b-1c8b969475a3" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:15:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:44 user nova-compute[75083]: DEBUG nova.compute.manager [req-0460093c-51aa-4504-8ae7-eb2508390e4d req-c20b6801-0c18-4de4-bdfa-3c38a6c91200 service nova] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Received event network-vif-plugged-085ffb03-ee8f-4e4e-b2b0-7031941871fc {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:15:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0460093c-51aa-4504-8ae7-eb2508390e4d req-c20b6801-0c18-4de4-bdfa-3c38a6c91200 service nova] Acquiring lock "29c870eb-05fb-42a0-a60b-1c8b969475a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:15:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0460093c-51aa-4504-8ae7-eb2508390e4d req-c20b6801-0c18-4de4-bdfa-3c38a6c91200 service nova] Lock "29c870eb-05fb-42a0-a60b-1c8b969475a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:15:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0460093c-51aa-4504-8ae7-eb2508390e4d req-c20b6801-0c18-4de4-bdfa-3c38a6c91200 service nova] Lock "29c870eb-05fb-42a0-a60b-1c8b969475a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:15:44 user nova-compute[75083]: DEBUG nova.compute.manager [req-0460093c-51aa-4504-8ae7-eb2508390e4d req-c20b6801-0c18-4de4-bdfa-3c38a6c91200 service nova] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] No waiting events found dispatching network-vif-plugged-085ffb03-ee8f-4e4e-b2b0-7031941871fc {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:15:44 user nova-compute[75083]: WARNING nova.compute.manager [req-0460093c-51aa-4504-8ae7-eb2508390e4d req-c20b6801-0c18-4de4-bdfa-3c38a6c91200 service nova] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Received unexpected event network-vif-plugged-085ffb03-ee8f-4e4e-b2b0-7031941871fc for instance with vm_state building and task_state spawning.
Nov 29 06:15:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:46 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:15:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:15:46 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Instance spawned successfully.
Nov 29 06:15:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:15:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:15:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:15:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:15:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:15:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:15:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:15:46 user nova-compute[75083]: INFO nova.compute.manager [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Took 5.88 seconds to spawn the instance on the hypervisor.
Nov 29 06:15:46 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:15:46 user nova-compute[75083]: DEBUG nova.compute.manager [req-515e74b9-bc1e-448c-b682-56011a467a5f req-4cbd2f61-1366-4e7b-9ae0-fa2754ee7ed4 service nova] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Received event network-vif-plugged-085ffb03-ee8f-4e4e-b2b0-7031941871fc {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:15:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-515e74b9-bc1e-448c-b682-56011a467a5f req-4cbd2f61-1366-4e7b-9ae0-fa2754ee7ed4 service nova] Acquiring lock "29c870eb-05fb-42a0-a60b-1c8b969475a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:15:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-515e74b9-bc1e-448c-b682-56011a467a5f req-4cbd2f61-1366-4e7b-9ae0-fa2754ee7ed4 service nova] Lock "29c870eb-05fb-42a0-a60b-1c8b969475a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:15:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-515e74b9-bc1e-448c-b682-56011a467a5f req-4cbd2f61-1366-4e7b-9ae0-fa2754ee7ed4 service nova] Lock "29c870eb-05fb-42a0-a60b-1c8b969475a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:15:46 user nova-compute[75083]: DEBUG nova.compute.manager [req-515e74b9-bc1e-448c-b682-56011a467a5f req-4cbd2f61-1366-4e7b-9ae0-fa2754ee7ed4 service nova] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] No waiting events found dispatching network-vif-plugged-085ffb03-ee8f-4e4e-b2b0-7031941871fc {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:15:46 user nova-compute[75083]: WARNING nova.compute.manager [req-515e74b9-bc1e-448c-b682-56011a467a5f req-4cbd2f61-1366-4e7b-9ae0-fa2754ee7ed4 service nova] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Received unexpected event network-vif-plugged-085ffb03-ee8f-4e4e-b2b0-7031941871fc for instance with vm_state building and task_state spawning.
Nov 29 06:15:46 user nova-compute[75083]: INFO nova.compute.manager [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Took 6.57 seconds to build instance.
Nov 29 06:15:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8a8f59f3-9740-41ee-9285-e494aa0f8952 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Lock "29c870eb-05fb-42a0-a60b-1c8b969475a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.667s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:15:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjTISVzD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:15:48 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:15:48 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:15:48 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bcb7db-6d01-4136-8b25-2febd27f1626]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:15:48 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c993b27c-30e8-4e60-b943-434958238cac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f] added
Nov 29 06:15:48 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1030fca6-88a9-43d8-9412-51e7691ca171]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d140cf0-6e57-4549-beb2-ec89964eecb5]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjTISVzD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjTISVzD" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a2ebfd-107a-41c9-8001-388ac6efc545]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wjTISVzD'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec79598-2391-4209-8f73-7c3885cc5269]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[763d8031-54e3-4616-9e25-ca606b9083f7]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:15:48 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:15:48 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:15:48 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:15:48 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ed625c-49ed-42ae-9c02-9006f2685e38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f, portal: 172.16.0.220,3260]
Nov 29 06:15:48 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f, portal: 172.16.0.220,3260] successful.
Nov 29 06:15:48 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a502f7-1aaa-4bb9-88be-1f6088a369eb]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a693860-aada-42e3-a621-b967897df829]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:15:48 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:15:48 user nova-compute[75083]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f (non-flash)
Nov 29 06:15:48 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:15:48 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:15:48 user nova-compute[75083]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f (non-flash)
Nov 29 06:15:48 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c4802b-6884-4a51-90ef-3c8b62f8ce3f]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:15:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjTISVzD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:15:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:15:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23833313433623831', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:15:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833313433623831', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:15:49 user nova-compute[75083]: DEBUG nova.objects.instance [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lazy-loading 'flavor' on Instance uuid 5277c58c-3078-44ba-85b3-2b4b7e16b760 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:15:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 06:15:49 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:15:49 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:15:49 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:15:49 user nova-compute[75083]:   <serial>c4c078ee-b0be-46d7-83d5-83381d3bc64f</serial>
Nov 29 06:15:49 user nova-compute[75083]: </disk>
Nov 29 06:15:49 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 06:15:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:15:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:15:50 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] No VIF found with MAC fa:16:3e:0e:0a:1d, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:15:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-126cee91-ad62-44cd-9222-de306283503c tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "5277c58c-3078-44ba-85b3-2b4b7e16b760" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.313s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:15:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "5277c58c-3078-44ba-85b3-2b4b7e16b760" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:15:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "5277c58c-3078-44ba-85b3-2b4b7e16b760" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:15:52 user nova-compute[75083]: INFO nova.compute.manager [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Detaching volume c4c078ee-b0be-46d7-83d5-83381d3bc64f
Nov 29 06:15:52 user nova-compute[75083]: INFO nova.virt.block_device [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Attempting to driver detach volume c4c078ee-b0be-46d7-83d5-83381d3bc64f from mountpoint /dev/vdb
Nov 29 06:15:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Attempting to detach device vdb from instance 5277c58c-3078-44ba-85b3-2b4b7e16b760 from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 06:15:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:15:52 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:15:52 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:15:52 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:15:52 user nova-compute[75083]:   <serial>c4c078ee-b0be-46d7-83d5-83381d3bc64f</serial>
Nov 29 06:15:52 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:15:52 user nova-compute[75083]: </disk>
Nov 29 06:15:52 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:15:52 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Successfully detached device vdb from instance 5277c58c-3078-44ba-85b3-2b4b7e16b760 from the persistent domain config.
Nov 29 06:15:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5277c58c-3078-44ba-85b3-2b4b7e16b760 from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 06:15:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:15:52 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:15:52 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:15:52 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:15:52 user nova-compute[75083]:   <serial>c4c078ee-b0be-46d7-83d5-83381d3bc64f</serial>
Nov 29 06:15:52 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:15:52 user nova-compute[75083]: </disk>
Nov 29 06:15:52 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:15:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5277c58c-3078-44ba-85b3-2b4b7e16b760 {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 06:15:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:15:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:07 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:13 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5277c58c-3078-44ba-85b3-2b4b7e16b760 is timed out.
Nov 29 06:16:13 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Successfully detached device vdb from instance 5277c58c-3078-44ba-85b3-2b4b7e16b760 from the live domain config.
Nov 29 06:16:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjTISVzD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:16:13 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:16:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc9e0af-80ba-4092-9cce-7f421fb9f934]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:16:13 user nova-compute[75083]: No targets found.
Nov 29 06:16:13 user nova-compute[75083]: iSNS:
Nov 29 06:16:13 user nova-compute[75083]: No targets found.
Nov 29 06:16:13 user nova-compute[75083]: STATIC:
Nov 29 06:16:13 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856
Nov 29 06:16:13 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:16:13 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:16:13 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406
Nov 29 06:16:13 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:16:13 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:16:13 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f
Nov 29 06:16:13 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:16:13 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:16:13 user nova-compute[75083]: FIRMWARE:
Nov 29 06:16:13 user nova-compute[75083]: No targets found.
Nov 29 06:16:13 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:16:13 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:16:13 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11a0b43-a5c2-4452-a5ad-74867e296ced]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fa5498-d417-4b1b-a646-ab8e36da02e9]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:16:13 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:16:13 user nova-compute[75083]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f (non-flash)
Nov 29 06:16:13 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:16:13 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:16:13 user nova-compute[75083]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f (non-flash)
Nov 29 06:16:13 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b83e5750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4191526c-b738-46d6-adbf-1279f2654b65]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec77239e-4579-42d1-972f-24cfe4ef6210]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3cdf36-184c-4948-926a-b341aa6cb2c8]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47a95f5-ddef-4e3f-ad47-0c4f5e9d7ace]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5e2f91-0cf5-4d39-8a7c-18d671ea4454]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f69e13d-9588-49a7-9f73-70648aa71d29]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f, portal: 172.16.0.220,3260]
Nov 29 06:16:13 user nova-compute[75083]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f, portal: 172.16.0.220,3260] successful.
Nov 29 06:16:13 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c078ee-b0be-46d7-83d5-83381d3bc64f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35445b5-0988-40b3-a6c3-afd1b26e683b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] <== disconnect_volume: return (300ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:16:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:16:14 user nova-compute[75083]: DEBUG nova.objects.instance [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lazy-loading 'flavor' on Instance uuid 5277c58c-3078-44ba-85b3-2b4b7e16b760 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:16:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-736f6dd8-97f5-4700-8e2a-7a44e4d7fd0a tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "5277c58c-3078-44ba-85b3-2b4b7e16b760" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.658s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:16:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:22 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:16:22 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:16:22 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:16:22 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:16:22 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:16:22 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:16:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:16:22 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:16:24 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:16:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:27 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:16:27 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:16:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:16:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:16:27 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:16:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:28 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Updating instance_info_cache with network_info: [{"id": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "address": "fa:16:3e:e1:f6:16", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feebf60-26", "ovs_interfaceid": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:16:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-fea64bdc-491c-46ba-9447-c175df432deb" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:16:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:16:28 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:16:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:16:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:16:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:16:28 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:16:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:28 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:29 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:16:29 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:16:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:30 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:16:30 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:16:30 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8404MB free_disk=24.875701904296875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:16:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:16:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:16:30 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:16:30 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fea64bdc-491c-46ba-9447-c175df432deb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:16:30 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance be4598f6-6ee2-4219-b8a2-446ba87b2efd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:16:30 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 0c2a7205-02b3-488f-b062-f7f676413cc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:16:30 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 5277c58c-3078-44ba-85b3-2b4b7e16b760 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:16:30 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 29c870eb-05fb-42a0-a60b-1c8b969475a3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:16:30 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:16:30 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:16:30 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:16:30 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:16:30 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:16:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:16:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:31 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:16:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "0c2a7205-02b3-488f-b062-f7f676413cc5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:16:44 user nova-compute[75083]: INFO nova.compute.manager [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Terminating instance
Nov 29 06:16:44 user nova-compute[75083]: DEBUG nova.compute.manager [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG nova.compute.manager [req-3a963be9-4c60-4bc9-a756-23477473d299 req-daddc812-0a93-4f37-bf7a-7ae8fbc4a1ba service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received event network-vif-unplugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3a963be9-4c60-4bc9-a756-23477473d299 req-daddc812-0a93-4f37-bf7a-7ae8fbc4a1ba service nova] Acquiring lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3a963be9-4c60-4bc9-a756-23477473d299 req-daddc812-0a93-4f37-bf7a-7ae8fbc4a1ba service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3a963be9-4c60-4bc9-a756-23477473d299 req-daddc812-0a93-4f37-bf7a-7ae8fbc4a1ba service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG nova.compute.manager [req-3a963be9-4c60-4bc9-a756-23477473d299 req-daddc812-0a93-4f37-bf7a-7ae8fbc4a1ba service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] No waiting events found dispatching network-vif-unplugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG nova.compute.manager [req-3a963be9-4c60-4bc9-a756-23477473d299 req-daddc812-0a93-4f37-bf7a-7ae8fbc4a1ba service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received event network-vif-unplugged-9750238c-1417-442c-a71c-9c04bb43388d for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:44 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Instance destroyed successfully.
Nov 29 06:16:44 user nova-compute[75083]: DEBUG nova.objects.instance [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'resources' on Instance uuid 0c2a7205-02b3-488f-b062-f7f676413cc5 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-727297675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-727297675',id=41,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:13:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47694ecf400b4d6c952d0c06d0764d1b',ramdisk_id='',reservation_id='r-f5vw9m4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:14:58Z,user_data=None,user_id='4145bf5a07ea4d398f1a1e10a976c10f',uuid=0c2a7205-02b3-488f-b062-f7f676413cc5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9750238c-1417-442c-a71c-9c04bb43388d", "address": "fa:16:3e:65:2e:c7", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9750238c-14", "ovs_interfaceid": "9750238c-1417-442c-a71c-9c04bb43388d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converting VIF {"id": "9750238c-1417-442c-a71c-9c04bb43388d", "address": "fa:16:3e:65:2e:c7", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9750238c-14", "ovs_interfaceid": "9750238c-1417-442c-a71c-9c04bb43388d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:2e:c7,bridge_name='br-int',has_traffic_filtering=True,id=9750238c-1417-442c-a71c-9c04bb43388d,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9750238c-14') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG os_vif [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:2e:c7,bridge_name='br-int',has_traffic_filtering=True,id=9750238c-1417-442c-a71c-9c04bb43388d,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9750238c-14') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9750238c-14, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:16:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33360c40-00c1-4bad-8fbf-bc9259abb723) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:16:45 user nova-compute[75083]: INFO os_vif [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:2e:c7,bridge_name='br-int',has_traffic_filtering=True,id=9750238c-1417-442c-a71c-9c04bb43388d,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9750238c-14')
Nov 29 06:16:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbjVhEQp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:16:45 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[62febe95-d479-4435-8641-4a5786df59c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:16:45 user nova-compute[75083]: No targets found.
Nov 29 06:16:45 user nova-compute[75083]: iSNS:
Nov 29 06:16:45 user nova-compute[75083]: No targets found.
Nov 29 06:16:45 user nova-compute[75083]: STATIC:
Nov 29 06:16:45 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856
Nov 29 06:16:45 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:16:45 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:16:45 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406
Nov 29 06:16:45 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:16:45 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:16:45 user nova-compute[75083]: FIRMWARE:
Nov 29 06:16:45 user nova-compute[75083]: No targets found.
Nov 29 06:16:45 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:16:45 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:16:45 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[921031e5-c411-49e9-bbc3-cd9b64702fb9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3aa9b2-70f6-4e9d-ade1-eb2fd2585031]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:16:45 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:16:45 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:16:45 user nova-compute[75083]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 (non-flash)
Nov 29 06:16:45 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b8483910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406'): ({'sdf'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Removing single pathed devices sdf {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc492f7-9840-444b-8b7e-a24cd75b1398]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb35970a-0b86-4979-b8e4-118c3d62d995]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Flushing IO for device /dev/sdf {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[31592f6f-b5dc-4ebb-93c0-6b9b30a19e1c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba95e8b-7517-4450-9deb-142cb529ab1d]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] SCSI volumes sdf have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23433646230643761', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ecf65733', '/dev/disk/by-id/scsi-1SCST_BIOecf65733-43db0d7a35738377') {{(pid=86165) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7740613-9d29-4afc-9e15-51daac48e170]: (4, None) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[95407ffc-484d-4460-a83e-8657b8fee452]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e4ea78-666f-4beb-8408-bb92fb7a841b]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406, portal: 172.16.0.220,3260]
Nov 29 06:16:45 user nova-compute[75083]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406, portal: 172.16.0.220,3260] successful.
Nov 29 06:16:45 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7300b2df-bebb-4f52-8f2f-02866067c406 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1942276-59c6-4896-983e-93541536a413]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] <== disconnect_volume: return (310ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:16:45 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Deleting instance files /opt/stack/data/nova/instances/0c2a7205-02b3-488f-b062-f7f676413cc5_del
Nov 29 06:16:45 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Deletion of /opt/stack/data/nova/instances/0c2a7205-02b3-488f-b062-f7f676413cc5_del complete
Nov 29 06:16:45 user nova-compute[75083]: INFO nova.compute.manager [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 29 06:16:45 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:16:45 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:16:45 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Took 0.48 seconds to deallocate network for instance.
Nov 29 06:16:46 user nova-compute[75083]: DEBUG nova.compute.manager [req-4ff6a61e-1a97-4c24-9497-32d425491d53 req-9d786014-b4c2-4329-b583-3ad54db1e765 service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received event network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:16:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4ff6a61e-1a97-4c24-9497-32d425491d53 req-9d786014-b4c2-4329-b583-3ad54db1e765 service nova] Acquiring lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:16:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4ff6a61e-1a97-4c24-9497-32d425491d53 req-9d786014-b4c2-4329-b583-3ad54db1e765 service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:16:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-4ff6a61e-1a97-4c24-9497-32d425491d53 req-9d786014-b4c2-4329-b583-3ad54db1e765 service nova] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:16:46 user nova-compute[75083]: DEBUG nova.compute.manager [req-4ff6a61e-1a97-4c24-9497-32d425491d53 req-9d786014-b4c2-4329-b583-3ad54db1e765 service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] No waiting events found dispatching network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:16:46 user nova-compute[75083]: WARNING nova.compute.manager [req-4ff6a61e-1a97-4c24-9497-32d425491d53 req-9d786014-b4c2-4329-b583-3ad54db1e765 service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received unexpected event network-vif-plugged-9750238c-1417-442c-a71c-9c04bb43388d for instance with vm_state active and task_state deleting.
Nov 29 06:16:46 user nova-compute[75083]: DEBUG nova.compute.manager [req-4ff6a61e-1a97-4c24-9497-32d425491d53 req-9d786014-b4c2-4329-b583-3ad54db1e765 service nova] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Received event network-vif-deleted-9750238c-1417-442c-a71c-9c04bb43388d {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:16:46 user nova-compute[75083]: INFO nova.compute.manager [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: 0c2a7205-02b3-488f-b062-f7f676413cc5] Took 0.77 seconds to detach 1 volumes for instance.
Nov 29 06:16:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:16:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:16:46 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:16:46 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:16:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:16:46 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Deleted allocations for instance 0c2a7205-02b3-488f-b062-f7f676413cc5
Nov 29 06:16:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dc9ad41f-2806-4464-8d9e-9d6614faf55b tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "0c2a7205-02b3-488f-b062-f7f676413cc5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.870s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:16:47 user nova-compute[75083]: DEBUG nova.compute.manager [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:16:47 user nova-compute[75083]: INFO nova.compute.manager [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] instance snapshotting
Nov 29 06:16:47 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Beginning live snapshot process
Nov 29 06:16:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json -f qcow2 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json -f qcow2 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjr0v9nts/55763d084d6c415b96f9b69335372f05.delta 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjr0v9nts/55763d084d6c415b96f9b69335372f05.delta 1073741824" returned: 0 in 0.050s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:48 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 06:16:48 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 06:16:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75083) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 06:16:49 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 06:16:49 user nova-compute[75083]: DEBUG nova.privsep.utils [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75083) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 06:16:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjr0v9nts/55763d084d6c415b96f9b69335372f05.delta /opt/stack/data/nova/instances/snapshots/tmpjr0v9nts/55763d084d6c415b96f9b69335372f05 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:50 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjr0v9nts/55763d084d6c415b96f9b69335372f05.delta /opt/stack/data/nova/instances/snapshots/tmpjr0v9nts/55763d084d6c415b96f9b69335372f05" returned: 0 in 0.549s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:50 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Snapshot extracted, beginning image upload
Nov 29 06:16:52 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Snapshot image upload complete
Nov 29 06:16:52 user nova-compute[75083]: INFO nova.compute.manager [None req-09d958a7-2386-4c13-bdd6-8d3aebdcf58b tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Took 5.09 seconds to snapshot the instance on the hypervisor.
Nov 29 06:16:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:16:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:16:54 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:16:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:16:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:16:54 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:16:54 user nova-compute[75083]: INFO nova.compute.claims [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Claim successful on node user
Nov 29 06:16:54 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:16:54 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:16:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:16:54 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:16:54 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:16:54 user nova-compute[75083]: DEBUG nova.network.neutron [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:16:54 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:16:54 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:16:54 user nova-compute[75083]: DEBUG nova.policy [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '131cbc1c58fb486eb2ba0740ecfaa7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b12e29dfdde4ed4b8a9f17ea146509e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:16:54 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:16:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:16:54 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Creating image(s)
Nov 29 06:16:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "/opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:16:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "/opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:16:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "/opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:16:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "bb4976e4661bfafec4401a3862450e74274088a0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:16:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "bb4976e4661bfafec4401a3862450e74274088a0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:16:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb4976e4661bfafec4401a3862450e74274088a0.part --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:55 user nova-compute[75083]: DEBUG nova.network.neutron [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Successfully created port: e3a2e9c5-344c-43b8-8ab4-652f2f041e93 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:16:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb4976e4661bfafec4401a3862450e74274088a0.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:55 user nova-compute[75083]: DEBUG nova.virt.images [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] a7cf426b-1ad7-4fc9-a67d-aa118755c328 was qcow2, converting to raw {{(pid=75083) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 06:16:55 user nova-compute[75083]: DEBUG nova.privsep.utils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75083) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 06:16:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bb4976e4661bfafec4401a3862450e74274088a0.part /opt/stack/data/nova/instances/_base/bb4976e4661bfafec4401a3862450e74274088a0.converted {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bb4976e4661bfafec4401a3862450e74274088a0.part /opt/stack/data/nova/instances/_base/bb4976e4661bfafec4401a3862450e74274088a0.converted" returned: 0 in 0.705s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb4976e4661bfafec4401a3862450e74274088a0.converted --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb4976e4661bfafec4401a3862450e74274088a0.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "bb4976e4661bfafec4401a3862450e74274088a0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.130s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:16:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb4976e4661bfafec4401a3862450e74274088a0 --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:56 user nova-compute[75083]: DEBUG nova.network.neutron [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Successfully updated port: e3a2e9c5-344c-43b8-8ab4-652f2f041e93 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-0e4b77c7-4543-4ad4-8a77-a68ae3e749c2 req-7161636c-82e0-48fe-9d22-5719ea4bb355 service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Received event network-changed-e3a2e9c5-344c-43b8-8ab4-652f2f041e93 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-0e4b77c7-4543-4ad4-8a77-a68ae3e749c2 req-7161636c-82e0-48fe-9d22-5719ea4bb355 service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Refreshing instance network info cache due to event network-changed-e3a2e9c5-344c-43b8-8ab4-652f2f041e93. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0e4b77c7-4543-4ad4-8a77-a68ae3e749c2 req-7161636c-82e0-48fe-9d22-5719ea4bb355 service nova] Acquiring lock "refresh_cache-bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0e4b77c7-4543-4ad4-8a77-a68ae3e749c2 req-7161636c-82e0-48fe-9d22-5719ea4bb355 service nova] Acquired lock "refresh_cache-bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.network.neutron [req-0e4b77c7-4543-4ad4-8a77-a68ae3e749c2 req-7161636c-82e0-48fe-9d22-5719ea4bb355 service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Refreshing network info cache for port e3a2e9c5-344c-43b8-8ab4-652f2f041e93 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb4976e4661bfafec4401a3862450e74274088a0 --force-share --output=json" returned: 0 in 0.187s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "bb4976e4661bfafec4401a3862450e74274088a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "bb4976e4661bfafec4401a3862450e74274088a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb4976e4661bfafec4401a3862450e74274088a0 --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "refresh_cache-bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.network.neutron [req-0e4b77c7-4543-4ad4-8a77-a68ae3e749c2 req-7161636c-82e0-48fe-9d22-5719ea4bb355 service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb4976e4661bfafec4401a3862450e74274088a0 --force-share --output=json" returned: 0 in 0.188s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb4976e4661bfafec4401a3862450e74274088a0,backing_fmt=raw /opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.network.neutron [req-0e4b77c7-4543-4ad4-8a77-a68ae3e749c2 req-7161636c-82e0-48fe-9d22-5719ea4bb355 service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb4976e4661bfafec4401a3862450e74274088a0,backing_fmt=raw /opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d/disk 1073741824" returned: 0 in 0.054s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "bb4976e4661bfafec4401a3862450e74274088a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb4976e4661bfafec4401a3862450e74274088a0 --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0e4b77c7-4543-4ad4-8a77-a68ae3e749c2 req-7161636c-82e0-48fe-9d22-5719ea4bb355 service nova] Releasing lock "refresh_cache-bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquired lock "refresh_cache-bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.network.neutron [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.network.neutron [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb4976e4661bfafec4401a3862450e74274088a0 --force-share --output=json" returned: 0 in 0.171s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Ensure instance console log exists: /opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.network.neutron [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Updating instance_info_cache with network_info: [{"id": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "address": "fa:16:3e:21:db:e3", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a2e9c5-34", "ovs_interfaceid": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Releasing lock "refresh_cache-bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Instance network_info: |[{"id": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "address": "fa:16:3e:21:db:e3", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a2e9c5-34", "ovs_interfaceid": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Start _get_guest_xml network_info=[{"id": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "address": "fa:16:3e:21:db:e3", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a2e9c5-34", "ovs_interfaceid": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='0b69a186974bc540ee9bbdd046dc79f7',container_format='bare',created_at=2023-11-29T06:16:47Z,direct_url=<?>,disk_format='qcow2',id=a7cf426b-1ad7-4fc9-a67d-aa118755c328,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-254368074',owner='4b12e29dfdde4ed4b8a9f17ea146509e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T06:16:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': 'a7cf426b-1ad7-4fc9-a67d-aa118755c328'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:16:57 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:16:57 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0b69a186974bc540ee9bbdd046dc79f7',container_format='bare',created_at=2023-11-29T06:16:47Z,direct_url=<?>,disk_format='qcow2',id=a7cf426b-1ad7-4fc9-a67d-aa118755c328,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-254368074',owner='4b12e29dfdde4ed4b8a9f17ea146509e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T06:16:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-996900115',display_name='tempest-TestStampPattern-server-996900115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-996900115',id=44,image_ref='a7cf426b-1ad7-4fc9-a67d-aa118755c328',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0r9XpGMZ9H/Y4I/0x8bzbOcE6fHNK54Wz8ou6+Qs3mulslzYO8Mrt2NyEGfqnGboyoLwXwwDgzi9WtBLtWKKBOjYUhnhNK5lWoSf+vBunDq+fymy+tZb2F3uviDT9Mjg==',key_name='tempest-TestStampPattern-774953284',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b12e29dfdde4ed4b8a9f17ea146509e',ramdisk_id='',reservation_id='r-aa70ifrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5277c58c-3078-44ba-85b3-2b4b7e16b760',image_min_disk='1',image_min_ram='0',image_owner_id='4b12e29dfdde4ed4b8a9f17ea146509e',image_owner_project_name='tempest-TestStampPattern-1336384366',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1336384366-project-member',image_user_id='131cbc1c58fb486eb2ba0740ecfaa7a9',network_allocated='True',owner_project_name='tempest-TestStampPattern-1336384366',owner_user_name='tempest-TestStampPattern-1336384366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:16:55Z,user_data=None,user_id='131cbc1c58fb486eb2ba0740ecfaa7a9',uuid=bedd2db3-7195-4f52-bd1c-d4391a6a9e3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "address": "fa:16:3e:21:db:e3", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a2e9c5-34", "ovs_interfaceid": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Converting VIF {"id": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "address": "fa:16:3e:21:db:e3", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a2e9c5-34", "ovs_interfaceid": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:db:e3,bridge_name='br-int',has_traffic_filtering=True,id=e3a2e9c5-344c-43b8-8ab4-652f2f041e93,network=Network(6a21050c-13c7-40b5-a1c5-f93ddc74e7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a2e9c5-34') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.objects.instance [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lazy-loading 'pci_devices' on Instance uuid bedd2db3-7195-4f52-bd1c-d4391a6a9e3d {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:16:57 user nova-compute[75083]:   <uuid>bedd2db3-7195-4f52-bd1c-d4391a6a9e3d</uuid>
Nov 29 06:16:57 user nova-compute[75083]:   <name>instance-0000002c</name>
Nov 29 06:16:57 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:16:57 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:16:57 user nova-compute[75083]:   <metadata>
Nov 29 06:16:57 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:16:57 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:16:57 user nova-compute[75083]:       <nova:name>tempest-TestStampPattern-server-996900115</nova:name>
Nov 29 06:16:57 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:16:57</nova:creationTime>
Nov 29 06:16:57 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:16:57 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:16:57 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:16:57 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:16:57 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:16:57 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:16:57 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:16:57 user nova-compute[75083]:       <nova:owner>
Nov 29 06:16:57 user nova-compute[75083]:         <nova:user uuid="131cbc1c58fb486eb2ba0740ecfaa7a9">tempest-TestStampPattern-1336384366-project-member</nova:user>
Nov 29 06:16:57 user nova-compute[75083]:         <nova:project uuid="4b12e29dfdde4ed4b8a9f17ea146509e">tempest-TestStampPattern-1336384366</nova:project>
Nov 29 06:16:57 user nova-compute[75083]:       </nova:owner>
Nov 29 06:16:57 user nova-compute[75083]:       <nova:root type="image" uuid="a7cf426b-1ad7-4fc9-a67d-aa118755c328"/>
Nov 29 06:16:57 user nova-compute[75083]:       <nova:ports>
Nov 29 06:16:57 user nova-compute[75083]:         <nova:port uuid="e3a2e9c5-344c-43b8-8ab4-652f2f041e93">
Nov 29 06:16:57 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 06:16:57 user nova-compute[75083]:         </nova:port>
Nov 29 06:16:57 user nova-compute[75083]:       </nova:ports>
Nov 29 06:16:57 user nova-compute[75083]:     </nova:instance>
Nov 29 06:16:57 user nova-compute[75083]:   </metadata>
Nov 29 06:16:57 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:16:57 user nova-compute[75083]:     <system>
Nov 29 06:16:57 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:16:57 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:16:57 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:16:57 user nova-compute[75083]:       <entry name="serial">bedd2db3-7195-4f52-bd1c-d4391a6a9e3d</entry>
Nov 29 06:16:57 user nova-compute[75083]:       <entry name="uuid">bedd2db3-7195-4f52-bd1c-d4391a6a9e3d</entry>
Nov 29 06:16:57 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:16:57 user nova-compute[75083]:     </system>
Nov 29 06:16:57 user nova-compute[75083]:   </sysinfo>
Nov 29 06:16:57 user nova-compute[75083]:   <os>
Nov 29 06:16:57 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:16:57 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:16:57 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:16:57 user nova-compute[75083]:   </os>
Nov 29 06:16:57 user nova-compute[75083]:   <features>
Nov 29 06:16:57 user nova-compute[75083]:     <acpi/>
Nov 29 06:16:57 user nova-compute[75083]:     <apic/>
Nov 29 06:16:57 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:16:57 user nova-compute[75083]:   </features>
Nov 29 06:16:57 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:16:57 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:16:57 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:16:57 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:16:57 user nova-compute[75083]:   </clock>
Nov 29 06:16:57 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:16:57 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:16:57 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:16:57 user nova-compute[75083]:   </cpu>
Nov 29 06:16:57 user nova-compute[75083]:   <devices>
Nov 29 06:16:57 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:16:57 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:16:57 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d/disk"/>
Nov 29 06:16:57 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:16:57 user nova-compute[75083]:     </disk>
Nov 29 06:16:57 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:16:57 user nova-compute[75083]:       <mac address="fa:16:3e:21:db:e3"/>
Nov 29 06:16:57 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:16:57 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:16:57 user nova-compute[75083]:       <target dev="tape3a2e9c5-34"/>
Nov 29 06:16:57 user nova-compute[75083]:     </interface>
Nov 29 06:16:57 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:16:57 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d/console.log" append="off"/>
Nov 29 06:16:57 user nova-compute[75083]:     </serial>
Nov 29 06:16:57 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:16:57 user nova-compute[75083]:     <video>
Nov 29 06:16:57 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:16:57 user nova-compute[75083]:     </video>
Nov 29 06:16:57 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:16:57 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:16:57 user nova-compute[75083]:     </rng>
Nov 29 06:16:57 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:16:57 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:16:57 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:16:57 user nova-compute[75083]:     </memballoon>
Nov 29 06:16:57 user nova-compute[75083]:   </devices>
Nov 29 06:16:57 user nova-compute[75083]: </domain>
Nov 29 06:16:57 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-996900115',display_name='tempest-TestStampPattern-server-996900115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-996900115',id=44,image_ref='a7cf426b-1ad7-4fc9-a67d-aa118755c328',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0r9XpGMZ9H/Y4I/0x8bzbOcE6fHNK54Wz8ou6+Qs3mulslzYO8Mrt2NyEGfqnGboyoLwXwwDgzi9WtBLtWKKBOjYUhnhNK5lWoSf+vBunDq+fymy+tZb2F3uviDT9Mjg==',key_name='tempest-TestStampPattern-774953284',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b12e29dfdde4ed4b8a9f17ea146509e',ramdisk_id='',reservation_id='r-aa70ifrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5277c58c-3078-44ba-85b3-2b4b7e16b760',image_min_disk='1',image_min_ram='0',image_owner_id='4b12e29dfdde4ed4b8a9f17ea146509e',image_owner_project_name='tempest-TestStampPattern-1336384366',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1336384366-project-member',image_user_id='131cbc1c58fb486eb2ba0740ecfaa7a9',network_allocated='True',owner_project_name='tempest-TestStampPattern-1336384366',owner_user_name='tempest-TestStampPattern-1336384366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:16:55Z,user_data=None,user_id='131cbc1c58fb486eb2ba0740ecfaa7a9',uuid=bedd2db3-7195-4f52-bd1c-d4391a6a9e3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "address": "fa:16:3e:21:db:e3", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a2e9c5-34", "ovs_interfaceid": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Converting VIF {"id": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "address": "fa:16:3e:21:db:e3", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a2e9c5-34", "ovs_interfaceid": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:db:e3,bridge_name='br-int',has_traffic_filtering=True,id=e3a2e9c5-344c-43b8-8ab4-652f2f041e93,network=Network(6a21050c-13c7-40b5-a1c5-f93ddc74e7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a2e9c5-34') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG os_vif [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:db:e3,bridge_name='br-int',has_traffic_filtering=True,id=e3a2e9c5-344c-43b8-8ab4-652f2f041e93,network=Network(6a21050c-13c7-40b5-a1c5-f93ddc74e7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a2e9c5-34') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '919d662f-c830-5ae1-b190-7f591de14bc3', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3a2e9c5-34, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3a2e9c5-34, col_values=(('qos', UUID('be903d27-eca7-4b89-b521-7a4024943813')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3a2e9c5-34, col_values=(('external_ids', {'iface-id': 'e3a2e9c5-344c-43b8-8ab4-652f2f041e93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:db:e3', 'vm-uuid': 'bedd2db3-7195-4f52-bd1c-d4391a6a9e3d'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:57 user nova-compute[75083]: INFO os_vif [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:db:e3,bridge_name='br-int',has_traffic_filtering=True,id=e3a2e9c5-344c-43b8-8ab4-652f2f041e93,network=Network(6a21050c-13c7-40b5-a1c5-f93ddc74e7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a2e9c5-34')
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:16:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] No VIF found with MAC fa:16:3e:21:db:e3, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:16:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:16:59 user nova-compute[75083]: DEBUG nova.compute.manager [req-06e0e39b-9d61-4564-bdbb-49f98f8510fa req-afad0f15-e67b-4a98-be0e-850e14798f1f service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Received event network-vif-plugged-e3a2e9c5-344c-43b8-8ab4-652f2f041e93 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:16:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-06e0e39b-9d61-4564-bdbb-49f98f8510fa req-afad0f15-e67b-4a98-be0e-850e14798f1f service nova] Acquiring lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:16:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-06e0e39b-9d61-4564-bdbb-49f98f8510fa req-afad0f15-e67b-4a98-be0e-850e14798f1f service nova] Lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:16:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-06e0e39b-9d61-4564-bdbb-49f98f8510fa req-afad0f15-e67b-4a98-be0e-850e14798f1f service nova] Lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:16:59 user nova-compute[75083]: DEBUG nova.compute.manager [req-06e0e39b-9d61-4564-bdbb-49f98f8510fa req-afad0f15-e67b-4a98-be0e-850e14798f1f service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] No waiting events found dispatching network-vif-plugged-e3a2e9c5-344c-43b8-8ab4-652f2f041e93 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:16:59 user nova-compute[75083]: WARNING nova.compute.manager [req-06e0e39b-9d61-4564-bdbb-49f98f8510fa req-afad0f15-e67b-4a98-be0e-850e14798f1f service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Received unexpected event network-vif-plugged-e3a2e9c5-344c-43b8-8ab4-652f2f041e93 for instance with vm_state building and task_state spawning.
Nov 29 06:16:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:01 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:17:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:17:01 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Instance spawned successfully.
Nov 29 06:17:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:17:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:17:01 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:17:01 user nova-compute[75083]: INFO nova.compute.manager [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Took 6.58 seconds to spawn the instance on the hypervisor.
Nov 29 06:17:01 user nova-compute[75083]: DEBUG nova.compute.manager [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:17:01 user nova-compute[75083]: DEBUG nova.compute.manager [req-05254753-4ea0-4615-9ee6-f18d4627f15b req-b27cb93e-5732-4509-8203-d5bf7b86e51c service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Received event network-vif-plugged-e3a2e9c5-344c-43b8-8ab4-652f2f041e93 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:17:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-05254753-4ea0-4615-9ee6-f18d4627f15b req-b27cb93e-5732-4509-8203-d5bf7b86e51c service nova] Acquiring lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:17:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-05254753-4ea0-4615-9ee6-f18d4627f15b req-b27cb93e-5732-4509-8203-d5bf7b86e51c service nova] Lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:17:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-05254753-4ea0-4615-9ee6-f18d4627f15b req-b27cb93e-5732-4509-8203-d5bf7b86e51c service nova] Lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:17:01 user nova-compute[75083]: DEBUG nova.compute.manager [req-05254753-4ea0-4615-9ee6-f18d4627f15b req-b27cb93e-5732-4509-8203-d5bf7b86e51c service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] No waiting events found dispatching network-vif-plugged-e3a2e9c5-344c-43b8-8ab4-652f2f041e93 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:17:01 user nova-compute[75083]: WARNING nova.compute.manager [req-05254753-4ea0-4615-9ee6-f18d4627f15b req-b27cb93e-5732-4509-8203-d5bf7b86e51c service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Received unexpected event network-vif-plugged-e3a2e9c5-344c-43b8-8ab4-652f2f041e93 for instance with vm_state building and task_state spawning.
Nov 29 06:17:01 user nova-compute[75083]: INFO nova.compute.manager [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Took 7.27 seconds to build instance.
Nov 29 06:17:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-8f62e213-d836-461d-b7db-3b84052b18ca tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.369s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:17:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:07 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:20 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:17:20 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:17:21 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:17:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:22 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:17:22 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:17:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:24 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:17:25 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:17:26 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:17:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 06:17:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] There are 0 instances to clean {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 06:17:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:27 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:17:27 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:17:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-be4598f6-6ee2-4219-b8a2-446ba87b2efd" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:17:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-be4598f6-6ee2-4219-b8a2-446ba87b2efd" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:17:27 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:17:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:28 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Updating instance_info_cache with network_info: [{"id": "f38c71e9-810f-4add-b8cb-1a41f2146304", "address": "fa:16:3e:70:3d:40", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38c71e9-81", "ovs_interfaceid": "f38c71e9-810f-4add-b8cb-1a41f2146304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:17:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-be4598f6-6ee2-4219-b8a2-446ba87b2efd" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:17:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:17:30 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:17:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:17:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:17:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:17:30 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:17:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:17:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:17:30 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:17:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:17:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:17:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:17:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:17:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:17:31 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:17:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:17:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:17:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:17:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:17:31 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:17:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:17:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:17:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:17:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:17:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:17:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:17:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:33 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:17:33 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:17:33 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8426MB free_disk=24.721355438232422GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance fea64bdc-491c-46ba-9447-c175df432deb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance be4598f6-6ee2-4219-b8a2-446ba87b2efd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 5277c58c-3078-44ba-85b3-2b4b7e16b760 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 29c870eb-05fb-42a0-a60b-1c8b969475a3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance bedd2db3-7195-4f52-bd1c-d4391a6a9e3d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing inventories for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Updating ProviderTree inventory for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Updating inventory in ProviderTree for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing aggregate associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, aggregates: None {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing trait associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, traits: HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.623s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:17:33 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75083) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 06:17:34 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:17:35 user nova-compute[75083]: INFO nova.compute.manager [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Terminating instance
Nov 29 06:17:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG nova.compute.manager [req-3de009c1-8bae-4326-8c06-323944b8b339 req-1145dfaa-d0b6-4fee-bd69-9487ebaa545c service nova] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Received event network-vif-unplugged-f38c71e9-810f-4add-b8cb-1a41f2146304 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3de009c1-8bae-4326-8c06-323944b8b339 req-1145dfaa-d0b6-4fee-bd69-9487ebaa545c service nova] Acquiring lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3de009c1-8bae-4326-8c06-323944b8b339 req-1145dfaa-d0b6-4fee-bd69-9487ebaa545c service nova] Lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3de009c1-8bae-4326-8c06-323944b8b339 req-1145dfaa-d0b6-4fee-bd69-9487ebaa545c service nova] Lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG nova.compute.manager [req-3de009c1-8bae-4326-8c06-323944b8b339 req-1145dfaa-d0b6-4fee-bd69-9487ebaa545c service nova] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] No waiting events found dispatching network-vif-unplugged-f38c71e9-810f-4add-b8cb-1a41f2146304 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG nova.compute.manager [req-3de009c1-8bae-4326-8c06-323944b8b339 req-1145dfaa-d0b6-4fee-bd69-9487ebaa545c service nova] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Received event network-vif-unplugged-f38c71e9-810f-4add-b8cb-1a41f2146304 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:17:35 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Instance destroyed successfully.
Nov 29 06:17:35 user nova-compute[75083]: DEBUG nova.objects.instance [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'resources' on Instance uuid be4598f6-6ee2-4219-b8a2-446ba87b2efd {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:08:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-484206354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-484206354',id=38,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:08:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47694ecf400b4d6c952d0c06d0764d1b',ramdisk_id='',reservation_id='r-3kp8h4me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:10:09Z,user_data=None,user_id='4145bf5a07ea4d398f1a1e10a976c10f',uuid=be4598f6-6ee2-4219-b8a2-446ba87b2efd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f38c71e9-810f-4add-b8cb-1a41f2146304", "address": "fa:16:3e:70:3d:40", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38c71e9-81", "ovs_interfaceid": "f38c71e9-810f-4add-b8cb-1a41f2146304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converting VIF {"id": "f38c71e9-810f-4add-b8cb-1a41f2146304", "address": "fa:16:3e:70:3d:40", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38c71e9-81", "ovs_interfaceid": "f38c71e9-810f-4add-b8cb-1a41f2146304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:3d:40,bridge_name='br-int',has_traffic_filtering=True,id=f38c71e9-810f-4add-b8cb-1a41f2146304,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38c71e9-81') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG os_vif [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:3d:40,bridge_name='br-int',has_traffic_filtering=True,id=f38c71e9-810f-4add-b8cb-1a41f2146304,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38c71e9-81') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf38c71e9-81, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc84cdbf-2ea5-48b4-b3d6-8d44688ab82e) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:17:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:17:36 user nova-compute[75083]: INFO os_vif [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:3d:40,bridge_name='br-int',has_traffic_filtering=True,id=f38c71e9-810f-4add-b8cb-1a41f2146304,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38c71e9-81')
Nov 29 06:17:36 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Deleting instance files /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd_del
Nov 29 06:17:36 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Deletion of /opt/stack/data/nova/instances/be4598f6-6ee2-4219-b8a2-446ba87b2efd_del complete
Nov 29 06:17:36 user nova-compute[75083]: INFO nova.compute.manager [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 29 06:17:36 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:17:36 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:17:36 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:17:36 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:17:36 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Took 0.55 seconds to deallocate network for instance.
Nov 29 06:17:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:17:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:17:36 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:17:36 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:17:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:17:36 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Deleted allocations for instance be4598f6-6ee2-4219-b8a2-446ba87b2efd
Nov 29 06:17:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-327dec20-491f-403b-946e-c88b8b1c07ed tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.926s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:17:37 user nova-compute[75083]: DEBUG nova.compute.manager [req-21005c16-b465-4ba7-a328-1ad9bcb1b1c3 req-ff4572e4-d1ec-41c8-9540-f229306e234a service nova] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Received event network-vif-plugged-f38c71e9-810f-4add-b8cb-1a41f2146304 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:17:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-21005c16-b465-4ba7-a328-1ad9bcb1b1c3 req-ff4572e4-d1ec-41c8-9540-f229306e234a service nova] Acquiring lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:17:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-21005c16-b465-4ba7-a328-1ad9bcb1b1c3 req-ff4572e4-d1ec-41c8-9540-f229306e234a service nova] Lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:17:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-21005c16-b465-4ba7-a328-1ad9bcb1b1c3 req-ff4572e4-d1ec-41c8-9540-f229306e234a service nova] Lock "be4598f6-6ee2-4219-b8a2-446ba87b2efd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:17:37 user nova-compute[75083]: DEBUG nova.compute.manager [req-21005c16-b465-4ba7-a328-1ad9bcb1b1c3 req-ff4572e4-d1ec-41c8-9540-f229306e234a service nova] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] No waiting events found dispatching network-vif-plugged-f38c71e9-810f-4add-b8cb-1a41f2146304 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:17:37 user nova-compute[75083]: WARNING nova.compute.manager [req-21005c16-b465-4ba7-a328-1ad9bcb1b1c3 req-ff4572e4-d1ec-41c8-9540-f229306e234a service nova] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Received unexpected event network-vif-plugged-f38c71e9-810f-4add-b8cb-1a41f2146304 for instance with vm_state deleted and task_state None.
Nov 29 06:17:37 user nova-compute[75083]: DEBUG nova.compute.manager [req-21005c16-b465-4ba7-a328-1ad9bcb1b1c3 req-ff4572e4-d1ec-41c8-9540-f229306e234a service nova] [instance: be4598f6-6ee2-4219-b8a2-446ba87b2efd] Received event network-vif-deleted-f38c71e9-810f-4add-b8cb-1a41f2146304 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Acquiring lock "29c870eb-05fb-42a0-a60b-1c8b969475a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Lock "29c870eb-05fb-42a0-a60b-1c8b969475a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Acquiring lock "29c870eb-05fb-42a0-a60b-1c8b969475a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Lock "29c870eb-05fb-42a0-a60b-1c8b969475a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Lock "29c870eb-05fb-42a0-a60b-1c8b969475a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:17:40 user nova-compute[75083]: INFO nova.compute.manager [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Terminating instance
Nov 29 06:17:40 user nova-compute[75083]: DEBUG nova.compute.manager [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-d78948bb-ceb1-40a6-8c6d-72deb1523f75 req-43f42cfc-3251-4f42-a2c1-eeced0d6d573 service nova] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Received event network-vif-unplugged-085ffb03-ee8f-4e4e-b2b0-7031941871fc {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d78948bb-ceb1-40a6-8c6d-72deb1523f75 req-43f42cfc-3251-4f42-a2c1-eeced0d6d573 service nova] Acquiring lock "29c870eb-05fb-42a0-a60b-1c8b969475a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d78948bb-ceb1-40a6-8c6d-72deb1523f75 req-43f42cfc-3251-4f42-a2c1-eeced0d6d573 service nova] Lock "29c870eb-05fb-42a0-a60b-1c8b969475a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d78948bb-ceb1-40a6-8c6d-72deb1523f75 req-43f42cfc-3251-4f42-a2c1-eeced0d6d573 service nova] Lock "29c870eb-05fb-42a0-a60b-1c8b969475a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-d78948bb-ceb1-40a6-8c6d-72deb1523f75 req-43f42cfc-3251-4f42-a2c1-eeced0d6d573 service nova] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] No waiting events found dispatching network-vif-unplugged-085ffb03-ee8f-4e4e-b2b0-7031941871fc {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG nova.compute.manager [req-d78948bb-ceb1-40a6-8c6d-72deb1523f75 req-43f42cfc-3251-4f42-a2c1-eeced0d6d573 service nova] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Received event network-vif-unplugged-085ffb03-ee8f-4e4e-b2b0-7031941871fc for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:40 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Instance destroyed successfully.
Nov 29 06:17:40 user nova-compute[75083]: DEBUG nova.objects.instance [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Lazy-loading 'resources' on Instance uuid 29c870eb-05fb-42a0-a60b-1c8b969475a3 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1537802510',display_name='tempest-VolumesActionsTest-instance-1537802510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1537802510',id=43,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:15:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f36b7fb29d0489686d0f353b456a562',ramdisk_id='',reservation_id='r-befll07z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-200283495',owner_user_name='tempest-VolumesActionsTest-200283495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:15:46Z,user_data=None,user_id='9286b85756504e1f8b10b73cd5523fbe',uuid=29c870eb-05fb-42a0-a60b-1c8b969475a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "085ffb03-ee8f-4e4e-b2b0-7031941871fc", "address": "fa:16:3e:c0:a1:30", "network": {"id": "7409ab19-2185-4987-a5a3-fcbdaeb0851a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-581706745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36b7fb29d0489686d0f353b456a562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085ffb03-ee", "ovs_interfaceid": "085ffb03-ee8f-4e4e-b2b0-7031941871fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Converting VIF {"id": "085ffb03-ee8f-4e4e-b2b0-7031941871fc", "address": "fa:16:3e:c0:a1:30", "network": {"id": "7409ab19-2185-4987-a5a3-fcbdaeb0851a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-581706745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36b7fb29d0489686d0f353b456a562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085ffb03-ee", "ovs_interfaceid": "085ffb03-ee8f-4e4e-b2b0-7031941871fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:a1:30,bridge_name='br-int',has_traffic_filtering=True,id=085ffb03-ee8f-4e4e-b2b0-7031941871fc,network=Network(7409ab19-2185-4987-a5a3-fcbdaeb0851a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085ffb03-ee') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG os_vif [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:a1:30,bridge_name='br-int',has_traffic_filtering=True,id=085ffb03-ee8f-4e4e-b2b0-7031941871fc,network=Network(7409ab19-2185-4987-a5a3-fcbdaeb0851a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085ffb03-ee') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap085ffb03-ee, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:17:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8787b85-1553-4d4d-832d-2c3cf0ee6a3c) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:17:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:41 user nova-compute[75083]: INFO os_vif [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:a1:30,bridge_name='br-int',has_traffic_filtering=True,id=085ffb03-ee8f-4e4e-b2b0-7031941871fc,network=Network(7409ab19-2185-4987-a5a3-fcbdaeb0851a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085ffb03-ee')
Nov 29 06:17:41 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Deleting instance files /opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3_del
Nov 29 06:17:41 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Deletion of /opt/stack/data/nova/instances/29c870eb-05fb-42a0-a60b-1c8b969475a3_del complete
Nov 29 06:17:41 user nova-compute[75083]: INFO nova.compute.manager [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 06:17:41 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:17:41 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:17:41 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:17:41 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:17:41 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Took 0.51 seconds to deallocate network for instance.
Nov 29 06:17:41 user nova-compute[75083]: DEBUG nova.compute.manager [req-d03ba668-4234-4c69-bd2a-b2c538c014de req-c13c79fc-98fd-49c9-8d15-6d4e6039f29e service nova] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Received event network-vif-deleted-085ffb03-ee8f-4e4e-b2b0-7031941871fc {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:17:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:17:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:17:41 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:17:41 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:17:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:17:41 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Deleted allocations for instance 29c870eb-05fb-42a0-a60b-1c8b969475a3
Nov 29 06:17:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-5f201fd1-9abd-4542-88ed-d94edbd667a2 tempest-VolumesActionsTest-200283495 tempest-VolumesActionsTest-200283495-project-member] Lock "29c870eb-05fb-42a0-a60b-1c8b969475a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.793s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:17:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-c5da1f95-47de-4523-beba-2cdad5a3ef7f req-48f4ca9c-9925-4535-a57a-b43d314b3223 service nova] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Received event network-vif-plugged-085ffb03-ee8f-4e4e-b2b0-7031941871fc {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:17:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c5da1f95-47de-4523-beba-2cdad5a3ef7f req-48f4ca9c-9925-4535-a57a-b43d314b3223 service nova] Acquiring lock "29c870eb-05fb-42a0-a60b-1c8b969475a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:17:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c5da1f95-47de-4523-beba-2cdad5a3ef7f req-48f4ca9c-9925-4535-a57a-b43d314b3223 service nova] Lock "29c870eb-05fb-42a0-a60b-1c8b969475a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:17:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c5da1f95-47de-4523-beba-2cdad5a3ef7f req-48f4ca9c-9925-4535-a57a-b43d314b3223 service nova] Lock "29c870eb-05fb-42a0-a60b-1c8b969475a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:17:42 user nova-compute[75083]: DEBUG nova.compute.manager [req-c5da1f95-47de-4523-beba-2cdad5a3ef7f req-48f4ca9c-9925-4535-a57a-b43d314b3223 service nova] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] No waiting events found dispatching network-vif-plugged-085ffb03-ee8f-4e4e-b2b0-7031941871fc {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:17:42 user nova-compute[75083]: WARNING nova.compute.manager [req-c5da1f95-47de-4523-beba-2cdad5a3ef7f req-48f4ca9c-9925-4535-a57a-b43d314b3223 service nova] [instance: 29c870eb-05fb-42a0-a60b-1c8b969475a3] Received unexpected event network-vif-plugged-085ffb03-ee8f-4e4e-b2b0-7031941871fc for instance with vm_state deleted and task_state None.
Nov 29 06:17:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:17:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:17:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:18:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:18:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:18:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:18:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:18:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:18:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:18:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:22 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:18:22 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:18:22 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:18:24 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:18:24 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:18:24 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:18:25 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:18:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "fea64bdc-491c-46ba-9447-c175df432deb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:18:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "fea64bdc-491c-46ba-9447-c175df432deb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:18:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "fea64bdc-491c-46ba-9447-c175df432deb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:18:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:18:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:18:25 user nova-compute[75083]: INFO nova.compute.manager [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Terminating instance
Nov 29 06:18:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-e8238f2e-08fa-4089-98d2-0dce648af0e4 req-5236a536-01fe-4b40-b2fb-e5f575ff7298 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received event network-vif-unplugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e8238f2e-08fa-4089-98d2-0dce648af0e4 req-5236a536-01fe-4b40-b2fb-e5f575ff7298 service nova] Acquiring lock "fea64bdc-491c-46ba-9447-c175df432deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e8238f2e-08fa-4089-98d2-0dce648af0e4 req-5236a536-01fe-4b40-b2fb-e5f575ff7298 service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e8238f2e-08fa-4089-98d2-0dce648af0e4 req-5236a536-01fe-4b40-b2fb-e5f575ff7298 service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-e8238f2e-08fa-4089-98d2-0dce648af0e4 req-5236a536-01fe-4b40-b2fb-e5f575ff7298 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] No waiting events found dispatching network-vif-unplugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-e8238f2e-08fa-4089-98d2-0dce648af0e4 req-5236a536-01fe-4b40-b2fb-e5f575ff7298 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received event network-vif-unplugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:18:26 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Instance destroyed successfully.
Nov 29 06:18:26 user nova-compute[75083]: DEBUG nova.objects.instance [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'resources' on Instance uuid fea64bdc-491c-46ba-9447-c175df432deb {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:02:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-147873442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-147873442',id=33,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:04:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47694ecf400b4d6c952d0c06d0764d1b',ramdisk_id='',reservation_id='r-0gk2qpfk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:06:26Z,user_data=None,user_id='4145bf5a07ea4d398f1a1e10a976c10f',uuid=fea64bdc-491c-46ba-9447-c175df432deb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "address": "fa:16:3e:e1:f6:16", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feebf60-26", "ovs_interfaceid": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converting VIF {"id": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "address": "fa:16:3e:e1:f6:16", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feebf60-26", "ovs_interfaceid": "1feebf60-26a4-4a1b-8978-cf8ea1bcf912", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:f6:16,bridge_name='br-int',has_traffic_filtering=True,id=1feebf60-26a4-4a1b-8978-cf8ea1bcf912,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1feebf60-26') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG os_vif [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:f6:16,bridge_name='br-int',has_traffic_filtering=True,id=1feebf60-26a4-4a1b-8978-cf8ea1bcf912,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1feebf60-26') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1feebf60-26, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0139492-4934-4e98-8b1f-7b324728ceec) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:18:26 user nova-compute[75083]: INFO os_vif [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:f6:16,bridge_name='br-int',has_traffic_filtering=True,id=1feebf60-26a4-4a1b-8978-cf8ea1bcf912,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1feebf60-26')
Nov 29 06:18:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sujkGoES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:18:26 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:18:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f29e57b-7778-4066-80a0-5a3a119d1895]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:18:26 user nova-compute[75083]: No targets found.
Nov 29 06:18:26 user nova-compute[75083]: iSNS:
Nov 29 06:18:26 user nova-compute[75083]: No targets found.
Nov 29 06:18:26 user nova-compute[75083]: STATIC:
Nov 29 06:18:26 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856
Nov 29 06:18:26 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:18:26 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:18:26 user nova-compute[75083]: FIRMWARE:
Nov 29 06:18:26 user nova-compute[75083]: No targets found.
Nov 29 06:18:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:18:26 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:18:26 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5724c2f-a674-4b5e-82e8-005cb0521cb3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3307348d-565b-4243-890d-336bf11a226f]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:18:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 (non-flash)
Nov 29 06:18:26 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b84829e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856'): ({'sdd'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Removing single pathed devices sdd {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df3f2d1-b6ba-4a97-ba61-2cb4e62be64d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff2fece-9671-4afe-adcd-a18b411dcbdc]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Flushing IO for device /dev/sdd {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa906e5-8d67-4a56-82b2-6843a1058e2c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3548ea97-2e80-42cb-ab2f-6a5f87487d9b]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] SCSI volumes sdd have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:18:26 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3d9843-ec3a-45b9-a151-489eb1774b55]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:18:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cb5fa4-8bc9-4472-98d7-51e79bee72b0]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856, portal: 172.16.0.220,3260]
Nov 29 06:18:27 user nova-compute[75083]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856, portal: 172.16.0.220,3260] successful.
Nov 29 06:18:27 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:18:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aca32e-a3bc-4ea5-bb3a-33ac7beec856 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d893bc68-8f40-4d08-921e-b877f6e68be6]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:18:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:18:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] <== disconnect_volume: return (306ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:18:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:18:27 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Deleting instance files /opt/stack/data/nova/instances/fea64bdc-491c-46ba-9447-c175df432deb_del
Nov 29 06:18:27 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Deletion of /opt/stack/data/nova/instances/fea64bdc-491c-46ba-9447-c175df432deb_del complete
Nov 29 06:18:27 user nova-compute[75083]: INFO nova.compute.manager [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 29 06:18:27 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:18:27 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:18:27 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: fea64bdc-491c-46ba-9447-c175df432deb] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:18:27 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:18:27 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Took 0.45 seconds to deallocate network for instance.
Nov 29 06:18:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-363d6439-ed36-4f0d-8d89-8b1c30adc578 req-aca7bbe1-0043-4d83-ae93-3ee69c70f5e8 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received event network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:18:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-363d6439-ed36-4f0d-8d89-8b1c30adc578 req-aca7bbe1-0043-4d83-ae93-3ee69c70f5e8 service nova] Acquiring lock "fea64bdc-491c-46ba-9447-c175df432deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:18:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-363d6439-ed36-4f0d-8d89-8b1c30adc578 req-aca7bbe1-0043-4d83-ae93-3ee69c70f5e8 service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:18:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-363d6439-ed36-4f0d-8d89-8b1c30adc578 req-aca7bbe1-0043-4d83-ae93-3ee69c70f5e8 service nova] Lock "fea64bdc-491c-46ba-9447-c175df432deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:18:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-363d6439-ed36-4f0d-8d89-8b1c30adc578 req-aca7bbe1-0043-4d83-ae93-3ee69c70f5e8 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] No waiting events found dispatching network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:18:28 user nova-compute[75083]: WARNING nova.compute.manager [req-363d6439-ed36-4f0d-8d89-8b1c30adc578 req-aca7bbe1-0043-4d83-ae93-3ee69c70f5e8 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received unexpected event network-vif-plugged-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 for instance with vm_state active and task_state deleting.
Nov 29 06:18:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-363d6439-ed36-4f0d-8d89-8b1c30adc578 req-aca7bbe1-0043-4d83-ae93-3ee69c70f5e8 service nova] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Received event network-vif-deleted-1feebf60-26a4-4a1b-8978-cf8ea1bcf912 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:18:28 user nova-compute[75083]: INFO nova.compute.manager [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: fea64bdc-491c-46ba-9447-c175df432deb] Took 0.88 seconds to detach 1 volumes for instance.
Nov 29 06:18:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:18:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:18:28 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:18:28 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:18:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:18:28 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Deleted allocations for instance fea64bdc-491c-46ba-9447-c175df432deb
Nov 29 06:18:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f2f10d81-d247-416d-a51c-9dfc9c2cea62 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "fea64bdc-491c-46ba-9447-c175df432deb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.868s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:18:29 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:18:29 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:18:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-5277c58c-3078-44ba-85b3-2b4b7e16b760" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:18:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-5277c58c-3078-44ba-85b3-2b4b7e16b760" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:18:29 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:18:30 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Updating instance_info_cache with network_info: [{"id": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "address": "fa:16:3e:0e:0a:1d", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373b7d49-10", "ovs_interfaceid": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:18:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-5277c58c-3078-44ba-85b3-2b4b7e16b760" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:18:30 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:18:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:32 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:18:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:18:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:18:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:18:32 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:18:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:32 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:34 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:18:34 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:18:34 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8715MB free_disk=24.872886657714844GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:18:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:18:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:18:34 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:18:34 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 5277c58c-3078-44ba-85b3-2b4b7e16b760 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:18:34 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance bedd2db3-7195-4f52-bd1c-d4391a6a9e3d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:18:34 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:18:34 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:18:34 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:18:34 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:18:34 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:18:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:18:35 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:18:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:18:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-82e6856f-0cfd-40ed-8a18-6f30060f9668 req-5e4d878a-89c3-4cbb-b822-7f2df830e88b service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Received event network-changed-e3a2e9c5-344c-43b8-8ab4-652f2f041e93 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:18:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-82e6856f-0cfd-40ed-8a18-6f30060f9668 req-5e4d878a-89c3-4cbb-b822-7f2df830e88b service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Refreshing instance network info cache due to event network-changed-e3a2e9c5-344c-43b8-8ab4-652f2f041e93. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:18:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-82e6856f-0cfd-40ed-8a18-6f30060f9668 req-5e4d878a-89c3-4cbb-b822-7f2df830e88b service nova] Acquiring lock "refresh_cache-bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:18:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-82e6856f-0cfd-40ed-8a18-6f30060f9668 req-5e4d878a-89c3-4cbb-b822-7f2df830e88b service nova] Acquired lock "refresh_cache-bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:18:45 user nova-compute[75083]: DEBUG nova.network.neutron [req-82e6856f-0cfd-40ed-8a18-6f30060f9668 req-5e4d878a-89c3-4cbb-b822-7f2df830e88b service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Refreshing network info cache for port e3a2e9c5-344c-43b8-8ab4-652f2f041e93 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG nova.network.neutron [req-82e6856f-0cfd-40ed-8a18-6f30060f9668 req-5e4d878a-89c3-4cbb-b822-7f2df830e88b service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Updated VIF entry in instance network info cache for port e3a2e9c5-344c-43b8-8ab4-652f2f041e93. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG nova.network.neutron [req-82e6856f-0cfd-40ed-8a18-6f30060f9668 req-5e4d878a-89c3-4cbb-b822-7f2df830e88b service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Updating instance_info_cache with network_info: [{"id": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "address": "fa:16:3e:21:db:e3", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a2e9c5-34", "ovs_interfaceid": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-82e6856f-0cfd-40ed-8a18-6f30060f9668 req-5e4d878a-89c3-4cbb-b822-7f2df830e88b service nova] Releasing lock "refresh_cache-bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG nova.objects.instance [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lazy-loading 'flavor' on Instance uuid bedd2db3-7195-4f52-bd1c-d4391a6a9e3d {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:18:46 user nova-compute[75083]: INFO nova.compute.manager [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Attaching volume df2dcb7b-9684-4f26-a688-df6271c6c5ce to /dev/vdb
Nov 29 06:18:46 user nova-compute[75083]: DEBUG os_brick.utils [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc540ba-0cef-4146-aacc-d3fa910f4455]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec17dae-ef83-4725-9713-ddeb7ca42b24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a7a13e-0a04-49cd-91dc-7688b5a69b7e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0a1bc0-413a-422e-86da-ab53b13e49a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:18:46 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:18:46 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[736e766f-92f3-4362-8258-89ccc38f24c2]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG os_brick.utils [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Updating existing volume attachment record: 56a5596e-608f-4fb6-8ddd-68c5bb7b03f7 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWZBzqST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:18:53 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:18:53 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:18:53 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a613736-f653-4c57-8ad9-abbe504bbef3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:18:53 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afffa67-88d6-4421-b2de-2a6dbe6990f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce] added
Nov 29 06:18:53 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6c90d4-df13-4e95-8b8e-809ed73b7567]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba072fa1-23aa-455c-ba60-82264e48bf9c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWZBzqST {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWZBzqST" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef54ca81-1681-4120-bb16-af71f285d2ca]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rWZBzqST'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2132ce2a-2822-4f44-818e-118af3733c26]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfa19d5-1731-450d-b870-8a792edd965f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 06:18:53 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 06:18:53 user nova-compute[75083]:  {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:18:53 user nova-compute[75083]: WARNING os_brick.initiator.connectors.iscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 06:18:53 user nova-compute[75083]: 
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[92eae701-4dd1-4dbf-80c7-72c0776bdfb9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce, portal: 172.16.0.220,3260]
Nov 29 06:18:53 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce, portal: 172.16.0.220,3260] successful.
Nov 29 06:18:53 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[082e0b09-a1f1-46f0-bc2f-fc60da62c0b4]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcd1ded-a32e-426e-bc99-26567c1a28cc]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce (non-flash)
Nov 29 06:18:53 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce (non-flash)
Nov 29 06:18:53 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[09114829-a82d-4ad9-931d-7ccccabdd6da]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:18:53 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWZBzqST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:18:54 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:18:54 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26666313863366166', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:18:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666313863366166', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:18:54 user nova-compute[75083]: DEBUG nova.objects.instance [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lazy-loading 'flavor' on Instance uuid bedd2db3-7195-4f52-bd1c-d4391a6a9e3d {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:18:54 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 06:18:54 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:18:54 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:18:54 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:18:54 user nova-compute[75083]:   <serial>df2dcb7b-9684-4f26-a688-df6271c6c5ce</serial>
Nov 29 06:18:54 user nova-compute[75083]: </disk>
Nov 29 06:18:54 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 06:18:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:18:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:18:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] No VIF found with MAC fa:16:3e:21:db:e3, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:18:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6d1f9808-19fc-4032-a001-150296c0eeba tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.023s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:18:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:18:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:18:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:18:57 user nova-compute[75083]: INFO nova.compute.manager [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Detaching volume df2dcb7b-9684-4f26-a688-df6271c6c5ce
Nov 29 06:18:57 user nova-compute[75083]: INFO nova.virt.block_device [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Attempting to driver detach volume df2dcb7b-9684-4f26-a688-df6271c6c5ce from mountpoint /dev/vdb
Nov 29 06:18:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Attempting to detach device vdb from instance bedd2db3-7195-4f52-bd1c-d4391a6a9e3d from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 06:18:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:18:57 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:18:57 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:18:57 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:18:57 user nova-compute[75083]:   <serial>df2dcb7b-9684-4f26-a688-df6271c6c5ce</serial>
Nov 29 06:18:57 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:18:57 user nova-compute[75083]: </disk>
Nov 29 06:18:57 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:18:57 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Successfully detached device vdb from instance bedd2db3-7195-4f52-bd1c-d4391a6a9e3d from the persistent domain config.
Nov 29 06:18:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bedd2db3-7195-4f52-bd1c-d4391a6a9e3d from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 06:18:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:18:57 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:18:57 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:18:57 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:18:57 user nova-compute[75083]:   <serial>df2dcb7b-9684-4f26-a688-df6271c6c5ce</serial>
Nov 29 06:18:57 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:18:57 user nova-compute[75083]: </disk>
Nov 29 06:18:57 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:18:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bedd2db3-7195-4f52-bd1c-d4391a6a9e3d {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 06:19:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:19:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:19:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:19:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:19:16 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:19:16 user nova-compute[75083]: INFO nova.compute.manager [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Terminating instance
Nov 29 06:19:16 user nova-compute[75083]: DEBUG nova.compute.manager [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:19:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG nova.compute.manager [req-89e54d67-f7e6-4d53-a975-ad09c153ab44 req-51e0108b-c10a-4a44-81da-83c18ecefe50 service nova] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Received event network-vif-unplugged-4cb2c35d-ef8d-47dd-b985-9d56cd1960bc {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-89e54d67-f7e6-4d53-a975-ad09c153ab44 req-51e0108b-c10a-4a44-81da-83c18ecefe50 service nova] Acquiring lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-89e54d67-f7e6-4d53-a975-ad09c153ab44 req-51e0108b-c10a-4a44-81da-83c18ecefe50 service nova] Lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-89e54d67-f7e6-4d53-a975-ad09c153ab44 req-51e0108b-c10a-4a44-81da-83c18ecefe50 service nova] Lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG nova.compute.manager [req-89e54d67-f7e6-4d53-a975-ad09c153ab44 req-51e0108b-c10a-4a44-81da-83c18ecefe50 service nova] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] No waiting events found dispatching network-vif-unplugged-4cb2c35d-ef8d-47dd-b985-9d56cd1960bc {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG nova.compute.manager [req-89e54d67-f7e6-4d53-a975-ad09c153ab44 req-51e0108b-c10a-4a44-81da-83c18ecefe50 service nova] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Received event network-vif-unplugged-4cb2c35d-ef8d-47dd-b985-9d56cd1960bc for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:19:17 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Instance destroyed successfully.
Nov 29 06:19:17 user nova-compute[75083]: DEBUG nova.objects.instance [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lazy-loading 'resources' on Instance uuid b57a4494-f14e-4cac-8d0b-c0a4416b0bb5 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T05:59:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1553528728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1553528728',id=28,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T05:59:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47694ecf400b4d6c952d0c06d0764d1b',ramdisk_id='',reservation_id='r-0x1qk8kw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:01:36Z,user_data=None,user_id='4145bf5a07ea4d398f1a1e10a976c10f',uuid=b57a4494-f14e-4cac-8d0b-c0a4416b0bb5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "address": "fa:16:3e:8a:f0:ed", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb2c35d-ef", "ovs_interfaceid": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converting VIF {"id": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "address": "fa:16:3e:8a:f0:ed", "network": {"id": "fb58a10c-57db-4a4c-972e-18ad8e39d0e1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-672806759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47694ecf400b4d6c952d0c06d0764d1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb2c35d-ef", "ovs_interfaceid": "4cb2c35d-ef8d-47dd-b985-9d56cd1960bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:f0:ed,bridge_name='br-int',has_traffic_filtering=True,id=4cb2c35d-ef8d-47dd-b985-9d56cd1960bc,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb2c35d-ef') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG os_vif [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:f0:ed,bridge_name='br-int',has_traffic_filtering=True,id=4cb2c35d-ef8d-47dd-b985-9d56cd1960bc,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb2c35d-ef') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cb2c35d-ef, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b72f050b-4a39-4b89-a49e-1fd5b10fb122) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:19:17 user nova-compute[75083]: INFO os_vif [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:f0:ed,bridge_name='br-int',has_traffic_filtering=True,id=4cb2c35d-ef8d-47dd-b985-9d56cd1960bc,network=Network(fb58a10c-57db-4a4c-972e-18ad8e39d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb2c35d-ef')
Nov 29 06:19:17 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Deleting instance files /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5_del
Nov 29 06:19:17 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Deletion of /opt/stack/data/nova/instances/b57a4494-f14e-4cac-8d0b-c0a4416b0bb5_del complete
Nov 29 06:19:17 user nova-compute[75083]: INFO nova.compute.manager [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:19:17 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bedd2db3-7195-4f52-bd1c-d4391a6a9e3d is timed out.
Nov 29 06:19:17 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Successfully detached device vdb from instance bedd2db3-7195-4f52-bd1c-d4391a6a9e3d from the live domain config.
Nov 29 06:19:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWZBzqST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:19:17 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:19:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[179a1369-1d7d-461a-b8d3-ad1432713f35]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:19:17 user nova-compute[75083]: No targets found.
Nov 29 06:19:17 user nova-compute[75083]: iSNS:
Nov 29 06:19:17 user nova-compute[75083]: No targets found.
Nov 29 06:19:17 user nova-compute[75083]: STATIC:
Nov 29 06:19:17 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce
Nov 29 06:19:17 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:19:17 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:19:17 user nova-compute[75083]: FIRMWARE:
Nov 29 06:19:17 user nova-compute[75083]: No targets found.
Nov 29 06:19:17 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:19:17 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:19:17 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8766a7-cf3d-4cef-af98-ae13244e33dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a444577-cb37-465c-82da-35f587db8f68]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce (non-flash)
Nov 29 06:19:17 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce (non-flash)
Nov 29 06:19:17 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b817e9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08ac2b5-d739-4af6-bcb4-69ebc1e4a273]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cda53a-9b28-47b0-9dd2-bba0d9363c9b]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[034e4ae3-7679-4f97-b248-c45a4411eb7d]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d906ee8a-c4d7-4adb-a244-f057ee283633]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f581fd78-fbc2-4f59-90af-35561682496c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:19:17 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:19:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:19:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e30def9-352b-44da-b0f0-8a8ec548a035]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:19:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce, portal: 172.16.0.220,3260]
Nov 29 06:19:18 user nova-compute[75083]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce, portal: 172.16.0.220,3260] successful.
Nov 29 06:19:18 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:19:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:19:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2dcb7b-9684-4f26-a688-df6271c6c5ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:19:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f47ab87-5711-4e85-a7d9-4526f333a24a]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:19:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:19:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:19:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] <== disconnect_volume: return (280ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:19:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:19:18 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:19:18 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Took 0.48 seconds to deallocate network for instance.
Nov 29 06:19:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:19:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:19:18 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:19:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-39feb840-f546-4748-9dda-965c21c86f40 req-1aab13e5-ac93-4720-a70c-c74d04e11103 service nova] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Received event network-vif-deleted-4cb2c35d-ef8d-47dd-b985-9d56cd1960bc {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:19:18 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:19:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:19:18 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Deleted allocations for instance b57a4494-f14e-4cac-8d0b-c0a4416b0bb5
Nov 29 06:19:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c4accc53-3fa2-4a49-b9a3-8b93208f5904 tempest-ServerBootFromVolumeStableRescueTest-1530350051 tempest-ServerBootFromVolumeStableRescueTest-1530350051-project-member] Lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.757s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:19:18 user nova-compute[75083]: DEBUG nova.objects.instance [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lazy-loading 'flavor' on Instance uuid bedd2db3-7195-4f52-bd1c-d4391a6a9e3d {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:19:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-1d4fb8b7-c103-4053-806a-72086a683ae2 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.628s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:19:19 user nova-compute[75083]: DEBUG nova.compute.manager [req-402aa0f6-f015-4d83-9ba3-53ba2301a58e req-8a5351cd-d5fc-4e4b-93ed-cd011684fa84 service nova] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Received event network-vif-plugged-4cb2c35d-ef8d-47dd-b985-9d56cd1960bc {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:19:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-402aa0f6-f015-4d83-9ba3-53ba2301a58e req-8a5351cd-d5fc-4e4b-93ed-cd011684fa84 service nova] Acquiring lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:19:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-402aa0f6-f015-4d83-9ba3-53ba2301a58e req-8a5351cd-d5fc-4e4b-93ed-cd011684fa84 service nova] Lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:19:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-402aa0f6-f015-4d83-9ba3-53ba2301a58e req-8a5351cd-d5fc-4e4b-93ed-cd011684fa84 service nova] Lock "b57a4494-f14e-4cac-8d0b-c0a4416b0bb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:19:19 user nova-compute[75083]: DEBUG nova.compute.manager [req-402aa0f6-f015-4d83-9ba3-53ba2301a58e req-8a5351cd-d5fc-4e4b-93ed-cd011684fa84 service nova] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] No waiting events found dispatching network-vif-plugged-4cb2c35d-ef8d-47dd-b985-9d56cd1960bc {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:19:19 user nova-compute[75083]: WARNING nova.compute.manager [req-402aa0f6-f015-4d83-9ba3-53ba2301a58e req-8a5351cd-d5fc-4e4b-93ed-cd011684fa84 service nova] [instance: b57a4494-f14e-4cac-8d0b-c0a4416b0bb5] Received unexpected event network-vif-plugged-4cb2c35d-ef8d-47dd-b985-9d56cd1960bc for instance with vm_state deleted and task_state None.
Nov 29 06:19:22 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:19:22 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:19:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:24 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:19:24 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:19:25 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:19:26 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:19:27 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:19:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:19:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:19:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:19:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:19:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:29 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:19:29 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:19:29 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:19:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-5277c58c-3078-44ba-85b3-2b4b7e16b760" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:19:29 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-5277c58c-3078-44ba-85b3-2b4b7e16b760" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:19:29 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:19:29 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lazy-loading 'info_cache' on Instance uuid 5277c58c-3078-44ba-85b3-2b4b7e16b760 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:19:30 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Updating instance_info_cache with network_info: [{"id": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "address": "fa:16:3e:0e:0a:1d", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373b7d49-10", "ovs_interfaceid": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:19:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-5277c58c-3078-44ba-85b3-2b4b7e16b760" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:19:30 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:19:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:34 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:19:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:19:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:19:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:19:34 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:19:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:19:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:19:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:19:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:19:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:19:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:19:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:19:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:19:35 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:19:35 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:19:35 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8877MB free_disk=24.99551773071289GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:19:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:19:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:19:35 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 5277c58c-3078-44ba-85b3-2b4b7e16b760 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:19:35 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance bedd2db3-7195-4f52-bd1c-d4391a6a9e3d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:19:35 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:19:35 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:19:36 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:19:36 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:19:36 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:19:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:19:37 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:19:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:19:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:19:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:19:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:19:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:19:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:19:48 user nova-compute[75083]: INFO nova.compute.manager [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Terminating instance
Nov 29 06:19:48 user nova-compute[75083]: DEBUG nova.compute.manager [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG nova.compute.manager [req-775a6d60-430c-45dc-be40-a7f6a5f2c293 req-89a93190-50f9-4de4-bd07-9931c8c91470 service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Received event network-changed-e3a2e9c5-344c-43b8-8ab4-652f2f041e93 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG nova.compute.manager [req-775a6d60-430c-45dc-be40-a7f6a5f2c293 req-89a93190-50f9-4de4-bd07-9931c8c91470 service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Refreshing instance network info cache due to event network-changed-e3a2e9c5-344c-43b8-8ab4-652f2f041e93. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-775a6d60-430c-45dc-be40-a7f6a5f2c293 req-89a93190-50f9-4de4-bd07-9931c8c91470 service nova] Acquiring lock "refresh_cache-bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-775a6d60-430c-45dc-be40-a7f6a5f2c293 req-89a93190-50f9-4de4-bd07-9931c8c91470 service nova] Acquired lock "refresh_cache-bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG nova.network.neutron [req-775a6d60-430c-45dc-be40-a7f6a5f2c293 req-89a93190-50f9-4de4-bd07-9931c8c91470 service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Refreshing network info cache for port e3a2e9c5-344c-43b8-8ab4-652f2f041e93 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG nova.network.neutron [req-775a6d60-430c-45dc-be40-a7f6a5f2c293 req-89a93190-50f9-4de4-bd07-9931c8c91470 service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Updated VIF entry in instance network info cache for port e3a2e9c5-344c-43b8-8ab4-652f2f041e93. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG nova.network.neutron [req-775a6d60-430c-45dc-be40-a7f6a5f2c293 req-89a93190-50f9-4de4-bd07-9931c8c91470 service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Updating instance_info_cache with network_info: [{"id": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "address": "fa:16:3e:21:db:e3", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a2e9c5-34", "ovs_interfaceid": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-775a6d60-430c-45dc-be40-a7f6a5f2c293 req-89a93190-50f9-4de4-bd07-9931c8c91470 service nova] Releasing lock "refresh_cache-bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:19:48 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Instance destroyed successfully.
Nov 29 06:19:48 user nova-compute[75083]: DEBUG nova.objects.instance [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lazy-loading 'resources' on Instance uuid bedd2db3-7195-4f52-bd1c-d4391a6a9e3d {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-996900115',display_name='tempest-TestStampPattern-server-996900115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-996900115',id=44,image_ref='a7cf426b-1ad7-4fc9-a67d-aa118755c328',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0r9XpGMZ9H/Y4I/0x8bzbOcE6fHNK54Wz8ou6+Qs3mulslzYO8Mrt2NyEGfqnGboyoLwXwwDgzi9WtBLtWKKBOjYUhnhNK5lWoSf+vBunDq+fymy+tZb2F3uviDT9Mjg==',key_name='tempest-TestStampPattern-774953284',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:17:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b12e29dfdde4ed4b8a9f17ea146509e',ramdisk_id='',reservation_id='r-aa70ifrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5277c58c-3078-44ba-85b3-2b4b7e16b760',image_min_disk='1',image_min_ram='0',image_owner_id='4b12e29dfdde4ed4b8a9f17ea146509e',image_owner_project_name='tempest-TestStampPattern-1336384366',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1336384366-project-member',image_user_id='131cbc1c58fb486eb2ba0740ecfaa7a9',owner_project_name='tempest-TestStampPattern-1336384366',owner_user_name='tempest-TestStampPattern-1336384366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:17:01Z,user_data=None,user_id='131cbc1c58fb486eb2ba0740ecfaa7a9',uuid=bedd2db3-7195-4f52-bd1c-d4391a6a9e3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "address": "fa:16:3e:21:db:e3", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a2e9c5-34", "ovs_interfaceid": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Converting VIF {"id": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "address": "fa:16:3e:21:db:e3", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a2e9c5-34", "ovs_interfaceid": "e3a2e9c5-344c-43b8-8ab4-652f2f041e93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:db:e3,bridge_name='br-int',has_traffic_filtering=True,id=e3a2e9c5-344c-43b8-8ab4-652f2f041e93,network=Network(6a21050c-13c7-40b5-a1c5-f93ddc74e7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a2e9c5-34') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG os_vif [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:db:e3,bridge_name='br-int',has_traffic_filtering=True,id=e3a2e9c5-344c-43b8-8ab4-652f2f041e93,network=Network(6a21050c-13c7-40b5-a1c5-f93ddc74e7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a2e9c5-34') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3a2e9c5-34, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be903d27-eca7-4b89-b521-7a4024943813) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:19:48 user nova-compute[75083]: INFO os_vif [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:db:e3,bridge_name='br-int',has_traffic_filtering=True,id=e3a2e9c5-344c-43b8-8ab4-652f2f041e93,network=Network(6a21050c-13c7-40b5-a1c5-f93ddc74e7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a2e9c5-34')
Nov 29 06:19:48 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Deleting instance files /opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d_del
Nov 29 06:19:48 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Deletion of /opt/stack/data/nova/instances/bedd2db3-7195-4f52-bd1c-d4391a6a9e3d_del complete
Nov 29 06:19:49 user nova-compute[75083]: INFO nova.compute.manager [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 29 06:19:49 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:19:49 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:19:49 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:19:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:49 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:19:49 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Took 0.49 seconds to deallocate network for instance.
Nov 29 06:19:49 user nova-compute[75083]: DEBUG nova.compute.manager [req-d4055a35-e7e6-46b6-8564-b8d6ae16c705 req-f19c16a2-a4fb-41ad-8fde-c0d4d8728ca5 service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Received event network-vif-deleted-e3a2e9c5-344c-43b8-8ab4-652f2f041e93 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:19:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:19:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:19:49 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:19:49 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:19:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:19:49 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Deleted allocations for instance bedd2db3-7195-4f52-bd1c-d4391a6a9e3d
Nov 29 06:19:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-10a97649-ee4a-4fd8-beea-6ff48fb635d5 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.646s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:19:50 user nova-compute[75083]: DEBUG nova.compute.manager [req-12e44cbe-4f14-40f2-8a5c-59443c4c5d17 req-e295315f-a316-403d-91fa-0b56d01f7fcc service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Received event network-vif-unplugged-e3a2e9c5-344c-43b8-8ab4-652f2f041e93 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:19:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-12e44cbe-4f14-40f2-8a5c-59443c4c5d17 req-e295315f-a316-403d-91fa-0b56d01f7fcc service nova] Acquiring lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:19:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-12e44cbe-4f14-40f2-8a5c-59443c4c5d17 req-e295315f-a316-403d-91fa-0b56d01f7fcc service nova] Lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:19:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-12e44cbe-4f14-40f2-8a5c-59443c4c5d17 req-e295315f-a316-403d-91fa-0b56d01f7fcc service nova] Lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:19:50 user nova-compute[75083]: DEBUG nova.compute.manager [req-12e44cbe-4f14-40f2-8a5c-59443c4c5d17 req-e295315f-a316-403d-91fa-0b56d01f7fcc service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] No waiting events found dispatching network-vif-unplugged-e3a2e9c5-344c-43b8-8ab4-652f2f041e93 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:19:50 user nova-compute[75083]: WARNING nova.compute.manager [req-12e44cbe-4f14-40f2-8a5c-59443c4c5d17 req-e295315f-a316-403d-91fa-0b56d01f7fcc service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Received unexpected event network-vif-unplugged-e3a2e9c5-344c-43b8-8ab4-652f2f041e93 for instance with vm_state deleted and task_state None.
Nov 29 06:19:50 user nova-compute[75083]: DEBUG nova.compute.manager [req-12e44cbe-4f14-40f2-8a5c-59443c4c5d17 req-e295315f-a316-403d-91fa-0b56d01f7fcc service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Received event network-vif-plugged-e3a2e9c5-344c-43b8-8ab4-652f2f041e93 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:19:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-12e44cbe-4f14-40f2-8a5c-59443c4c5d17 req-e295315f-a316-403d-91fa-0b56d01f7fcc service nova] Acquiring lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:19:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-12e44cbe-4f14-40f2-8a5c-59443c4c5d17 req-e295315f-a316-403d-91fa-0b56d01f7fcc service nova] Lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:19:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-12e44cbe-4f14-40f2-8a5c-59443c4c5d17 req-e295315f-a316-403d-91fa-0b56d01f7fcc service nova] Lock "bedd2db3-7195-4f52-bd1c-d4391a6a9e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:19:50 user nova-compute[75083]: DEBUG nova.compute.manager [req-12e44cbe-4f14-40f2-8a5c-59443c4c5d17 req-e295315f-a316-403d-91fa-0b56d01f7fcc service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] No waiting events found dispatching network-vif-plugged-e3a2e9c5-344c-43b8-8ab4-652f2f041e93 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:19:50 user nova-compute[75083]: WARNING nova.compute.manager [req-12e44cbe-4f14-40f2-8a5c-59443c4c5d17 req-e295315f-a316-403d-91fa-0b56d01f7fcc service nova] [instance: bedd2db3-7195-4f52-bd1c-d4391a6a9e3d] Received unexpected event network-vif-plugged-e3a2e9c5-344c-43b8-8ab4-652f2f041e93 for instance with vm_state deleted and task_state None.
Nov 29 06:19:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:19:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:20:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:20:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:20:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:20:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:20:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:20:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:20:24 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:20:24 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:20:24 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:20:26 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:20:26 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:20:28 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:20:28 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:20:28 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:20:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:20:30 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:20:30 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:20:30 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 06:20:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:20:34 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:20:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:20:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:20:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:20:34 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:20:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:20:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:20:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:20:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:20:35 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:20:35 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:20:35 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8974MB free_disk=24.99517059326172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:20:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:20:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:20:35 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 5277c58c-3078-44ba-85b3-2b4b7e16b760 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:20:35 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:20:35 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:20:35 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:20:35 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:20:35 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:20:35 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:20:36 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:20:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:20:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:20:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:20:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:20:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:20:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:20:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "5277c58c-3078-44ba-85b3-2b4b7e16b760" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "5277c58c-3078-44ba-85b3-2b4b7e16b760" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "5277c58c-3078-44ba-85b3-2b4b7e16b760-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "5277c58c-3078-44ba-85b3-2b4b7e16b760-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "5277c58c-3078-44ba-85b3-2b4b7e16b760-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:20:47 user nova-compute[75083]: INFO nova.compute.manager [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Terminating instance
Nov 29 06:20:47 user nova-compute[75083]: DEBUG nova.compute.manager [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG nova.compute.manager [req-d37b6837-6175-4dec-9478-13f49f98bbf3 req-4b6fbe37-c63a-4ce5-a7ea-9461bc741b9c service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Received event network-changed-373b7d49-10c9-46ca-a1e5-6a20d1712035 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG nova.compute.manager [req-d37b6837-6175-4dec-9478-13f49f98bbf3 req-4b6fbe37-c63a-4ce5-a7ea-9461bc741b9c service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Refreshing instance network info cache due to event network-changed-373b7d49-10c9-46ca-a1e5-6a20d1712035. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d37b6837-6175-4dec-9478-13f49f98bbf3 req-4b6fbe37-c63a-4ce5-a7ea-9461bc741b9c service nova] Acquiring lock "refresh_cache-5277c58c-3078-44ba-85b3-2b4b7e16b760" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d37b6837-6175-4dec-9478-13f49f98bbf3 req-4b6fbe37-c63a-4ce5-a7ea-9461bc741b9c service nova] Acquired lock "refresh_cache-5277c58c-3078-44ba-85b3-2b4b7e16b760" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG nova.network.neutron [req-d37b6837-6175-4dec-9478-13f49f98bbf3 req-4b6fbe37-c63a-4ce5-a7ea-9461bc741b9c service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Refreshing network info cache for port 373b7d49-10c9-46ca-a1e5-6a20d1712035 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG nova.compute.manager [req-e2708947-e7a8-4dab-9ba2-88b010d7735c req-f2692729-2f6f-41fb-8e07-d7688523542f service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Received event network-vif-unplugged-373b7d49-10c9-46ca-a1e5-6a20d1712035 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e2708947-e7a8-4dab-9ba2-88b010d7735c req-f2692729-2f6f-41fb-8e07-d7688523542f service nova] Acquiring lock "5277c58c-3078-44ba-85b3-2b4b7e16b760-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e2708947-e7a8-4dab-9ba2-88b010d7735c req-f2692729-2f6f-41fb-8e07-d7688523542f service nova] Lock "5277c58c-3078-44ba-85b3-2b4b7e16b760-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-e2708947-e7a8-4dab-9ba2-88b010d7735c req-f2692729-2f6f-41fb-8e07-d7688523542f service nova] Lock "5277c58c-3078-44ba-85b3-2b4b7e16b760-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG nova.compute.manager [req-e2708947-e7a8-4dab-9ba2-88b010d7735c req-f2692729-2f6f-41fb-8e07-d7688523542f service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] No waiting events found dispatching network-vif-unplugged-373b7d49-10c9-46ca-a1e5-6a20d1712035 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG nova.compute.manager [req-e2708947-e7a8-4dab-9ba2-88b010d7735c req-f2692729-2f6f-41fb-8e07-d7688523542f service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Received event network-vif-unplugged-373b7d49-10c9-46ca-a1e5-6a20d1712035 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG nova.network.neutron [req-d37b6837-6175-4dec-9478-13f49f98bbf3 req-4b6fbe37-c63a-4ce5-a7ea-9461bc741b9c service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Updated VIF entry in instance network info cache for port 373b7d49-10c9-46ca-a1e5-6a20d1712035. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG nova.network.neutron [req-d37b6837-6175-4dec-9478-13f49f98bbf3 req-4b6fbe37-c63a-4ce5-a7ea-9461bc741b9c service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Updating instance_info_cache with network_info: [{"id": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "address": "fa:16:3e:0e:0a:1d", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373b7d49-10", "ovs_interfaceid": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:20:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-d37b6837-6175-4dec-9478-13f49f98bbf3 req-4b6fbe37-c63a-4ce5-a7ea-9461bc741b9c service nova] Releasing lock "refresh_cache-5277c58c-3078-44ba-85b3-2b4b7e16b760" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:20:48 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Instance destroyed successfully.
Nov 29 06:20:48 user nova-compute[75083]: DEBUG nova.objects.instance [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lazy-loading 'resources' on Instance uuid 5277c58c-3078-44ba-85b3-2b4b7e16b760 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:20:48 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-153210734',display_name='tempest-TestStampPattern-server-153210734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-153210734',id=42,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0r9XpGMZ9H/Y4I/0x8bzbOcE6fHNK54Wz8ou6+Qs3mulslzYO8Mrt2NyEGfqnGboyoLwXwwDgzi9WtBLtWKKBOjYUhnhNK5lWoSf+vBunDq+fymy+tZb2F3uviDT9Mjg==',key_name='tempest-TestStampPattern-774953284',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b12e29dfdde4ed4b8a9f17ea146509e',ramdisk_id='',reservation_id='r-4u8tkqpt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1336384366',owner_user_name='tempest-TestStampPattern-1336384366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:16:52Z,user_data=None,user_id='131cbc1c58fb486eb2ba0740ecfaa7a9',uuid=5277c58c-3078-44ba-85b3-2b4b7e16b760,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "address": "fa:16:3e:0e:0a:1d", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373b7d49-10", "ovs_interfaceid": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:20:48 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Converting VIF {"id": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "address": "fa:16:3e:0e:0a:1d", "network": {"id": "6a21050c-13c7-40b5-a1c5-f93ddc74e7fd", "bridge": "br-int", "label": "tempest-TestStampPattern-83168856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b12e29dfdde4ed4b8a9f17ea146509e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373b7d49-10", "ovs_interfaceid": "373b7d49-10c9-46ca-a1e5-6a20d1712035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:20:48 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:0a:1d,bridge_name='br-int',has_traffic_filtering=True,id=373b7d49-10c9-46ca-a1e5-6a20d1712035,network=Network(6a21050c-13c7-40b5-a1c5-f93ddc74e7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373b7d49-10') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:20:48 user nova-compute[75083]: DEBUG os_vif [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:0a:1d,bridge_name='br-int',has_traffic_filtering=True,id=373b7d49-10c9-46ca-a1e5-6a20d1712035,network=Network(6a21050c-13c7-40b5-a1c5-f93ddc74e7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373b7d49-10') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:20:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:20:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap373b7d49-10, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:20:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:20:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:20:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7467dc3-924d-4b3a-8cf4-af48695ab205) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:20:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:20:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:20:48 user nova-compute[75083]: INFO os_vif [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:0a:1d,bridge_name='br-int',has_traffic_filtering=True,id=373b7d49-10c9-46ca-a1e5-6a20d1712035,network=Network(6a21050c-13c7-40b5-a1c5-f93ddc74e7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373b7d49-10')
Nov 29 06:20:48 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Deleting instance files /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760_del
Nov 29 06:20:48 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Deletion of /opt/stack/data/nova/instances/5277c58c-3078-44ba-85b3-2b4b7e16b760_del complete
Nov 29 06:20:48 user nova-compute[75083]: INFO nova.compute.manager [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 06:20:48 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:20:48 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:20:48 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:20:48 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:20:48 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Took 0.55 seconds to deallocate network for instance.
Nov 29 06:20:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:20:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:20:48 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:20:48 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:20:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:20:48 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Deleted allocations for instance 5277c58c-3078-44ba-85b3-2b4b7e16b760
Nov 29 06:20:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-298e13a7-96d6-431f-a4f3-133a1921d0b1 tempest-TestStampPattern-1336384366 tempest-TestStampPattern-1336384366-project-member] Lock "5277c58c-3078-44ba-85b3-2b4b7e16b760" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.792s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:20:49 user nova-compute[75083]: DEBUG nova.compute.manager [req-b512d591-86b0-4ea0-8bc7-d98b07f361ab req-b6ce4a2d-d68a-44ea-9888-a0c33c98acaa service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Received event network-vif-plugged-373b7d49-10c9-46ca-a1e5-6a20d1712035 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:20:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b512d591-86b0-4ea0-8bc7-d98b07f361ab req-b6ce4a2d-d68a-44ea-9888-a0c33c98acaa service nova] Acquiring lock "5277c58c-3078-44ba-85b3-2b4b7e16b760-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:20:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b512d591-86b0-4ea0-8bc7-d98b07f361ab req-b6ce4a2d-d68a-44ea-9888-a0c33c98acaa service nova] Lock "5277c58c-3078-44ba-85b3-2b4b7e16b760-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:20:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b512d591-86b0-4ea0-8bc7-d98b07f361ab req-b6ce4a2d-d68a-44ea-9888-a0c33c98acaa service nova] Lock "5277c58c-3078-44ba-85b3-2b4b7e16b760-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:20:49 user nova-compute[75083]: DEBUG nova.compute.manager [req-b512d591-86b0-4ea0-8bc7-d98b07f361ab req-b6ce4a2d-d68a-44ea-9888-a0c33c98acaa service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] No waiting events found dispatching network-vif-plugged-373b7d49-10c9-46ca-a1e5-6a20d1712035 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:20:49 user nova-compute[75083]: WARNING nova.compute.manager [req-b512d591-86b0-4ea0-8bc7-d98b07f361ab req-b6ce4a2d-d68a-44ea-9888-a0c33c98acaa service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Received unexpected event network-vif-plugged-373b7d49-10c9-46ca-a1e5-6a20d1712035 for instance with vm_state deleted and task_state None.
Nov 29 06:20:49 user nova-compute[75083]: DEBUG nova.compute.manager [req-b512d591-86b0-4ea0-8bc7-d98b07f361ab req-b6ce4a2d-d68a-44ea-9888-a0c33c98acaa service nova] [instance: 5277c58c-3078-44ba-85b3-2b4b7e16b760] Received event network-vif-deleted-373b7d49-10c9-46ca-a1e5-6a20d1712035 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:20:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:20:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:21:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:21:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:21:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:21:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:21:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:21:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:21:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:21:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:21:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:21:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:24 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:21:26 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:21:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:21:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:27 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:21:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:28 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:21:29 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:21:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:30 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:21:30 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:21:30 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:21:30 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 06:21:30 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:21:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:35 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:21:36 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:21:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:21:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:21:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:21:36 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:21:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:36 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:21:36 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:21:36 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=9118MB free_disk=25.110153198242188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:21:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:21:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:21:37 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:21:37 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:21:37 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:21:37 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:21:37 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:21:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:21:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:21:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:21:41 user nova-compute[75083]: DEBUG nova.compute.manager [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:21:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:21:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:21:41 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:21:41 user nova-compute[75083]: INFO nova.compute.claims [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Claim successful on node user
Nov 29 06:21:41 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:21:41 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:21:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:21:41 user nova-compute[75083]: DEBUG nova.compute.manager [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:21:41 user nova-compute[75083]: DEBUG nova.compute.manager [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:21:41 user nova-compute[75083]: DEBUG nova.network.neutron [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:21:41 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:21:41 user nova-compute[75083]: DEBUG nova.compute.manager [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG nova.compute.manager [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:21:42 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Creating image(s)
Nov 29 06:21:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "/opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "/opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "/opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG nova.policy [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '98533e90b5904b37b0cbcdd3a18cb15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ab7954dd9455f9025e026a8c0c1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.193s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.206s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/disk 1073741824" returned: 0 in 0.056s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.178s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG nova.network.neutron [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Successfully created port: 18e29088-0348-4df0-bef5-9ab2edca2d95 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Cannot resize image /opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Ensure instance console log exists: /opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:21:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.network.neutron [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Successfully updated port: 18e29088-0348-4df0-bef5-9ab2edca2d95 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "refresh_cache-dcd4711c-8e56-4e18-b4be-11b2bc81ca02" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquired lock "refresh_cache-dcd4711c-8e56-4e18-b4be-11b2bc81ca02" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.network.neutron [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-f61a0898-4469-4384-b282-43a4c6b570b2 req-a7030aa0-e7bc-477d-8ada-7990ab31938b service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Received event network-changed-18e29088-0348-4df0-bef5-9ab2edca2d95 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.compute.manager [req-f61a0898-4469-4384-b282-43a4c6b570b2 req-a7030aa0-e7bc-477d-8ada-7990ab31938b service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Refreshing instance network info cache due to event network-changed-18e29088-0348-4df0-bef5-9ab2edca2d95. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f61a0898-4469-4384-b282-43a4c6b570b2 req-a7030aa0-e7bc-477d-8ada-7990ab31938b service nova] Acquiring lock "refresh_cache-dcd4711c-8e56-4e18-b4be-11b2bc81ca02" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.network.neutron [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.network.neutron [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Updating instance_info_cache with network_info: [{"id": "18e29088-0348-4df0-bef5-9ab2edca2d95", "address": "fa:16:3e:5c:15:ba", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e29088-03", "ovs_interfaceid": "18e29088-0348-4df0-bef5-9ab2edca2d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Releasing lock "refresh_cache-dcd4711c-8e56-4e18-b4be-11b2bc81ca02" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.compute.manager [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Instance network_info: |[{"id": "18e29088-0348-4df0-bef5-9ab2edca2d95", "address": "fa:16:3e:5c:15:ba", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e29088-03", "ovs_interfaceid": "18e29088-0348-4df0-bef5-9ab2edca2d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f61a0898-4469-4384-b282-43a4c6b570b2 req-a7030aa0-e7bc-477d-8ada-7990ab31938b service nova] Acquired lock "refresh_cache-dcd4711c-8e56-4e18-b4be-11b2bc81ca02" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.network.neutron [req-f61a0898-4469-4384-b282-43a4c6b570b2 req-a7030aa0-e7bc-477d-8ada-7990ab31938b service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Refreshing network info cache for port 18e29088-0348-4df0-bef5-9ab2edca2d95 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Start _get_guest_xml network_info=[{"id": "18e29088-0348-4df0-bef5-9ab2edca2d95", "address": "fa:16:3e:5c:15:ba", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e29088-03", "ovs_interfaceid": "18e29088-0348-4df0-bef5-9ab2edca2d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:21:43 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:21:43 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-993801431',display_name='tempest-VolumesSnapshotTestJSON-instance-993801431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-993801431',id=45,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpkGNtMljSPmmT7S2kfgS63Np6mKwEbhquptY3eTZgtWTp6crQ6ppspZZa/mwwbNLH+oj1JbtSK6SG6gKayLLsriy4RWETFv3o9wzfDU1PCkQGToPUN/0nuSn1fnFgdkg==',key_name='tempest-keypair-1032064783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a77ab7954dd9455f9025e026a8c0c1f0',ramdisk_id='',reservation_id='r-iozgergl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-817468576',owner_user_name='tempest-VolumesSnapshotTestJSON-817468576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98533e90b5904b37b0cbcdd3a18cb15f',uuid=dcd4711c-8e56-4e18-b4be-11b2bc81ca02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18e29088-0348-4df0-bef5-9ab2edca2d95", "address": "fa:16:3e:5c:15:ba", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e29088-03", "ovs_interfaceid": "18e29088-0348-4df0-bef5-9ab2edca2d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Converting VIF {"id": "18e29088-0348-4df0-bef5-9ab2edca2d95", "address": "fa:16:3e:5c:15:ba", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e29088-03", "ovs_interfaceid": "18e29088-0348-4df0-bef5-9ab2edca2d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:15:ba,bridge_name='br-int',has_traffic_filtering=True,id=18e29088-0348-4df0-bef5-9ab2edca2d95,network=Network(4c20e80c-b8cc-40ab-9ae5-8c29689f494b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e29088-03') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.objects.instance [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lazy-loading 'pci_devices' on Instance uuid dcd4711c-8e56-4e18-b4be-11b2bc81ca02 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:21:43 user nova-compute[75083]:   <uuid>dcd4711c-8e56-4e18-b4be-11b2bc81ca02</uuid>
Nov 29 06:21:43 user nova-compute[75083]:   <name>instance-0000002d</name>
Nov 29 06:21:43 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:21:43 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:21:43 user nova-compute[75083]:   <metadata>
Nov 29 06:21:43 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:21:43 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:21:43 user nova-compute[75083]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-993801431</nova:name>
Nov 29 06:21:43 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:21:43</nova:creationTime>
Nov 29 06:21:43 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:21:43 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:21:43 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:21:43 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:21:43 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:21:43 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:21:43 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:21:43 user nova-compute[75083]:       <nova:owner>
Nov 29 06:21:43 user nova-compute[75083]:         <nova:user uuid="98533e90b5904b37b0cbcdd3a18cb15f">tempest-VolumesSnapshotTestJSON-817468576-project-member</nova:user>
Nov 29 06:21:43 user nova-compute[75083]:         <nova:project uuid="a77ab7954dd9455f9025e026a8c0c1f0">tempest-VolumesSnapshotTestJSON-817468576</nova:project>
Nov 29 06:21:43 user nova-compute[75083]:       </nova:owner>
Nov 29 06:21:43 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 06:21:43 user nova-compute[75083]:       <nova:ports>
Nov 29 06:21:43 user nova-compute[75083]:         <nova:port uuid="18e29088-0348-4df0-bef5-9ab2edca2d95">
Nov 29 06:21:43 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 06:21:43 user nova-compute[75083]:         </nova:port>
Nov 29 06:21:43 user nova-compute[75083]:       </nova:ports>
Nov 29 06:21:43 user nova-compute[75083]:     </nova:instance>
Nov 29 06:21:43 user nova-compute[75083]:   </metadata>
Nov 29 06:21:43 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:21:43 user nova-compute[75083]:     <system>
Nov 29 06:21:43 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:21:43 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:21:43 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:21:43 user nova-compute[75083]:       <entry name="serial">dcd4711c-8e56-4e18-b4be-11b2bc81ca02</entry>
Nov 29 06:21:43 user nova-compute[75083]:       <entry name="uuid">dcd4711c-8e56-4e18-b4be-11b2bc81ca02</entry>
Nov 29 06:21:43 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:21:43 user nova-compute[75083]:     </system>
Nov 29 06:21:43 user nova-compute[75083]:   </sysinfo>
Nov 29 06:21:43 user nova-compute[75083]:   <os>
Nov 29 06:21:43 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:21:43 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:21:43 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:21:43 user nova-compute[75083]:   </os>
Nov 29 06:21:43 user nova-compute[75083]:   <features>
Nov 29 06:21:43 user nova-compute[75083]:     <acpi/>
Nov 29 06:21:43 user nova-compute[75083]:     <apic/>
Nov 29 06:21:43 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:21:43 user nova-compute[75083]:   </features>
Nov 29 06:21:43 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:21:43 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:21:43 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:21:43 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:21:43 user nova-compute[75083]:   </clock>
Nov 29 06:21:43 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:21:43 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:21:43 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:21:43 user nova-compute[75083]:   </cpu>
Nov 29 06:21:43 user nova-compute[75083]:   <devices>
Nov 29 06:21:43 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:21:43 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:21:43 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/disk"/>
Nov 29 06:21:43 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:21:43 user nova-compute[75083]:     </disk>
Nov 29 06:21:43 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:21:43 user nova-compute[75083]:       <mac address="fa:16:3e:5c:15:ba"/>
Nov 29 06:21:43 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:21:43 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:21:43 user nova-compute[75083]:       <target dev="tap18e29088-03"/>
Nov 29 06:21:43 user nova-compute[75083]:     </interface>
Nov 29 06:21:43 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:21:43 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/console.log" append="off"/>
Nov 29 06:21:43 user nova-compute[75083]:     </serial>
Nov 29 06:21:43 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:21:43 user nova-compute[75083]:     <video>
Nov 29 06:21:43 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:21:43 user nova-compute[75083]:     </video>
Nov 29 06:21:43 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:21:43 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:21:43 user nova-compute[75083]:     </rng>
Nov 29 06:21:43 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:21:43 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:21:43 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:21:43 user nova-compute[75083]:     </memballoon>
Nov 29 06:21:43 user nova-compute[75083]:   </devices>
Nov 29 06:21:43 user nova-compute[75083]: </domain>
Nov 29 06:21:43 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-993801431',display_name='tempest-VolumesSnapshotTestJSON-instance-993801431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-993801431',id=45,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpkGNtMljSPmmT7S2kfgS63Np6mKwEbhquptY3eTZgtWTp6crQ6ppspZZa/mwwbNLH+oj1JbtSK6SG6gKayLLsriy4RWETFv3o9wzfDU1PCkQGToPUN/0nuSn1fnFgdkg==',key_name='tempest-keypair-1032064783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a77ab7954dd9455f9025e026a8c0c1f0',ramdisk_id='',reservation_id='r-iozgergl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-817468576',owner_user_name='tempest-VolumesSnapshotTestJSON-817468576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98533e90b5904b37b0cbcdd3a18cb15f',uuid=dcd4711c-8e56-4e18-b4be-11b2bc81ca02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18e29088-0348-4df0-bef5-9ab2edca2d95", "address": "fa:16:3e:5c:15:ba", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e29088-03", "ovs_interfaceid": "18e29088-0348-4df0-bef5-9ab2edca2d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Converting VIF {"id": "18e29088-0348-4df0-bef5-9ab2edca2d95", "address": "fa:16:3e:5c:15:ba", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e29088-03", "ovs_interfaceid": "18e29088-0348-4df0-bef5-9ab2edca2d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:15:ba,bridge_name='br-int',has_traffic_filtering=True,id=18e29088-0348-4df0-bef5-9ab2edca2d95,network=Network(4c20e80c-b8cc-40ab-9ae5-8c29689f494b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e29088-03') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG os_vif [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:15:ba,bridge_name='br-int',has_traffic_filtering=True,id=18e29088-0348-4df0-bef5-9ab2edca2d95,network=Network(4c20e80c-b8cc-40ab-9ae5-8c29689f494b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e29088-03') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b518f866-e48e-5ebb-9189-957645e7e404', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18e29088-03, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18e29088-03, col_values=(('qos', UUID('0737df26-f0b6-403b-957b-2950eef86f0a')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18e29088-03, col_values=(('external_ids', {'iface-id': '18e29088-0348-4df0-bef5-9ab2edca2d95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:15:ba', 'vm-uuid': 'dcd4711c-8e56-4e18-b4be-11b2bc81ca02'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:43 user nova-compute[75083]: INFO os_vif [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:15:ba,bridge_name='br-int',has_traffic_filtering=True,id=18e29088-0348-4df0-bef5-9ab2edca2d95,network=Network(4c20e80c-b8cc-40ab-9ae5-8c29689f494b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e29088-03')
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:21:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] No VIF found with MAC fa:16:3e:5c:15:ba, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:21:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:44 user nova-compute[75083]: DEBUG nova.network.neutron [req-f61a0898-4469-4384-b282-43a4c6b570b2 req-a7030aa0-e7bc-477d-8ada-7990ab31938b service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Updated VIF entry in instance network info cache for port 18e29088-0348-4df0-bef5-9ab2edca2d95. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:21:44 user nova-compute[75083]: DEBUG nova.network.neutron [req-f61a0898-4469-4384-b282-43a4c6b570b2 req-a7030aa0-e7bc-477d-8ada-7990ab31938b service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Updating instance_info_cache with network_info: [{"id": "18e29088-0348-4df0-bef5-9ab2edca2d95", "address": "fa:16:3e:5c:15:ba", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e29088-03", "ovs_interfaceid": "18e29088-0348-4df0-bef5-9ab2edca2d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:21:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f61a0898-4469-4384-b282-43a4c6b570b2 req-a7030aa0-e7bc-477d-8ada-7990ab31938b service nova] Releasing lock "refresh_cache-dcd4711c-8e56-4e18-b4be-11b2bc81ca02" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:21:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-53e274ab-2143-4de8-91db-8138b59e2463 req-a00fdcd4-8157-48dd-9ccd-24a90a54430a service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Received event network-vif-plugged-18e29088-0348-4df0-bef5-9ab2edca2d95 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:21:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53e274ab-2143-4de8-91db-8138b59e2463 req-a00fdcd4-8157-48dd-9ccd-24a90a54430a service nova] Acquiring lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:21:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53e274ab-2143-4de8-91db-8138b59e2463 req-a00fdcd4-8157-48dd-9ccd-24a90a54430a service nova] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:21:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53e274ab-2143-4de8-91db-8138b59e2463 req-a00fdcd4-8157-48dd-9ccd-24a90a54430a service nova] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:21:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-53e274ab-2143-4de8-91db-8138b59e2463 req-a00fdcd4-8157-48dd-9ccd-24a90a54430a service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] No waiting events found dispatching network-vif-plugged-18e29088-0348-4df0-bef5-9ab2edca2d95 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:21:45 user nova-compute[75083]: WARNING nova.compute.manager [req-53e274ab-2143-4de8-91db-8138b59e2463 req-a00fdcd4-8157-48dd-9ccd-24a90a54430a service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Received unexpected event network-vif-plugged-18e29088-0348-4df0-bef5-9ab2edca2d95 for instance with vm_state building and task_state spawning.
Nov 29 06:21:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:47 user nova-compute[75083]: DEBUG nova.compute.manager [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:21:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:21:47 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Instance spawned successfully.
Nov 29 06:21:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:21:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:21:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:21:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:21:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:21:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:21:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:21:47 user nova-compute[75083]: INFO nova.compute.manager [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 29 06:21:47 user nova-compute[75083]: DEBUG nova.compute.manager [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:21:47 user nova-compute[75083]: INFO nova.compute.manager [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Took 6.07 seconds to build instance.
Nov 29 06:21:47 user nova-compute[75083]: DEBUG nova.compute.manager [req-82497d6a-889d-441a-8251-7ea3fa5538fb req-0d3c9ca3-7136-434b-8f00-4722d14ad72c service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Received event network-vif-plugged-18e29088-0348-4df0-bef5-9ab2edca2d95 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:21:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-82497d6a-889d-441a-8251-7ea3fa5538fb req-0d3c9ca3-7136-434b-8f00-4722d14ad72c service nova] Acquiring lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:21:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-82497d6a-889d-441a-8251-7ea3fa5538fb req-0d3c9ca3-7136-434b-8f00-4722d14ad72c service nova] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:21:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-82497d6a-889d-441a-8251-7ea3fa5538fb req-0d3c9ca3-7136-434b-8f00-4722d14ad72c service nova] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:21:47 user nova-compute[75083]: DEBUG nova.compute.manager [req-82497d6a-889d-441a-8251-7ea3fa5538fb req-0d3c9ca3-7136-434b-8f00-4722d14ad72c service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] No waiting events found dispatching network-vif-plugged-18e29088-0348-4df0-bef5-9ab2edca2d95 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:21:47 user nova-compute[75083]: WARNING nova.compute.manager [req-82497d6a-889d-441a-8251-7ea3fa5538fb req-0d3c9ca3-7136-434b-8f00-4722d14ad72c service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Received unexpected event network-vif-plugged-18e29088-0348-4df0-bef5-9ab2edca2d95 for instance with vm_state active and task_state None.
Nov 29 06:21:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-dbe02c4b-134e-4e18-8ba1-19a1325e5261 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.176s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:21:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:21:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:21:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:21:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:21:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:21:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:21:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:21:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Verify base images {{(pid=75083) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 29 06:21:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Image id 0c1e50f1-5043-4598-be6f-f50133dc7439 yields fingerprint 1dba183a7e6146473f607853840776dd29cbb29a {{(pid=75083) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 06:21:49 user nova-compute[75083]: INFO nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] image 0c1e50f1-5043-4598-be6f-f50133dc7439 at (/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a): checking
Nov 29 06:21:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] image 0c1e50f1-5043-4598-be6f-f50133dc7439 at (/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a): image is in use {{(pid=75083) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 29 06:21:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75083) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 06:21:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] dcd4711c-8e56-4e18-b4be-11b2bc81ca02 is a valid instance name {{(pid=75083) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 06:21:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] dcd4711c-8e56-4e18-b4be-11b2bc81ca02 has a disk file {{(pid=75083) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 29 06:21:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:21:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:21:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance dcd4711c-8e56-4e18-b4be-11b2bc81ca02 is backed by 1dba183a7e6146473f607853840776dd29cbb29a {{(pid=75083) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 29 06:21:49 user nova-compute[75083]: WARNING nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Unknown base file: /opt/stack/data/nova/instances/_base/010ee24463793ef82fe1687e0c696d18d51ac994
Nov 29 06:21:49 user nova-compute[75083]: WARNING nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Unknown base file: /opt/stack/data/nova/instances/_base/eb849e8c7f35bf45efddaa4765813fbf32129ca8
Nov 29 06:21:49 user nova-compute[75083]: WARNING nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Unknown base file: /opt/stack/data/nova/instances/_base/6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7
Nov 29 06:21:49 user nova-compute[75083]: WARNING nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Unknown base file: /opt/stack/data/nova/instances/_base/4db62da88214c3226b11bb98526997a3d3834466
Nov 29 06:21:49 user nova-compute[75083]: WARNING nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Unknown base file: /opt/stack/data/nova/instances/_base/aca7a4315e9d17d826db8830aa4cd56182f3bdbc
Nov 29 06:21:49 user nova-compute[75083]: WARNING nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Unknown base file: /opt/stack/data/nova/instances/_base/8040691e2d2310b199db5b797b1378e92de8d33b
Nov 29 06:21:49 user nova-compute[75083]: WARNING nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Unknown base file: /opt/stack/data/nova/instances/_base/bb4976e4661bfafec4401a3862450e74274088a0
Nov 29 06:21:49 user nova-compute[75083]: WARNING nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Unknown base file: /opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2
Nov 29 06:21:49 user nova-compute[75083]: WARNING nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Unknown base file: /opt/stack/data/nova/instances/_base/1c1c514aee71e41d2fd2c682f0e95530806cc53d
Nov 29 06:21:49 user nova-compute[75083]: INFO nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Active base files: /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a
Nov 29 06:21:49 user nova-compute[75083]: INFO nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Removable base files: /opt/stack/data/nova/instances/_base/010ee24463793ef82fe1687e0c696d18d51ac994 /opt/stack/data/nova/instances/_base/eb849e8c7f35bf45efddaa4765813fbf32129ca8 /opt/stack/data/nova/instances/_base/6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7 /opt/stack/data/nova/instances/_base/4db62da88214c3226b11bb98526997a3d3834466 /opt/stack/data/nova/instances/_base/aca7a4315e9d17d826db8830aa4cd56182f3bdbc /opt/stack/data/nova/instances/_base/8040691e2d2310b199db5b797b1378e92de8d33b /opt/stack/data/nova/instances/_base/bb4976e4661bfafec4401a3862450e74274088a0 /opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2 /opt/stack/data/nova/instances/_base/1c1c514aee71e41d2fd2c682f0e95530806cc53d
Nov 29 06:21:49 user nova-compute[75083]: INFO nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/010ee24463793ef82fe1687e0c696d18d51ac994
Nov 29 06:21:49 user nova-compute[75083]: INFO nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/eb849e8c7f35bf45efddaa4765813fbf32129ca8
Nov 29 06:21:49 user nova-compute[75083]: INFO nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6a0715ccf5b1aa1b8978b50ec5f302e7f460b8b7
Nov 29 06:21:49 user nova-compute[75083]: INFO nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4db62da88214c3226b11bb98526997a3d3834466
Nov 29 06:21:49 user nova-compute[75083]: INFO nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/aca7a4315e9d17d826db8830aa4cd56182f3bdbc
Nov 29 06:21:49 user nova-compute[75083]: INFO nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8040691e2d2310b199db5b797b1378e92de8d33b
Nov 29 06:21:49 user nova-compute[75083]: INFO nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bb4976e4661bfafec4401a3862450e74274088a0
Nov 29 06:21:49 user nova-compute[75083]: INFO nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/af2f29995b267185b2bf3f7328b3856925fb92a2
Nov 29 06:21:49 user nova-compute[75083]: INFO nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1c1c514aee71e41d2fd2c682f0e95530806cc53d
Nov 29 06:21:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Verification complete {{(pid=75083) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 29 06:21:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Verify swap images {{(pid=75083) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 29 06:21:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.imagecache [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Verify ephemeral images {{(pid=75083) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 29 06:21:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:21:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:22:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:22:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:22:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:22:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:22:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:22:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:22:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:22:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:22:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:22:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:22:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:22:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:22:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:22:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:22:25 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:22:26 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:22:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:22:28 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:22:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:22:29 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:22:29 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:22:29 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:22:29 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 06:22:29 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] There are 0 instances to clean {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 06:22:30 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:22:31 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:22:31 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:22:31 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:22:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-dcd4711c-8e56-4e18-b4be-11b2bc81ca02" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:22:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-dcd4711c-8e56-4e18-b4be-11b2bc81ca02" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:22:31 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:22:31 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lazy-loading 'info_cache' on Instance uuid dcd4711c-8e56-4e18-b4be-11b2bc81ca02 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:22:32 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Updating instance_info_cache with network_info: [{"id": "18e29088-0348-4df0-bef5-9ab2edca2d95", "address": "fa:16:3e:5c:15:ba", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e29088-03", "ovs_interfaceid": "18e29088-0348-4df0-bef5-9ab2edca2d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:22:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-dcd4711c-8e56-4e18-b4be-11b2bc81ca02" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:22:32 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:22:32 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:22:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:22:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:22:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:22:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:22:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:22:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:22:35 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:22:37 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:22:37 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75083) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 06:22:38 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:22:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:22:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:22:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:22:38 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:22:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:22:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:22:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:22:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:22:39 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:22:39 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:22:39 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:22:39 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8981MB free_disk=25.07992172241211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:22:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:22:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:22:39 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance dcd4711c-8e56-4e18-b4be-11b2bc81ca02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:22:39 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:22:39 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:22:39 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing inventories for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 06:22:39 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Updating ProviderTree inventory for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 06:22:39 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Updating inventory in ProviderTree for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 06:22:39 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing aggregate associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, aggregates: None {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 06:22:39 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing trait associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, traits: HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 06:22:39 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:22:39 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:22:39 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:22:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:22:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:22:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:22:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:22:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:22:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:22:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:22:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:22:52 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:22:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:22:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:22:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:22:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:22:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:22:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:22:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:23:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:23:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:23:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:23:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:23:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:23:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:23:05 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:23:05 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid dcd4711c-8e56-4e18-b4be-11b2bc81ca02 {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:23:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:23:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:23:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:23:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:23:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:23:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:23:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:23:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:23:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:23:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:23:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:23:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:23:26 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:23:27 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:23:27 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:23:28 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:23:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:23:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:23:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:23:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:23:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:23:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:23:31 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:23:31 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:23:31 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:23:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-dcd4711c-8e56-4e18-b4be-11b2bc81ca02" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:23:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-dcd4711c-8e56-4e18-b4be-11b2bc81ca02" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:23:31 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:23:31 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lazy-loading 'info_cache' on Instance uuid dcd4711c-8e56-4e18-b4be-11b2bc81ca02 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:23:32 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Updating instance_info_cache with network_info: [{"id": "18e29088-0348-4df0-bef5-9ab2edca2d95", "address": "fa:16:3e:5c:15:ba", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e29088-03", "ovs_interfaceid": "18e29088-0348-4df0-bef5-9ab2edca2d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:23:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-dcd4711c-8e56-4e18-b4be-11b2bc81ca02" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:23:32 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:23:32 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:23:32 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:23:32 user nova-compute[75083]: DEBUG nova.compute.manager [req-0f3f271e-0eae-4417-982e-3c51a1be558e req-93491d80-3baf-4b74-b073-e2e7b0571280 service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Received event network-changed-18e29088-0348-4df0-bef5-9ab2edca2d95 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:23:32 user nova-compute[75083]: DEBUG nova.compute.manager [req-0f3f271e-0eae-4417-982e-3c51a1be558e req-93491d80-3baf-4b74-b073-e2e7b0571280 service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Refreshing instance network info cache due to event network-changed-18e29088-0348-4df0-bef5-9ab2edca2d95. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:23:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0f3f271e-0eae-4417-982e-3c51a1be558e req-93491d80-3baf-4b74-b073-e2e7b0571280 service nova] Acquiring lock "refresh_cache-dcd4711c-8e56-4e18-b4be-11b2bc81ca02" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:23:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0f3f271e-0eae-4417-982e-3c51a1be558e req-93491d80-3baf-4b74-b073-e2e7b0571280 service nova] Acquired lock "refresh_cache-dcd4711c-8e56-4e18-b4be-11b2bc81ca02" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:23:32 user nova-compute[75083]: DEBUG nova.network.neutron [req-0f3f271e-0eae-4417-982e-3c51a1be558e req-93491d80-3baf-4b74-b073-e2e7b0571280 service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Refreshing network info cache for port 18e29088-0348-4df0-bef5-9ab2edca2d95 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:23:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:23:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:23:32 user nova-compute[75083]: DEBUG nova.objects.instance [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lazy-loading 'flavor' on Instance uuid dcd4711c-8e56-4e18-b4be-11b2bc81ca02 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:23:32 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Ignoring supplied device name: /dev/vdb
Nov 29 06:23:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:23:33 user nova-compute[75083]: INFO nova.compute.manager [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Attaching volume 4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d to /dev/vdb
Nov 29 06:23:33 user nova-compute[75083]: DEBUG nova.network.neutron [req-0f3f271e-0eae-4417-982e-3c51a1be558e req-93491d80-3baf-4b74-b073-e2e7b0571280 service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Updated VIF entry in instance network info cache for port 18e29088-0348-4df0-bef5-9ab2edca2d95. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG nova.network.neutron [req-0f3f271e-0eae-4417-982e-3c51a1be558e req-93491d80-3baf-4b74-b073-e2e7b0571280 service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Updating instance_info_cache with network_info: [{"id": "18e29088-0348-4df0-bef5-9ab2edca2d95", "address": "fa:16:3e:5c:15:ba", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e29088-03", "ovs_interfaceid": "18e29088-0348-4df0-bef5-9ab2edca2d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0f3f271e-0eae-4417-982e-3c51a1be558e req-93491d80-3baf-4b74-b073-e2e7b0571280 service nova] Releasing lock "refresh_cache-dcd4711c-8e56-4e18-b4be-11b2bc81ca02" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG os_brick.utils [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68431e1-b37b-47b7-805b-50b7b8209aff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[733aee0c-1931-4ecc-bd39-ef58e2ad8186]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[371590be-801e-4f55-ab54-9bd70ac77e63]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a115340-d061-4593-8dcd-b12b7002ef19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:23:33 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:23:33 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[967700da-a247-4adf-921e-6aaf5966b3cb]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG os_brick.utils [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Updating existing volume attachment record: f92fb79c-851f-48b9-8631-25f2aae200f6 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:23:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:23:36 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:23:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:23:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtlWNLBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:23:40 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:23:40 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:23:40 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21167e0-e829-47a0-bc6b-373cf7f59456]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:23:40 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf5c05d-9963-46a5-bee1-0b849e65e3c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d] added
Nov 29 06:23:40 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72ca62c-993c-422e-b6f7-a225fb71c469]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b11308c-b61b-4d69-8807-cad3a3f954f3]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CtlWNLBf {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CtlWNLBf" returned: 0 in 0.025s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[703995ce-d360-4b98-8f99-4b3293e8902a]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CtlWNLBf'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f640ae-7e41-4f1a-a40b-cc4faaae5e01]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[086c35f8-0a8d-48be-8c00-bca6306dec49]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 06:23:40 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 06:23:40 user nova-compute[75083]:  {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:23:40 user nova-compute[75083]: WARNING os_brick.initiator.connectors.iscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 06:23:40 user nova-compute[75083]: 
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced79ab7-0c19-4f12-9053-a88c4011f46f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d, portal: 172.16.0.220,3260]
Nov 29 06:23:40 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d, portal: 172.16.0.220,3260] successful.
Nov 29 06:23:40 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef3c7b9-bfbd-4aa3-a3ef-ef916f9c61c8]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9e11cd-3c35-4933-8833-eb34b5d93a07]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d (non-flash)
Nov 29 06:23:40 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d (non-flash)
Nov 29 06:23:40 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[60922c8f-733e-449c-a6dc-6b65e51c2b84]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtlWNLBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:23:40 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:23:41 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:23:41 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:23:41 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:23:41 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8990MB free_disk=25.079097747802734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:23:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:23:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:23:41 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance dcd4711c-8e56-4e18-b4be-11b2bc81ca02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:23:41 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:23:41 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:23:41 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:23:41 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23836393235313734', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:23:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836393235313734', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:23:41 user nova-compute[75083]: DEBUG nova.objects.instance [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lazy-loading 'flavor' on Instance uuid dcd4711c-8e56-4e18-b4be-11b2bc81ca02 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:23:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 06:23:41 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:23:41 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:23:41 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:23:41 user nova-compute[75083]:   <serial>4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d</serial>
Nov 29 06:23:41 user nova-compute[75083]: </disk>
Nov 29 06:23:41 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 06:23:41 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:23:41 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:23:41 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:23:41 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:23:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:23:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:23:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:23:41 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] No VIF found with MAC fa:16:3e:5c:15:ba, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:23:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-c536260c-19d7-4f31-aeab-1b7b27a98e27 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.034s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:23:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:23:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:23:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:23:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:23:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:24:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:24:02 user nova-compute[75083]: INFO nova.compute.manager [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Detaching volume 4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d
Nov 29 06:24:02 user nova-compute[75083]: INFO nova.virt.block_device [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Attempting to driver detach volume 4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d from mountpoint /dev/vdb
Nov 29 06:24:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Attempting to detach device vdb from instance dcd4711c-8e56-4e18-b4be-11b2bc81ca02 from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 06:24:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:24:02 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:24:02 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:24:02 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:24:02 user nova-compute[75083]:   <serial>4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d</serial>
Nov 29 06:24:02 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:24:02 user nova-compute[75083]: </disk>
Nov 29 06:24:02 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:24:02 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Successfully detached device vdb from instance dcd4711c-8e56-4e18-b4be-11b2bc81ca02 from the persistent domain config.
Nov 29 06:24:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dcd4711c-8e56-4e18-b4be-11b2bc81ca02 from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 06:24:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:24:02 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:24:02 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:24:02 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:24:02 user nova-compute[75083]:   <serial>4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d</serial>
Nov 29 06:24:02 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:24:02 user nova-compute[75083]: </disk>
Nov 29 06:24:02 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:24:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:24:02 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dcd4711c-8e56-4e18-b4be-11b2bc81ca02 {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 06:24:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:24:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:24:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:24:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:24:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:24:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:24:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:24:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:24:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:24:22 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dcd4711c-8e56-4e18-b4be-11b2bc81ca02 is timed out.
Nov 29 06:24:22 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Successfully detached device vdb from instance dcd4711c-8e56-4e18-b4be-11b2bc81ca02 from the live domain config.
Nov 29 06:24:22 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtlWNLBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:24:22 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:24:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9e73bf-f806-410a-8224-e18499d37d08]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:24:22 user nova-compute[75083]: No targets found.
Nov 29 06:24:22 user nova-compute[75083]: iSNS:
Nov 29 06:24:22 user nova-compute[75083]: No targets found.
Nov 29 06:24:22 user nova-compute[75083]: STATIC:
Nov 29 06:24:22 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d
Nov 29 06:24:22 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:24:22 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:24:22 user nova-compute[75083]: FIRMWARE:
Nov 29 06:24:22 user nova-compute[75083]: No targets found.
Nov 29 06:24:22 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:24:22 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:24:22 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d10664-009c-4dda-9ab7-d9b06d760704]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6a852c-d172-4c4a-b778-4691b99a1f08]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d (non-flash)
Nov 29 06:24:22 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d (non-flash)
Nov 29 06:24:22 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b8315ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[775ab68f-090a-44ab-9080-e32df192cdb9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:24:22 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4be2463-888e-4224-a7d0-f0f40e530553]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59a3518-3570-4633-a8e0-d64227b620c0]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a4eddf-a0cb-48f8-8b68-a1199d83c49f]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e849fb8f-97e2-4527-948b-8b819b418629]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8791cfce-0d18-4b10-8c4a-6f66983b20c8]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d, portal: 172.16.0.220,3260]
Nov 29 06:24:23 user nova-compute[75083]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d, portal: 172.16.0.220,3260] successful.
Nov 29 06:24:23 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce7f528-c2ee-4962-a4c2-32b07de3f0df]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] <== disconnect_volume: return (291ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:24:23 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG nova.objects.instance [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lazy-loading 'flavor' on Instance uuid dcd4711c-8e56-4e18-b4be-11b2bc81ca02 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b9d112e7-7518-4f3b-826a-4970fc65bfe9 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.766s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.651s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:24:24 user nova-compute[75083]: INFO nova.compute.manager [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Terminating instance
Nov 29 06:24:24 user nova-compute[75083]: DEBUG nova.compute.manager [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG nova.compute.manager [req-06cf6616-5b37-4d89-b068-6fffd9f13af3 req-e2871a91-0033-4907-8fd1-c86d0a311c06 service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Received event network-vif-unplugged-18e29088-0348-4df0-bef5-9ab2edca2d95 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-06cf6616-5b37-4d89-b068-6fffd9f13af3 req-e2871a91-0033-4907-8fd1-c86d0a311c06 service nova] Acquiring lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-06cf6616-5b37-4d89-b068-6fffd9f13af3 req-e2871a91-0033-4907-8fd1-c86d0a311c06 service nova] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-06cf6616-5b37-4d89-b068-6fffd9f13af3 req-e2871a91-0033-4907-8fd1-c86d0a311c06 service nova] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG nova.compute.manager [req-06cf6616-5b37-4d89-b068-6fffd9f13af3 req-e2871a91-0033-4907-8fd1-c86d0a311c06 service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] No waiting events found dispatching network-vif-unplugged-18e29088-0348-4df0-bef5-9ab2edca2d95 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG nova.compute.manager [req-06cf6616-5b37-4d89-b068-6fffd9f13af3 req-e2871a91-0033-4907-8fd1-c86d0a311c06 service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Received event network-vif-unplugged-18e29088-0348-4df0-bef5-9ab2edca2d95 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:24 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Instance destroyed successfully.
Nov 29 06:24:24 user nova-compute[75083]: DEBUG nova.objects.instance [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lazy-loading 'resources' on Instance uuid dcd4711c-8e56-4e18-b4be-11b2bc81ca02 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-993801431',display_name='tempest-VolumesSnapshotTestJSON-instance-993801431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-993801431',id=45,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpkGNtMljSPmmT7S2kfgS63Np6mKwEbhquptY3eTZgtWTp6crQ6ppspZZa/mwwbNLH+oj1JbtSK6SG6gKayLLsriy4RWETFv3o9wzfDU1PCkQGToPUN/0nuSn1fnFgdkg==',key_name='tempest-keypair-1032064783',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:21:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a77ab7954dd9455f9025e026a8c0c1f0',ramdisk_id='',reservation_id='r-iozgergl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-817468576',owner_user_name='tempest-VolumesSnapshotTestJSON-817468576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:21:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98533e90b5904b37b0cbcdd3a18cb15f',uuid=dcd4711c-8e56-4e18-b4be-11b2bc81ca02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18e29088-0348-4df0-bef5-9ab2edca2d95", "address": "fa:16:3e:5c:15:ba", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e29088-03", "ovs_interfaceid": "18e29088-0348-4df0-bef5-9ab2edca2d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Converting VIF {"id": "18e29088-0348-4df0-bef5-9ab2edca2d95", "address": "fa:16:3e:5c:15:ba", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e29088-03", "ovs_interfaceid": "18e29088-0348-4df0-bef5-9ab2edca2d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:15:ba,bridge_name='br-int',has_traffic_filtering=True,id=18e29088-0348-4df0-bef5-9ab2edca2d95,network=Network(4c20e80c-b8cc-40ab-9ae5-8c29689f494b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e29088-03') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG os_vif [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:15:ba,bridge_name='br-int',has_traffic_filtering=True,id=18e29088-0348-4df0-bef5-9ab2edca2d95,network=Network(4c20e80c-b8cc-40ab-9ae5-8c29689f494b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e29088-03') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18e29088-03, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0737df26-f0b6-403b-957b-2950eef86f0a) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:24:24 user nova-compute[75083]: INFO os_vif [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:15:ba,bridge_name='br-int',has_traffic_filtering=True,id=18e29088-0348-4df0-bef5-9ab2edca2d95,network=Network(4c20e80c-b8cc-40ab-9ae5-8c29689f494b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e29088-03')
Nov 29 06:24:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:4b8e81a5-a12c-4428-a9ba-65dad2e3ae1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtlWNLBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:24:24 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:24:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[d864a2b0-48b9-41a2-833a-e9af0eac66e1]: Unexpected error while running command.
Nov 29 06:24:24 user nova-compute[75083]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 29 06:24:24 user nova-compute[75083]: Exit code: 21
Nov 29 06:24:24 user nova-compute[75083]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 29 06:24:24 user nova-compute[75083]: Stderr: '' {{(pid=86165) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 29 06:24:24 user nova-compute[75083]: Traceback (most recent call last):
Nov 29 06:24:24 user nova-compute[75083]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 29 06:24:24 user nova-compute[75083]:     ret = func(*f_args, **f_kwargs)
Nov 29 06:24:24 user nova-compute[75083]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 29 06:24:24 user nova-compute[75083]:     return func(*args, **kwargs)
Nov 29 06:24:24 user nova-compute[75083]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 29 06:24:24 user nova-compute[75083]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 29 06:24:24 user nova-compute[75083]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 29 06:24:24 user nova-compute[75083]:     return putils.execute(on_execute=on_execute,
Nov 29 06:24:24 user nova-compute[75083]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 29 06:24:24 user nova-compute[75083]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 29 06:24:24 user nova-compute[75083]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 29 06:24:24 user nova-compute[75083]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 29 06:24:24 user nova-compute[75083]: Exit code: 21
Nov 29 06:24:24 user nova-compute[75083]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 29 06:24:24 user nova-compute[75083]: Stderr: ''
Nov 29 06:24:24 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d864a2b0-48b9-41a2-833a-e9af0eac66e1]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 29 06:24:24 user nova-compute[75083]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 29 06:24:24 user nova-compute[75083]: Exit code: 21
Nov 29 06:24:24 user nova-compute[75083]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 29 06:24:24 user nova-compute[75083]: Stderr: ''
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 29 06:24:24 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi 
Nov 29 06:24:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75083) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.034s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] <== disconnect_volume: return (35ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:24:24 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:24:24 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Deleting instance files /opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02_del
Nov 29 06:24:24 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Deletion of /opt/stack/data/nova/instances/dcd4711c-8e56-4e18-b4be-11b2bc81ca02_del complete
Nov 29 06:24:25 user nova-compute[75083]: INFO nova.compute.manager [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 06:24:25 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:24:25 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:24:25 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:24:26 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:24:26 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Took 1.12 seconds to deallocate network for instance.
Nov 29 06:24:26 user nova-compute[75083]: WARNING nova.volume.cinder [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Attachment f92fb79c-851f-48b9-8631-25f2aae200f6 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = f92fb79c-851f-48b9-8631-25f2aae200f6. (HTTP 404) (Request-ID: req-60cc8fde-8b65-4687-904f-661a2b53718c)
Nov 29 06:24:26 user nova-compute[75083]: INFO nova.compute.manager [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Took 0.03 seconds to detach 1 volumes for instance.
Nov 29 06:24:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-fffd8b45-ed1e-4809-97c4-5ab27fb47d5e req-20340455-17e3-4b43-85b5-3c69a7b6456d service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Received event network-vif-deleted-18e29088-0348-4df0-bef5-9ab2edca2d95 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:24:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:24:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:24:26 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:24:26 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:24:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:24:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-91ce9edb-327e-4699-81a5-edf665bd0a16 req-8f647c61-45d5-4764-8d46-34dafe216a15 service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Received event network-vif-plugged-18e29088-0348-4df0-bef5-9ab2edca2d95 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:24:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-91ce9edb-327e-4699-81a5-edf665bd0a16 req-8f647c61-45d5-4764-8d46-34dafe216a15 service nova] Acquiring lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:24:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-91ce9edb-327e-4699-81a5-edf665bd0a16 req-8f647c61-45d5-4764-8d46-34dafe216a15 service nova] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:24:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-91ce9edb-327e-4699-81a5-edf665bd0a16 req-8f647c61-45d5-4764-8d46-34dafe216a15 service nova] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:24:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-91ce9edb-327e-4699-81a5-edf665bd0a16 req-8f647c61-45d5-4764-8d46-34dafe216a15 service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] No waiting events found dispatching network-vif-plugged-18e29088-0348-4df0-bef5-9ab2edca2d95 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:24:26 user nova-compute[75083]: WARNING nova.compute.manager [req-91ce9edb-327e-4699-81a5-edf665bd0a16 req-8f647c61-45d5-4764-8d46-34dafe216a15 service nova] [instance: dcd4711c-8e56-4e18-b4be-11b2bc81ca02] Received unexpected event network-vif-plugged-18e29088-0348-4df0-bef5-9ab2edca2d95 for instance with vm_state deleted and task_state None.
Nov 29 06:24:26 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Deleted allocations for instance dcd4711c-8e56-4e18-b4be-11b2bc81ca02
Nov 29 06:24:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-75badf6b-de0d-41ba-87a5-f052a3de5ff3 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "dcd4711c-8e56-4e18-b4be-11b2bc81ca02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.408s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:24:27 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:24:27 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:24:27 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:24:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:30 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:24:30 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:24:32 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:24:32 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:24:32 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:24:32 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 06:24:32 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:24:34 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:24:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:35 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:24:36 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:24:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:24:42 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:24:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:24:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:24:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:24:42 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:24:42 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:24:42 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:24:42 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=9143MB free_disk=25.105926513671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:24:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:24:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:24:42 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:24:42 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:24:43 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:24:43 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:24:43 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:24:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:24:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:24:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:24:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:24:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:24:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:24:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:24:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:24:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:24:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:25:07 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "56410fac-1d60-4937-a585-18f99d6f5ad9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:25:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:25:09 user nova-compute[75083]: DEBUG nova.compute.manager [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:25:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:25:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:25:09 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:25:09 user nova-compute[75083]: INFO nova.compute.claims [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Claim successful on node user
Nov 29 06:25:09 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:25:09 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:25:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.182s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:25:09 user nova-compute[75083]: DEBUG nova.compute.manager [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:25:09 user nova-compute[75083]: DEBUG nova.compute.manager [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:25:09 user nova-compute[75083]: DEBUG nova.network.neutron [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:25:09 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:25:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:09 user nova-compute[75083]: DEBUG nova.compute.manager [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG nova.policy [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '98533e90b5904b37b0cbcdd3a18cb15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ab7954dd9455f9025e026a8c0c1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG nova.compute.manager [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:25:10 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Creating image(s)
Nov 29 06:25:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "/opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "/opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "/opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.177s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "1dba183a7e6146473f607853840776dd29cbb29a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk 1073741824 {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a,backing_fmt=raw /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk 1073741824" returned: 0 in 0.048s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "1dba183a7e6146473f607853840776dd29cbb29a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dba183a7e6146473f607853840776dd29cbb29a --force-share --output=json" returned: 0 in 0.173s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk. size=1073741824 {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG nova.network.neutron [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Successfully created port: 15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG nova.virt.disk.api [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Cannot resize image /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk to a smaller size. {{(pid=75083) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Created local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Ensure instance console log exists: /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:25:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.network.neutron [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Successfully updated port: 15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "refresh_cache-56410fac-1d60-4937-a585-18f99d6f5ad9" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquired lock "refresh_cache-56410fac-1d60-4937-a585-18f99d6f5ad9" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.network.neutron [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.compute.manager [req-8d9c1559-efde-4a71-8d16-534106c7fa14 req-ff445fc1-8a9e-4bc6-ae12-e32b322214cf service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Received event network-changed-15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.compute.manager [req-8d9c1559-efde-4a71-8d16-534106c7fa14 req-ff445fc1-8a9e-4bc6-ae12-e32b322214cf service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Refreshing instance network info cache due to event network-changed-15f3c862-0dca-4bd8-acde-02c7ba56bf43. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8d9c1559-efde-4a71-8d16-534106c7fa14 req-ff445fc1-8a9e-4bc6-ae12-e32b322214cf service nova] Acquiring lock "refresh_cache-56410fac-1d60-4937-a585-18f99d6f5ad9" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.network.neutron [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.network.neutron [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Updating instance_info_cache with network_info: [{"id": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "address": "fa:16:3e:39:9c:77", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f3c862-0d", "ovs_interfaceid": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Releasing lock "refresh_cache-56410fac-1d60-4937-a585-18f99d6f5ad9" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.compute.manager [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Instance network_info: |[{"id": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "address": "fa:16:3e:39:9c:77", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f3c862-0d", "ovs_interfaceid": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8d9c1559-efde-4a71-8d16-534106c7fa14 req-ff445fc1-8a9e-4bc6-ae12-e32b322214cf service nova] Acquired lock "refresh_cache-56410fac-1d60-4937-a585-18f99d6f5ad9" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.network.neutron [req-8d9c1559-efde-4a71-8d16-534106c7fa14 req-ff445fc1-8a9e-4bc6-ae12-e32b322214cf service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Refreshing network info cache for port 15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Start _get_guest_xml network_info=[{"id": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "address": "fa:16:3e:39:9c:77", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f3c862-0d", "ovs_interfaceid": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'image_id': '0c1e50f1-5043-4598-be6f-f50133dc7439'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:25:11 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:25:11 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T05:42:18Z,direct_url=<?>,disk_format='qcow2',id=0c1e50f1-5043-4598-be6f-f50133dc7439,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='338a11d250eb4a7a9ead9ff296e79514',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T05:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-4761725',display_name='tempest-VolumesSnapshotTestJSON-instance-4761725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-4761725',id=46,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbipKqiS61LZtQqiAO66n1dFoMzslPVlMj+DIp4oJCWvXe80aU6h8IHRL97OUfhigDJj1eXtiTWO/Y5FZoFKnsIOXgsYa2uwV8IEW8F5a9pJcvLN98i8QOgfWn2FXX4nA==',key_name='tempest-keypair-2034371743',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a77ab7954dd9455f9025e026a8c0c1f0',ramdisk_id='',reservation_id='r-pia1ykvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-817468576',owner_user_name='tempest-VolumesSnapshotTestJSON-817468576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:25:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98533e90b5904b37b0cbcdd3a18cb15f',uuid=56410fac-1d60-4937-a585-18f99d6f5ad9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "address": "fa:16:3e:39:9c:77", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f3c862-0d", "ovs_interfaceid": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Converting VIF {"id": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "address": "fa:16:3e:39:9c:77", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f3c862-0d", "ovs_interfaceid": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:9c:77,bridge_name='br-int',has_traffic_filtering=True,id=15f3c862-0dca-4bd8-acde-02c7ba56bf43,network=Network(4c20e80c-b8cc-40ab-9ae5-8c29689f494b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f3c862-0d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.objects.instance [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lazy-loading 'pci_devices' on Instance uuid 56410fac-1d60-4937-a585-18f99d6f5ad9 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:25:11 user nova-compute[75083]:   <uuid>56410fac-1d60-4937-a585-18f99d6f5ad9</uuid>
Nov 29 06:25:11 user nova-compute[75083]:   <name>instance-0000002e</name>
Nov 29 06:25:11 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:25:11 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:25:11 user nova-compute[75083]:   <metadata>
Nov 29 06:25:11 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:25:11 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:25:11 user nova-compute[75083]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-4761725</nova:name>
Nov 29 06:25:11 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:25:11</nova:creationTime>
Nov 29 06:25:11 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:25:11 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:25:11 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:25:11 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:25:11 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:25:11 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:25:11 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:25:11 user nova-compute[75083]:       <nova:owner>
Nov 29 06:25:11 user nova-compute[75083]:         <nova:user uuid="98533e90b5904b37b0cbcdd3a18cb15f">tempest-VolumesSnapshotTestJSON-817468576-project-member</nova:user>
Nov 29 06:25:11 user nova-compute[75083]:         <nova:project uuid="a77ab7954dd9455f9025e026a8c0c1f0">tempest-VolumesSnapshotTestJSON-817468576</nova:project>
Nov 29 06:25:11 user nova-compute[75083]:       </nova:owner>
Nov 29 06:25:11 user nova-compute[75083]:       <nova:root type="image" uuid="0c1e50f1-5043-4598-be6f-f50133dc7439"/>
Nov 29 06:25:11 user nova-compute[75083]:       <nova:ports>
Nov 29 06:25:11 user nova-compute[75083]:         <nova:port uuid="15f3c862-0dca-4bd8-acde-02c7ba56bf43">
Nov 29 06:25:11 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 06:25:11 user nova-compute[75083]:         </nova:port>
Nov 29 06:25:11 user nova-compute[75083]:       </nova:ports>
Nov 29 06:25:11 user nova-compute[75083]:     </nova:instance>
Nov 29 06:25:11 user nova-compute[75083]:   </metadata>
Nov 29 06:25:11 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:25:11 user nova-compute[75083]:     <system>
Nov 29 06:25:11 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:25:11 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:25:11 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:25:11 user nova-compute[75083]:       <entry name="serial">56410fac-1d60-4937-a585-18f99d6f5ad9</entry>
Nov 29 06:25:11 user nova-compute[75083]:       <entry name="uuid">56410fac-1d60-4937-a585-18f99d6f5ad9</entry>
Nov 29 06:25:11 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:25:11 user nova-compute[75083]:     </system>
Nov 29 06:25:11 user nova-compute[75083]:   </sysinfo>
Nov 29 06:25:11 user nova-compute[75083]:   <os>
Nov 29 06:25:11 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:25:11 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:25:11 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:25:11 user nova-compute[75083]:   </os>
Nov 29 06:25:11 user nova-compute[75083]:   <features>
Nov 29 06:25:11 user nova-compute[75083]:     <acpi/>
Nov 29 06:25:11 user nova-compute[75083]:     <apic/>
Nov 29 06:25:11 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:25:11 user nova-compute[75083]:   </features>
Nov 29 06:25:11 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:25:11 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:25:11 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:25:11 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:25:11 user nova-compute[75083]:   </clock>
Nov 29 06:25:11 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:25:11 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:25:11 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:25:11 user nova-compute[75083]:   </cpu>
Nov 29 06:25:11 user nova-compute[75083]:   <devices>
Nov 29 06:25:11 user nova-compute[75083]:     <disk type="file" device="disk">
Nov 29 06:25:11 user nova-compute[75083]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 06:25:11 user nova-compute[75083]:       <source file="/opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk"/>
Nov 29 06:25:11 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:25:11 user nova-compute[75083]:     </disk>
Nov 29 06:25:11 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:25:11 user nova-compute[75083]:       <mac address="fa:16:3e:39:9c:77"/>
Nov 29 06:25:11 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:25:11 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:25:11 user nova-compute[75083]:       <target dev="tap15f3c862-0d"/>
Nov 29 06:25:11 user nova-compute[75083]:     </interface>
Nov 29 06:25:11 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:25:11 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/console.log" append="off"/>
Nov 29 06:25:11 user nova-compute[75083]:     </serial>
Nov 29 06:25:11 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:25:11 user nova-compute[75083]:     <video>
Nov 29 06:25:11 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:25:11 user nova-compute[75083]:     </video>
Nov 29 06:25:11 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:25:11 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:25:11 user nova-compute[75083]:     </rng>
Nov 29 06:25:11 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:25:11 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:25:11 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:25:11 user nova-compute[75083]:     </memballoon>
Nov 29 06:25:11 user nova-compute[75083]:   </devices>
Nov 29 06:25:11 user nova-compute[75083]: </domain>
Nov 29 06:25:11 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-4761725',display_name='tempest-VolumesSnapshotTestJSON-instance-4761725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-4761725',id=46,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbipKqiS61LZtQqiAO66n1dFoMzslPVlMj+DIp4oJCWvXe80aU6h8IHRL97OUfhigDJj1eXtiTWO/Y5FZoFKnsIOXgsYa2uwV8IEW8F5a9pJcvLN98i8QOgfWn2FXX4nA==',key_name='tempest-keypair-2034371743',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a77ab7954dd9455f9025e026a8c0c1f0',ramdisk_id='',reservation_id='r-pia1ykvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-817468576',owner_user_name='tempest-VolumesSnapshotTestJSON-817468576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:25:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98533e90b5904b37b0cbcdd3a18cb15f',uuid=56410fac-1d60-4937-a585-18f99d6f5ad9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "address": "fa:16:3e:39:9c:77", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f3c862-0d", "ovs_interfaceid": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Converting VIF {"id": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "address": "fa:16:3e:39:9c:77", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f3c862-0d", "ovs_interfaceid": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:9c:77,bridge_name='br-int',has_traffic_filtering=True,id=15f3c862-0dca-4bd8-acde-02c7ba56bf43,network=Network(4c20e80c-b8cc-40ab-9ae5-8c29689f494b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f3c862-0d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG os_vif [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:9c:77,bridge_name='br-int',has_traffic_filtering=True,id=15f3c862-0dca-4bd8-acde-02c7ba56bf43,network=Network(4c20e80c-b8cc-40ab-9ae5-8c29689f494b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f3c862-0d') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'daa7ee14-6027-5a5c-8e4b-5d3eb5385364', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15f3c862-0d, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15f3c862-0d, col_values=(('qos', UUID('dabb9468-c816-4d30-84bc-4c5ab5923d7e')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15f3c862-0d, col_values=(('external_ids', {'iface-id': '15f3c862-0dca-4bd8-acde-02c7ba56bf43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:9c:77', 'vm-uuid': '56410fac-1d60-4937-a585-18f99d6f5ad9'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:11 user nova-compute[75083]: INFO os_vif [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:9c:77,bridge_name='br-int',has_traffic_filtering=True,id=15f3c862-0dca-4bd8-acde-02c7ba56bf43,network=Network(4c20e80c-b8cc-40ab-9ae5-8c29689f494b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f3c862-0d')
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:25:11 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] No VIF found with MAC fa:16:3e:39:9c:77, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:25:12 user nova-compute[75083]: DEBUG nova.network.neutron [req-8d9c1559-efde-4a71-8d16-534106c7fa14 req-ff445fc1-8a9e-4bc6-ae12-e32b322214cf service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Updated VIF entry in instance network info cache for port 15f3c862-0dca-4bd8-acde-02c7ba56bf43. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:25:12 user nova-compute[75083]: DEBUG nova.network.neutron [req-8d9c1559-efde-4a71-8d16-534106c7fa14 req-ff445fc1-8a9e-4bc6-ae12-e32b322214cf service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Updating instance_info_cache with network_info: [{"id": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "address": "fa:16:3e:39:9c:77", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f3c862-0d", "ovs_interfaceid": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:25:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8d9c1559-efde-4a71-8d16-534106c7fa14 req-ff445fc1-8a9e-4bc6-ae12-e32b322214cf service nova] Releasing lock "refresh_cache-56410fac-1d60-4937-a585-18f99d6f5ad9" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:25:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:13 user nova-compute[75083]: DEBUG nova.compute.manager [req-8b02ac29-94dd-4010-9985-91e9ed4e1025 req-894cddc6-bc6e-434b-8160-9be488797ace service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Received event network-vif-plugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:25:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8b02ac29-94dd-4010-9985-91e9ed4e1025 req-894cddc6-bc6e-434b-8160-9be488797ace service nova] Acquiring lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:25:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8b02ac29-94dd-4010-9985-91e9ed4e1025 req-894cddc6-bc6e-434b-8160-9be488797ace service nova] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:25:13 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-8b02ac29-94dd-4010-9985-91e9ed4e1025 req-894cddc6-bc6e-434b-8160-9be488797ace service nova] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:25:13 user nova-compute[75083]: DEBUG nova.compute.manager [req-8b02ac29-94dd-4010-9985-91e9ed4e1025 req-894cddc6-bc6e-434b-8160-9be488797ace service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] No waiting events found dispatching network-vif-plugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:25:13 user nova-compute[75083]: WARNING nova.compute.manager [req-8b02ac29-94dd-4010-9985-91e9ed4e1025 req-894cddc6-bc6e-434b-8160-9be488797ace service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Received unexpected event network-vif-plugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 for instance with vm_state building and task_state spawning.
Nov 29 06:25:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:15 user nova-compute[75083]: DEBUG nova.compute.manager [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:25:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:25:15 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Instance spawned successfully.
Nov 29 06:25:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:25:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:25:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:25:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:25:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:25:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:25:15 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:25:15 user nova-compute[75083]: INFO nova.compute.manager [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 29 06:25:15 user nova-compute[75083]: DEBUG nova.compute.manager [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:25:15 user nova-compute[75083]: DEBUG nova.compute.manager [req-9a756bb7-1fb9-4fe1-888c-9fab80169bc6 req-fee1a0b8-371e-4b72-984b-8d8d7f2e60a7 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Received event network-vif-plugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:25:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9a756bb7-1fb9-4fe1-888c-9fab80169bc6 req-fee1a0b8-371e-4b72-984b-8d8d7f2e60a7 service nova] Acquiring lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:25:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9a756bb7-1fb9-4fe1-888c-9fab80169bc6 req-fee1a0b8-371e-4b72-984b-8d8d7f2e60a7 service nova] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:25:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9a756bb7-1fb9-4fe1-888c-9fab80169bc6 req-fee1a0b8-371e-4b72-984b-8d8d7f2e60a7 service nova] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:25:15 user nova-compute[75083]: DEBUG nova.compute.manager [req-9a756bb7-1fb9-4fe1-888c-9fab80169bc6 req-fee1a0b8-371e-4b72-984b-8d8d7f2e60a7 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] No waiting events found dispatching network-vif-plugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:25:15 user nova-compute[75083]: WARNING nova.compute.manager [req-9a756bb7-1fb9-4fe1-888c-9fab80169bc6 req-fee1a0b8-371e-4b72-984b-8d8d7f2e60a7 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Received unexpected event network-vif-plugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 for instance with vm_state building and task_state spawning.
Nov 29 06:25:15 user nova-compute[75083]: INFO nova.compute.manager [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Took 5.75 seconds to build instance.
Nov 29 06:25:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-a3e8abec-4cba-4397-adf7-f3dd2cbe3d87 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.860s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:25:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:25:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:25:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:25:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:25:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:28 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:25:28 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:25:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:25:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:25:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:25:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:25:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:25:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:32 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:25:32 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:25:32 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:25:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-56410fac-1d60-4937-a585-18f99d6f5ad9" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:25:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-56410fac-1d60-4937-a585-18f99d6f5ad9" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:25:32 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:25:32 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lazy-loading 'info_cache' on Instance uuid 56410fac-1d60-4937-a585-18f99d6f5ad9 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:25:33 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Updating instance_info_cache with network_info: [{"id": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "address": "fa:16:3e:39:9c:77", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f3c862-0d", "ovs_interfaceid": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:25:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-56410fac-1d60-4937-a585-18f99d6f5ad9" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:25:33 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:25:33 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:25:33 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:25:35 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:25:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:37 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:25:38 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:25:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:42 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:25:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:25:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:25:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:25:42 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:25:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:25:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:25:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:25:43 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:25:43 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:25:43 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:25:43 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8969MB free_disk=25.068286895751953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:25:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:25:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:25:43 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 56410fac-1d60-4937-a585-18f99d6f5ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:25:43 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:25:43 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:25:43 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:25:43 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:25:43 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:25:43 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:25:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:25:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:26:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:26:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:26:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:26:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:26:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:26:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:26:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:26:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:26:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:26:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:26:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:26:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:26:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:26:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:26:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:26:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:26:30 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:26:30 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:26:30 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:26:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:26:33 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:26:33 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:26:33 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:26:33 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:26:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-56410fac-1d60-4937-a585-18f99d6f5ad9" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:26:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-56410fac-1d60-4937-a585-18f99d6f5ad9" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:26:33 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:26:33 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lazy-loading 'info_cache' on Instance uuid 56410fac-1d60-4937-a585-18f99d6f5ad9 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:26:34 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Updating instance_info_cache with network_info: [{"id": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "address": "fa:16:3e:39:9c:77", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f3c862-0d", "ovs_interfaceid": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:26:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-56410fac-1d60-4937-a585-18f99d6f5ad9" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:26:34 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:26:34 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:26:34 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:26:36 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:26:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:26:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:26:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:26:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:26:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:26:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:26:38 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:26:39 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:26:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:26:44 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:26:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:26:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:26:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:26:44 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:26:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:26:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:26:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:26:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:26:45 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:26:45 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:26:45 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=9016MB free_disk=25.06753921508789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:26:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:26:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:26:45 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 56410fac-1d60-4937-a585-18f99d6f5ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:26:45 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:26:45 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:26:45 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:26:45 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:26:45 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:26:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:26:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:26:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:26:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:26:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:26:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:26:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:26:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:26:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:26:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:26:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:26:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:26:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:26:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:00 user nova-compute[75083]: DEBUG nova.compute.manager [req-c99f6f0c-8d9a-47a3-af75-b25816d2ef13 req-1c49b066-0ada-402b-b35c-0cd42c247964 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Received event network-changed-15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:27:00 user nova-compute[75083]: DEBUG nova.compute.manager [req-c99f6f0c-8d9a-47a3-af75-b25816d2ef13 req-1c49b066-0ada-402b-b35c-0cd42c247964 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Refreshing instance network info cache due to event network-changed-15f3c862-0dca-4bd8-acde-02c7ba56bf43. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:27:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c99f6f0c-8d9a-47a3-af75-b25816d2ef13 req-1c49b066-0ada-402b-b35c-0cd42c247964 service nova] Acquiring lock "refresh_cache-56410fac-1d60-4937-a585-18f99d6f5ad9" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:27:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c99f6f0c-8d9a-47a3-af75-b25816d2ef13 req-1c49b066-0ada-402b-b35c-0cd42c247964 service nova] Acquired lock "refresh_cache-56410fac-1d60-4937-a585-18f99d6f5ad9" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:27:00 user nova-compute[75083]: DEBUG nova.network.neutron [req-c99f6f0c-8d9a-47a3-af75-b25816d2ef13 req-1c49b066-0ada-402b-b35c-0cd42c247964 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Refreshing network info cache for port 15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:27:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "56410fac-1d60-4937-a585-18f99d6f5ad9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:27:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:27:00 user nova-compute[75083]: DEBUG nova.objects.instance [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lazy-loading 'flavor' on Instance uuid 56410fac-1d60-4937-a585-18f99d6f5ad9 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:27:00 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Ignoring supplied device name: /dev/vdb
Nov 29 06:27:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "56410fac-1d60-4937-a585-18f99d6f5ad9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:27:01 user nova-compute[75083]: INFO nova.compute.manager [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Attaching volume 5a86ddc4-4619-4cbd-8579-a764ddbc4fac to /dev/vdb
Nov 29 06:27:01 user nova-compute[75083]: DEBUG os_brick.utils [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b114edc-d5b5-4b0e-b50f-95e391442492]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e951259-ce27-48ce-98d8-8a18adcc24f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[679ab18d-1eff-47a0-88c7-e0d6407aac3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[da760ead-b5c4-4b0b-935e-5f96f515b8e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:27:01 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:27:01 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecc705f-b515-45bf-920f-8b6cf1c8701b]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG os_brick.utils [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Updating existing volume attachment record: 7559630c-f8fc-4eb0-b422-d604d5b00110 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG nova.network.neutron [req-c99f6f0c-8d9a-47a3-af75-b25816d2ef13 req-1c49b066-0ada-402b-b35c-0cd42c247964 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Updated VIF entry in instance network info cache for port 15f3c862-0dca-4bd8-acde-02c7ba56bf43. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG nova.network.neutron [req-c99f6f0c-8d9a-47a3-af75-b25816d2ef13 req-1c49b066-0ada-402b-b35c-0cd42c247964 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Updating instance_info_cache with network_info: [{"id": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "address": "fa:16:3e:39:9c:77", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f3c862-0d", "ovs_interfaceid": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-c99f6f0c-8d9a-47a3-af75-b25816d2ef13 req-1c49b066-0ada-402b-b35c-0cd42c247964 service nova] Releasing lock "refresh_cache-56410fac-1d60-4937-a585-18f99d6f5ad9" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:27:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:06 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:27:07 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sFhKYxBC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:27:07 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:27:07 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:27:07 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:27:07 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:27:07 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:27:07 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:27:07 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:27:07 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4a58b4-1713-4fc3-8f05-370968b7c751]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:27:08 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1258b83f-0d7a-4447-97c2-97794ce23717]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac] added
Nov 29 06:27:08 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47bd395-f670-44fb-bc8f-a31cf59679b4]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6b5160-0ef9-4ec3-908b-4646b4544f29]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sFhKYxBC {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sFhKYxBC" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[25865ecc-d7df-4479-bbea-df9687a49ab5]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sFhKYxBC'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b271c7aa-2696-460d-aeff-d2965d489055]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[494f8320-aaeb-4e17-88c3-387636c8ac12]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 06:27:08 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 06:27:08 user nova-compute[75083]:  {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:27:08 user nova-compute[75083]: WARNING os_brick.initiator.connectors.iscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 06:27:08 user nova-compute[75083]: 
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4222932b-2e59-4459-aa85-3061eeaa6dc6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac, portal: 172.16.0.220,3260]
Nov 29 06:27:08 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac, portal: 172.16.0.220,3260] successful.
Nov 29 06:27:08 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.050s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a84fdc-7fec-4d5a-a8bc-f368dc14f9c1]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f2925a-0f08-4c74-81f9-df8fcd7e00ba]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac (non-flash)
Nov 29 06:27:08 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac (non-flash)
Nov 29 06:27:08 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8a1d53-bc05-4ad4-a4a9-b936048f2f96]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:27:08 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sFhKYxBC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:27:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:27:09 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23539326132643262', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:27:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539326132643262', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:27:09 user nova-compute[75083]: DEBUG nova.objects.instance [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lazy-loading 'flavor' on Instance uuid 56410fac-1d60-4937-a585-18f99d6f5ad9 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:27:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 06:27:09 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:27:09 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:27:09 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:27:09 user nova-compute[75083]:   <serial>5a86ddc4-4619-4cbd-8579-a764ddbc4fac</serial>
Nov 29 06:27:09 user nova-compute[75083]: </disk>
Nov 29 06:27:09 user nova-compute[75083]:  {{(pid=75083) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 06:27:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:27:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:27:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] No VIF found with MAC fa:16:3e:39:9c:77, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:27:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-f5abd1e1-b1dc-495a-b78c-41d473583e55 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.816s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:27:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "56410fac-1d60-4937-a585-18f99d6f5ad9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:27:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:27:27 user nova-compute[75083]: INFO nova.compute.manager [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Detaching volume 5a86ddc4-4619-4cbd-8579-a764ddbc4fac
Nov 29 06:27:27 user nova-compute[75083]: INFO nova.virt.block_device [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Attempting to driver detach volume 5a86ddc4-4619-4cbd-8579-a764ddbc4fac from mountpoint /dev/vdb
Nov 29 06:27:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Attempting to detach device vdb from instance 56410fac-1d60-4937-a585-18f99d6f5ad9 from the persistent domain config. {{(pid=75083) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 06:27:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:27:27 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:27:27 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:27:27 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:27:27 user nova-compute[75083]:   <serial>5a86ddc4-4619-4cbd-8579-a764ddbc4fac</serial>
Nov 29 06:27:27 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:27:27 user nova-compute[75083]: </disk>
Nov 29 06:27:27 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:27:27 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Successfully detached device vdb from instance 56410fac-1d60-4937-a585-18f99d6f5ad9 from the persistent domain config.
Nov 29 06:27:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 56410fac-1d60-4937-a585-18f99d6f5ad9 from the live domain config. {{(pid=75083) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 06:27:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.guest [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 06:27:27 user nova-compute[75083]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:27:27 user nova-compute[75083]:   <source dev="/dev/sdb"/>
Nov 29 06:27:27 user nova-compute[75083]:   <target dev="vdb" bus="virtio"/>
Nov 29 06:27:27 user nova-compute[75083]:   <serial>5a86ddc4-4619-4cbd-8579-a764ddbc4fac</serial>
Nov 29 06:27:27 user nova-compute[75083]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 06:27:27 user nova-compute[75083]: </disk>
Nov 29 06:27:27 user nova-compute[75083]:  {{(pid=75083) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 06:27:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "56410fac-1d60-4937-a585-18f99d6f5ad9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:27:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 56410fac-1d60-4937-a585-18f99d6f5ad9 {{(pid=75083) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 06:27:30 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:27:30 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:27:30 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:27:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:27:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:33 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:27:33 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 06:27:33 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] There are 0 instances to clean {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 06:27:34 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:27:34 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:27:34 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:27:34 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Skipping network cache update for instance because it is being deleted. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 29 06:27:34 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 06:27:34 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:27:34 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:27:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:38 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:27:38 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:27:40 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:27:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:44 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:27:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:27:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:27:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:27:44 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:27:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk --force-share --output=json {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:45 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:45 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:27:45 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:27:45 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=9035MB free_disk=25.06639862060547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:27:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:27:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:27:45 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 56410fac-1d60-4937-a585-18f99d6f5ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:27:45 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:27:45 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:27:45 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing inventories for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 06:27:45 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Updating ProviderTree inventory for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 06:27:45 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Updating inventory in ProviderTree for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 06:27:45 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing aggregate associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, aggregates: None {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 06:27:45 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing trait associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, traits: HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 06:27:45 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:27:45 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:27:45 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:27:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:27:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:47 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:27:47 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75083) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 06:27:47 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 56410fac-1d60-4937-a585-18f99d6f5ad9 is timed out.
Nov 29 06:27:48 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Successfully detached device vdb from instance 56410fac-1d60-4937-a585-18f99d6f5ad9 from the live domain config.
Nov 29 06:27:48 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sFhKYxBC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:27:48 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:27:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be2d9c3-091a-4a64-808a-4813ee50efda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:27:48 user nova-compute[75083]: No targets found.
Nov 29 06:27:48 user nova-compute[75083]: iSNS:
Nov 29 06:27:48 user nova-compute[75083]: No targets found.
Nov 29 06:27:48 user nova-compute[75083]: STATIC:
Nov 29 06:27:48 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac
Nov 29 06:27:48 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:27:48 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:27:48 user nova-compute[75083]: FIRMWARE:
Nov 29 06:27:48 user nova-compute[75083]: No targets found.
Nov 29 06:27:48 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:27:48 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:27:48 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e859dc93-8b40-4339-a62c-a4ac67011a87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccd8fc1-a31a-4906-b6c3-e705ce9346a2]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac (non-flash)
Nov 29 06:27:48 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac (non-flash)
Nov 29 06:27:48 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b83e6710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3174bf7d-970c-4aea-b3c5-423578373e86]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c069f75a-dde3-45e4-a493-6a6c5e6154f5]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0965a35d-5c93-4823-bef3-544a42223b81]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95661d6-1201-4816-9ee2-02acba46c142]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26ae39e-28c7-4c20-b00b-4b86cc02be83]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeea436f-9bde-4442-91a2-e7d1f953593c]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac, portal: 172.16.0.220,3260]
Nov 29 06:27:48 user nova-compute[75083]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac, portal: 172.16.0.220,3260] successful.
Nov 29 06:27:48 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edbe320-293b-442a-a389-584be41d35e6]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] <== disconnect_volume: return (300ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:27:48 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG nova.objects.instance [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lazy-loading 'flavor' on Instance uuid 56410fac-1d60-4937-a585-18f99d6f5ad9 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-b79ab463-1792-4594-a51d-eedddfad170e tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.637s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.522s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:27:49 user nova-compute[75083]: INFO nova.compute.manager [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Terminating instance
Nov 29 06:27:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG nova.compute.manager [req-0bd7fb35-5c57-43aa-a94a-7efdd9a6fbf2 req-05c76ec9-ad09-4402-bea9-1dddc8184058 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Received event network-vif-unplugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0bd7fb35-5c57-43aa-a94a-7efdd9a6fbf2 req-05c76ec9-ad09-4402-bea9-1dddc8184058 service nova] Acquiring lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0bd7fb35-5c57-43aa-a94a-7efdd9a6fbf2 req-05c76ec9-ad09-4402-bea9-1dddc8184058 service nova] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0bd7fb35-5c57-43aa-a94a-7efdd9a6fbf2 req-05c76ec9-ad09-4402-bea9-1dddc8184058 service nova] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG nova.compute.manager [req-0bd7fb35-5c57-43aa-a94a-7efdd9a6fbf2 req-05c76ec9-ad09-4402-bea9-1dddc8184058 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] No waiting events found dispatching network-vif-unplugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG nova.compute.manager [req-0bd7fb35-5c57-43aa-a94a-7efdd9a6fbf2 req-05c76ec9-ad09-4402-bea9-1dddc8184058 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Received event network-vif-unplugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:49 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Instance destroyed successfully.
Nov 29 06:27:49 user nova-compute[75083]: DEBUG nova.objects.instance [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lazy-loading 'resources' on Instance uuid 56410fac-1d60-4937-a585-18f99d6f5ad9 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-4761725',display_name='tempest-VolumesSnapshotTestJSON-instance-4761725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-4761725',id=46,image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbipKqiS61LZtQqiAO66n1dFoMzslPVlMj+DIp4oJCWvXe80aU6h8IHRL97OUfhigDJj1eXtiTWO/Y5FZoFKnsIOXgsYa2uwV8IEW8F5a9pJcvLN98i8QOgfWn2FXX4nA==',key_name='tempest-keypair-2034371743',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:25:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a77ab7954dd9455f9025e026a8c0c1f0',ramdisk_id='',reservation_id='r-pia1ykvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c1e50f1-5043-4598-be6f-f50133dc7439',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-817468576',owner_user_name='tempest-VolumesSnapshotTestJSON-817468576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:25:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98533e90b5904b37b0cbcdd3a18cb15f',uuid=56410fac-1d60-4937-a585-18f99d6f5ad9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "address": "fa:16:3e:39:9c:77", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f3c862-0d", "ovs_interfaceid": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Converting VIF {"id": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "address": "fa:16:3e:39:9c:77", "network": {"id": "4c20e80c-b8cc-40ab-9ae5-8c29689f494b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1493207193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77ab7954dd9455f9025e026a8c0c1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f3c862-0d", "ovs_interfaceid": "15f3c862-0dca-4bd8-acde-02c7ba56bf43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:9c:77,bridge_name='br-int',has_traffic_filtering=True,id=15f3c862-0dca-4bd8-acde-02c7ba56bf43,network=Network(4c20e80c-b8cc-40ab-9ae5-8c29689f494b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f3c862-0d') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG os_vif [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:9c:77,bridge_name='br-int',has_traffic_filtering=True,id=15f3c862-0dca-4bd8-acde-02c7ba56bf43,network=Network(4c20e80c-b8cc-40ab-9ae5-8c29689f494b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f3c862-0d') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15f3c862-0d, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dabb9468-c816-4d30-84bc-4c5ab5923d7e) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:27:49 user nova-compute[75083]: INFO os_vif [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:9c:77,bridge_name='br-int',has_traffic_filtering=True,id=15f3c862-0dca-4bd8-acde-02c7ba56bf43,network=Network(4c20e80c-b8cc-40ab-9ae5-8c29689f494b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f3c862-0d')
Nov 29 06:27:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:5a86ddc4-4619-4cbd-8579-a764ddbc4fac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sFhKYxBC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:27:49 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:27:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[f4f2999c-c49a-4ca2-9e3b-932db849dc08]: Unexpected error while running command.
Nov 29 06:27:49 user nova-compute[75083]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 29 06:27:49 user nova-compute[75083]: Exit code: 21
Nov 29 06:27:49 user nova-compute[75083]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 29 06:27:49 user nova-compute[75083]: Stderr: '' {{(pid=86165) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 29 06:27:49 user nova-compute[75083]: Traceback (most recent call last):
Nov 29 06:27:49 user nova-compute[75083]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 29 06:27:49 user nova-compute[75083]:     ret = func(*f_args, **f_kwargs)
Nov 29 06:27:49 user nova-compute[75083]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 29 06:27:49 user nova-compute[75083]:     return func(*args, **kwargs)
Nov 29 06:27:49 user nova-compute[75083]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 29 06:27:49 user nova-compute[75083]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 29 06:27:49 user nova-compute[75083]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 29 06:27:49 user nova-compute[75083]:     return putils.execute(on_execute=on_execute,
Nov 29 06:27:49 user nova-compute[75083]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 29 06:27:49 user nova-compute[75083]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 29 06:27:49 user nova-compute[75083]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 29 06:27:49 user nova-compute[75083]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 29 06:27:49 user nova-compute[75083]: Exit code: 21
Nov 29 06:27:49 user nova-compute[75083]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 29 06:27:49 user nova-compute[75083]: Stderr: ''
Nov 29 06:27:49 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f2999c-c49a-4ca2-9e3b-932db849dc08]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 29 06:27:49 user nova-compute[75083]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 29 06:27:49 user nova-compute[75083]: Exit code: 21
Nov 29 06:27:49 user nova-compute[75083]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 29 06:27:49 user nova-compute[75083]: Stderr: ''
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 29 06:27:49 user nova-compute[75083]: ERROR os_brick.initiator.connectors.iscsi 
Nov 29 06:27:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75083) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.022s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] <== disconnect_volume: return (24ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:27:49 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Deleting instance files /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9_del
Nov 29 06:27:49 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Deletion of /opt/stack/data/nova/instances/56410fac-1d60-4937-a585-18f99d6f5ad9_del complete
Nov 29 06:27:49 user nova-compute[75083]: INFO nova.compute.manager [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 06:27:49 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:27:49 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:27:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:50 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:27:50 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Took 0.71 seconds to deallocate network for instance.
Nov 29 06:27:50 user nova-compute[75083]: DEBUG nova.compute.manager [req-35710427-8a4b-4c49-ab0b-6e8540097e85 req-b8900143-7fd6-474c-a5ed-a7f1c51a2614 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Received event network-vif-deleted-15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:27:50 user nova-compute[75083]: WARNING nova.volume.cinder [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Attachment 7559630c-f8fc-4eb0-b422-d604d5b00110 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7559630c-f8fc-4eb0-b422-d604d5b00110. (HTTP 404) (Request-ID: req-dbb1ea32-8f97-4b7f-8ba5-b46d4421a681)
Nov 29 06:27:50 user nova-compute[75083]: INFO nova.compute.manager [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Took 0.03 seconds to detach 1 volumes for instance.
Nov 29 06:27:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:27:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:27:50 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:27:50 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:27:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:27:50 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Deleted allocations for instance 56410fac-1d60-4937-a585-18f99d6f5ad9
Nov 29 06:27:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-610e5b6f-2d6a-4d3d-b555-eb4b10ce5c84 tempest-VolumesSnapshotTestJSON-817468576 tempest-VolumesSnapshotTestJSON-817468576-project-member] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.927s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG nova.compute.manager [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Received event network-vif-plugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] Acquiring lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG nova.compute.manager [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] No waiting events found dispatching network-vif-plugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:27:51 user nova-compute[75083]: WARNING nova.compute.manager [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Received unexpected event network-vif-plugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 for instance with vm_state deleted and task_state None.
Nov 29 06:27:51 user nova-compute[75083]: DEBUG nova.compute.manager [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Received event network-vif-plugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] Acquiring lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG nova.compute.manager [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] No waiting events found dispatching network-vif-plugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:27:51 user nova-compute[75083]: WARNING nova.compute.manager [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Received unexpected event network-vif-plugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 for instance with vm_state deleted and task_state None.
Nov 29 06:27:51 user nova-compute[75083]: DEBUG nova.compute.manager [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Received event network-vif-plugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] Acquiring lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG nova.compute.manager [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] No waiting events found dispatching network-vif-plugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:27:51 user nova-compute[75083]: WARNING nova.compute.manager [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Received unexpected event network-vif-plugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 for instance with vm_state deleted and task_state None.
Nov 29 06:27:51 user nova-compute[75083]: DEBUG nova.compute.manager [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Received event network-vif-unplugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] Acquiring lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG nova.compute.manager [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] No waiting events found dispatching network-vif-unplugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:27:51 user nova-compute[75083]: WARNING nova.compute.manager [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Received unexpected event network-vif-unplugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 for instance with vm_state deleted and task_state None.
Nov 29 06:27:51 user nova-compute[75083]: DEBUG nova.compute.manager [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Received event network-vif-plugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] Acquiring lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] Lock "56410fac-1d60-4937-a585-18f99d6f5ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:27:51 user nova-compute[75083]: DEBUG nova.compute.manager [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] No waiting events found dispatching network-vif-plugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:27:51 user nova-compute[75083]: WARNING nova.compute.manager [req-9489b8fd-8982-4b0b-b82e-a2a980e29307 req-9f789da9-9535-4d98-a560-d15976904be4 service nova] [instance: 56410fac-1d60-4937-a585-18f99d6f5ad9] Received unexpected event network-vif-plugged-15f3c862-0dca-4bd8-acde-02c7ba56bf43 for instance with vm_state deleted and task_state None.
Nov 29 06:27:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:27:55 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:27:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:27:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:27:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:27:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:27:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:27:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:28:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:28:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:28:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:28:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:28:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:28:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:28:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:28:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:28:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:28:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:28:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:28:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:28:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:28:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:28:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:28:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:28:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:28:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:28:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:28:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:28:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:28:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:28:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:28:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:28:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:28:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:28:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:28:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:28:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:28:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:28:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:28:30 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:28:32 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:28:32 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:28:34 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:28:34 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:28:34 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:28:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:28:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:28:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:28:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:28:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:28:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:28:36 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:28:36 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:28:36 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:28:36 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 06:28:38 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:28:39 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:28:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:28:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:28:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5006 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:28:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:28:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:28:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:28:41 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:28:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:28:45 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:28:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:28:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:28:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:28:45 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:28:45 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:28:45 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:28:45 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=9165MB free_disk=25.092727661132812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:28:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:28:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:28:46 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:28:46 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:28:46 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:28:46 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:28:46 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:28:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:28:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:28:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:28:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:28:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:28:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:28:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:28:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:28:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:28:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:29:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:29:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:29:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:29:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:29:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:29:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:29:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:29:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:29:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:29:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:29:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:29:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:29:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:31 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:29:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:34 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:29:34 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:29:34 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:29:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:35 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:29:36 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "308813dd-3fd9-488e-a9ee-971309762e99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:29:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "308813dd-3fd9-488e-a9ee-971309762e99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:29:37 user nova-compute[75083]: DEBUG nova.compute.manager [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:29:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:29:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:29:37 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:29:37 user nova-compute[75083]: INFO nova.compute.claims [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Claim successful on node user
Nov 29 06:29:38 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:29:38 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:29:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.181s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:29:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:29:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:29:38 user nova-compute[75083]: DEBUG nova.network.neutron [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:29:38 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:29:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:29:38 user nova-compute[75083]: DEBUG nova.policy [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73fd740b5fe248edad95bcc269eee750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a61afbdd47455bbaa044282feb7c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:29:38 user nova-compute[75083]: INFO nova.virt.block_device [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Booting with volume snapshot f6a06c26-83df-4e2d-b9a7-fc3ec4109573 at /dev/vda
Nov 29 06:29:38 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:29:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:29:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:29:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Skipping network cache update for instance because it is Building. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 06:29:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 06:29:38 user nova-compute[75083]: DEBUG nova.network.neutron [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Successfully created port: c292c21d-f51e-42b2-bd75-84a5c6e735c3 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:29:39 user nova-compute[75083]: DEBUG nova.network.neutron [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Successfully updated port: c292c21d-f51e-42b2-bd75-84a5c6e735c3 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:29:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "refresh_cache-308813dd-3fd9-488e-a9ee-971309762e99" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:29:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquired lock "refresh_cache-308813dd-3fd9-488e-a9ee-971309762e99" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:29:39 user nova-compute[75083]: DEBUG nova.network.neutron [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:29:39 user nova-compute[75083]: DEBUG nova.network.neutron [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:29:39 user nova-compute[75083]: DEBUG nova.compute.manager [req-ef3b1de7-b8ae-4dad-8f9e-436fe117ccce req-bfaee079-56d1-4b87-84d6-edb7dc48a16e service nova] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Received event network-changed-c292c21d-f51e-42b2-bd75-84a5c6e735c3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:29:39 user nova-compute[75083]: DEBUG nova.compute.manager [req-ef3b1de7-b8ae-4dad-8f9e-436fe117ccce req-bfaee079-56d1-4b87-84d6-edb7dc48a16e service nova] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Refreshing instance network info cache due to event network-changed-c292c21d-f51e-42b2-bd75-84a5c6e735c3. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:29:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ef3b1de7-b8ae-4dad-8f9e-436fe117ccce req-bfaee079-56d1-4b87-84d6-edb7dc48a16e service nova] Acquiring lock "refresh_cache-308813dd-3fd9-488e-a9ee-971309762e99" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:29:39 user nova-compute[75083]: DEBUG nova.network.neutron [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Updating instance_info_cache with network_info: [{"id": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "address": "fa:16:3e:be:2f:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc292c21d-f5", "ovs_interfaceid": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:29:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Releasing lock "refresh_cache-308813dd-3fd9-488e-a9ee-971309762e99" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:29:39 user nova-compute[75083]: DEBUG nova.compute.manager [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Instance network_info: |[{"id": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "address": "fa:16:3e:be:2f:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc292c21d-f5", "ovs_interfaceid": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:29:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ef3b1de7-b8ae-4dad-8f9e-436fe117ccce req-bfaee079-56d1-4b87-84d6-edb7dc48a16e service nova] Acquired lock "refresh_cache-308813dd-3fd9-488e-a9ee-971309762e99" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:29:39 user nova-compute[75083]: DEBUG nova.network.neutron [req-ef3b1de7-b8ae-4dad-8f9e-436fe117ccce req-bfaee079-56d1-4b87-84d6-edb7dc48a16e service nova] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Refreshing network info cache for port c292c21d-f51e-42b2-bd75-84a5c6e735c3 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:29:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:40 user nova-compute[75083]: DEBUG nova.network.neutron [req-ef3b1de7-b8ae-4dad-8f9e-436fe117ccce req-bfaee079-56d1-4b87-84d6-edb7dc48a16e service nova] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Updated VIF entry in instance network info cache for port c292c21d-f51e-42b2-bd75-84a5c6e735c3. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:29:40 user nova-compute[75083]: DEBUG nova.network.neutron [req-ef3b1de7-b8ae-4dad-8f9e-436fe117ccce req-bfaee079-56d1-4b87-84d6-edb7dc48a16e service nova] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Updating instance_info_cache with network_info: [{"id": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "address": "fa:16:3e:be:2f:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc292c21d-f5", "ovs_interfaceid": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:29:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ef3b1de7-b8ae-4dad-8f9e-436fe117ccce req-bfaee079-56d1-4b87-84d6-edb7dc48a16e service nova] Releasing lock "refresh_cache-308813dd-3fd9-488e-a9ee-971309762e99" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:29:40 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:29:40 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:29:41 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:42 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG os_brick.utils [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1c47a9-4779-452f-b708-c5934531168a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[93089bec-ac96-4ba4-8395-6df46b888b87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e727a822-b89a-4452-a912-210909a30386]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[929fe5cc-f999-4306-a20d-ee01e40b4a32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:29:44 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:29:44 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[466116ba-ca03-4897-ae54-7b08259b6e46]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG os_brick.utils [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Updating existing volume attachment record: 3f9fe1a0-2f7d-46e6-a595-50a7d29401c7 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:29:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:47 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:29:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:29:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:29:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:29:47 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:29:47 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:29:47 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:29:47 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=9156MB free_disk=25.08202362060547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:29:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:29:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:29:48 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 308813dd-3fd9-488e-a9ee-971309762e99 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:29:48 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:29:48 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:29:48 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:29:48 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:29:48 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:29:48 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:29:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:29:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:29:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:29:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:29:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:29:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.compute.manager [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:29:51 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Creating image(s)
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Did not create local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Ensure instance console log exists: /opt/stack/data/nova/instances/308813dd-3fd9-488e-a9ee-971309762e99/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Start _get_guest_xml network_info=[{"id": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "address": "fa:16:3e:be:2f:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc292c21d-f5", "ovs_interfaceid": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '3f9fe1a0-2f7d-46e6-a595-50a7d29401c7', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DupHGPjq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '308813dd-3fd9-488e-a9ee-971309762e99', 'attached_at': '', 'detached_at': '', 'volume_id': '78ac464c-426d-4876-8084-ca68c24ae9cb', 'serial': '78ac464c-426d-4876-8084-ca68c24ae9cb'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:29:51 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:29:51 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DupHGPjq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:29:51 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:29:51 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:29:51 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78137c9-8f89-468a-92a3-b06e4210ca06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:29:51 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[38294ea8-4ce0-41fe-83eb-b87eed6fd165]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb] added
Nov 29 06:29:51 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad83d99e-7995-4ec5-aa18-c2097a817162]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03d9b53-53c6-4d9a-8c74-10bf291b0a87]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DupHGPjq {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DupHGPjq" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1e6d77-d201-4e94-bcde-b39e45f44674]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DupHGPjq'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a70ce5f-230c-4e80-bcca-5b1dd00ad11b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5f9408-e5c1-421d-9262-8519ca610401]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 06:29:51 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 06:29:51 user nova-compute[75083]:  {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:29:51 user nova-compute[75083]: WARNING os_brick.initiator.connectors.iscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 06:29:51 user nova-compute[75083]: 
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d4317f-7ec2-4c71-a1b0-61fcc98ec82d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb, portal: 172.16.0.220,3260]
Nov 29 06:29:51 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb, portal: 172.16.0.220,3260] successful.
Nov 29 06:29:51 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bce4519-abe2-44a2-81c9-5736a87e1544]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab15b2fc-0261-4f0d-94e6-2d1d1ffd5bcf]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb (non-flash)
Nov 29 06:29:51 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb (non-flash)
Nov 29 06:29:51 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d120c5bf-437c-4f57-9bf5-a2cace0c8333]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DupHGPjq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:29:51 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23462636637326233', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462636637326233', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:29:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-793681596',display_name='tempest-TestVolumeBootPattern-server-793681596',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-793681596',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21a61afbdd47455bbaa044282feb7c47',ramdisk_id='',reservation_id='r-jw7q9rjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-46466774',owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:29:38Z,user_data=None,user_id='73fd740b5fe248edad95bcc269eee750',uuid=308813dd-3fd9-488e-a9ee-971309762e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "address": "fa:16:3e:be:2f:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc292c21d-f5", "ovs_interfaceid": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converting VIF {"id": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "address": "fa:16:3e:be:2f:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc292c21d-f5", "ovs_interfaceid": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:2f:aa,bridge_name='br-int',has_traffic_filtering=True,id=c292c21d-f51e-42b2-bd75-84a5c6e735c3,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc292c21d-f5') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG nova.objects.instance [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lazy-loading 'pci_devices' on Instance uuid 308813dd-3fd9-488e-a9ee-971309762e99 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:29:52 user nova-compute[75083]:   <uuid>308813dd-3fd9-488e-a9ee-971309762e99</uuid>
Nov 29 06:29:52 user nova-compute[75083]:   <name>instance-0000002f</name>
Nov 29 06:29:52 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:29:52 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:29:52 user nova-compute[75083]:   <metadata>
Nov 29 06:29:52 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:29:52 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:29:52 user nova-compute[75083]:       <nova:name>tempest-TestVolumeBootPattern-server-793681596</nova:name>
Nov 29 06:29:52 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:29:51</nova:creationTime>
Nov 29 06:29:52 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:29:52 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:29:52 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:29:52 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:29:52 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:29:52 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:29:52 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:29:52 user nova-compute[75083]:       <nova:owner>
Nov 29 06:29:52 user nova-compute[75083]:         <nova:user uuid="73fd740b5fe248edad95bcc269eee750">tempest-TestVolumeBootPattern-46466774-project-member</nova:user>
Nov 29 06:29:52 user nova-compute[75083]:         <nova:project uuid="21a61afbdd47455bbaa044282feb7c47">tempest-TestVolumeBootPattern-46466774</nova:project>
Nov 29 06:29:52 user nova-compute[75083]:       </nova:owner>
Nov 29 06:29:52 user nova-compute[75083]:       <nova:ports>
Nov 29 06:29:52 user nova-compute[75083]:         <nova:port uuid="c292c21d-f51e-42b2-bd75-84a5c6e735c3">
Nov 29 06:29:52 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 06:29:52 user nova-compute[75083]:         </nova:port>
Nov 29 06:29:52 user nova-compute[75083]:       </nova:ports>
Nov 29 06:29:52 user nova-compute[75083]:     </nova:instance>
Nov 29 06:29:52 user nova-compute[75083]:   </metadata>
Nov 29 06:29:52 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:29:52 user nova-compute[75083]:     <system>
Nov 29 06:29:52 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:29:52 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:29:52 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:29:52 user nova-compute[75083]:       <entry name="serial">308813dd-3fd9-488e-a9ee-971309762e99</entry>
Nov 29 06:29:52 user nova-compute[75083]:       <entry name="uuid">308813dd-3fd9-488e-a9ee-971309762e99</entry>
Nov 29 06:29:52 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:29:52 user nova-compute[75083]:     </system>
Nov 29 06:29:52 user nova-compute[75083]:   </sysinfo>
Nov 29 06:29:52 user nova-compute[75083]:   <os>
Nov 29 06:29:52 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:29:52 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:29:52 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:29:52 user nova-compute[75083]:   </os>
Nov 29 06:29:52 user nova-compute[75083]:   <features>
Nov 29 06:29:52 user nova-compute[75083]:     <acpi/>
Nov 29 06:29:52 user nova-compute[75083]:     <apic/>
Nov 29 06:29:52 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:29:52 user nova-compute[75083]:   </features>
Nov 29 06:29:52 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:29:52 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:29:52 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:29:52 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:29:52 user nova-compute[75083]:   </clock>
Nov 29 06:29:52 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:29:52 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:29:52 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:29:52 user nova-compute[75083]:   </cpu>
Nov 29 06:29:52 user nova-compute[75083]:   <devices>
Nov 29 06:29:52 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 06:29:52 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:29:52 user nova-compute[75083]:       <source dev="/dev/sdb"/>
Nov 29 06:29:52 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:29:52 user nova-compute[75083]:       <serial>78ac464c-426d-4876-8084-ca68c24ae9cb</serial>
Nov 29 06:29:52 user nova-compute[75083]:     </disk>
Nov 29 06:29:52 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:29:52 user nova-compute[75083]:       <mac address="fa:16:3e:be:2f:aa"/>
Nov 29 06:29:52 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:29:52 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:29:52 user nova-compute[75083]:       <target dev="tapc292c21d-f5"/>
Nov 29 06:29:52 user nova-compute[75083]:     </interface>
Nov 29 06:29:52 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:29:52 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/308813dd-3fd9-488e-a9ee-971309762e99/console.log" append="off"/>
Nov 29 06:29:52 user nova-compute[75083]:     </serial>
Nov 29 06:29:52 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:29:52 user nova-compute[75083]:     <video>
Nov 29 06:29:52 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:29:52 user nova-compute[75083]:     </video>
Nov 29 06:29:52 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:29:52 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:29:52 user nova-compute[75083]:     </rng>
Nov 29 06:29:52 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:29:52 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:29:52 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:29:52 user nova-compute[75083]:     </memballoon>
Nov 29 06:29:52 user nova-compute[75083]:   </devices>
Nov 29 06:29:52 user nova-compute[75083]: </domain>
Nov 29 06:29:52 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:29:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-793681596',display_name='tempest-TestVolumeBootPattern-server-793681596',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-793681596',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21a61afbdd47455bbaa044282feb7c47',ramdisk_id='',reservation_id='r-jw7q9rjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-46466774',owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:29:38Z,user_data=None,user_id='73fd740b5fe248edad95bcc269eee750',uuid=308813dd-3fd9-488e-a9ee-971309762e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "address": "fa:16:3e:be:2f:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc292c21d-f5", "ovs_interfaceid": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converting VIF {"id": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "address": "fa:16:3e:be:2f:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc292c21d-f5", "ovs_interfaceid": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:2f:aa,bridge_name='br-int',has_traffic_filtering=True,id=c292c21d-f51e-42b2-bd75-84a5c6e735c3,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc292c21d-f5') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG os_vif [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:2f:aa,bridge_name='br-int',has_traffic_filtering=True,id=c292c21d-f51e-42b2-bd75-84a5c6e735c3,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc292c21d-f5') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a397cbc4-822e-5056-a431-6b0a312e38e7', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc292c21d-f5, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc292c21d-f5, col_values=(('qos', UUID('7f0cf715-0f3e-486a-aae3-88ee4a0a05b5')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc292c21d-f5, col_values=(('external_ids', {'iface-id': 'c292c21d-f51e-42b2-bd75-84a5c6e735c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:2f:aa', 'vm-uuid': '308813dd-3fd9-488e-a9ee-971309762e99'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:52 user nova-compute[75083]: INFO os_vif [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:2f:aa,bridge_name='br-int',has_traffic_filtering=True,id=c292c21d-f51e-42b2-bd75-84a5c6e735c3,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc292c21d-f5')
Nov 29 06:29:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:29:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] No VIF found with MAC fa:16:3e:be:2f:aa, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:29:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:54 user nova-compute[75083]: DEBUG nova.compute.manager [req-82149934-b6b1-41f3-ae79-359c70ed1838 req-0a81340d-8c1f-4afa-ad3b-f643bff3deb9 service nova] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Received event network-vif-plugged-c292c21d-f51e-42b2-bd75-84a5c6e735c3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:29:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-82149934-b6b1-41f3-ae79-359c70ed1838 req-0a81340d-8c1f-4afa-ad3b-f643bff3deb9 service nova] Acquiring lock "308813dd-3fd9-488e-a9ee-971309762e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:29:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-82149934-b6b1-41f3-ae79-359c70ed1838 req-0a81340d-8c1f-4afa-ad3b-f643bff3deb9 service nova] Lock "308813dd-3fd9-488e-a9ee-971309762e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:29:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-82149934-b6b1-41f3-ae79-359c70ed1838 req-0a81340d-8c1f-4afa-ad3b-f643bff3deb9 service nova] Lock "308813dd-3fd9-488e-a9ee-971309762e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:29:54 user nova-compute[75083]: DEBUG nova.compute.manager [req-82149934-b6b1-41f3-ae79-359c70ed1838 req-0a81340d-8c1f-4afa-ad3b-f643bff3deb9 service nova] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] No waiting events found dispatching network-vif-plugged-c292c21d-f51e-42b2-bd75-84a5c6e735c3 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:29:54 user nova-compute[75083]: WARNING nova.compute.manager [req-82149934-b6b1-41f3-ae79-359c70ed1838 req-0a81340d-8c1f-4afa-ad3b-f643bff3deb9 service nova] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Received unexpected event network-vif-plugged-c292c21d-f51e-42b2-bd75-84a5c6e735c3 for instance with vm_state building and task_state spawning.
Nov 29 06:29:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:56 user nova-compute[75083]: DEBUG nova.compute.manager [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:29:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:29:56 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Instance spawned successfully.
Nov 29 06:29:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:29:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:29:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:29:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:29:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:29:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:29:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:29:56 user nova-compute[75083]: INFO nova.compute.manager [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Took 4.84 seconds to spawn the instance on the hypervisor.
Nov 29 06:29:56 user nova-compute[75083]: DEBUG nova.compute.manager [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:29:56 user nova-compute[75083]: INFO nova.compute.manager [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Took 18.28 seconds to build instance.
Nov 29 06:29:56 user nova-compute[75083]: DEBUG nova.compute.manager [req-11f7b328-4d56-48cf-9e47-910c2a6f8b7f req-2e6c8ccd-46e6-4cd6-9c31-e6c92562f0ae service nova] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Received event network-vif-plugged-c292c21d-f51e-42b2-bd75-84a5c6e735c3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:29:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-11f7b328-4d56-48cf-9e47-910c2a6f8b7f req-2e6c8ccd-46e6-4cd6-9c31-e6c92562f0ae service nova] Acquiring lock "308813dd-3fd9-488e-a9ee-971309762e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:29:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-11f7b328-4d56-48cf-9e47-910c2a6f8b7f req-2e6c8ccd-46e6-4cd6-9c31-e6c92562f0ae service nova] Lock "308813dd-3fd9-488e-a9ee-971309762e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:29:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-11f7b328-4d56-48cf-9e47-910c2a6f8b7f req-2e6c8ccd-46e6-4cd6-9c31-e6c92562f0ae service nova] Lock "308813dd-3fd9-488e-a9ee-971309762e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:29:56 user nova-compute[75083]: DEBUG nova.compute.manager [req-11f7b328-4d56-48cf-9e47-910c2a6f8b7f req-2e6c8ccd-46e6-4cd6-9c31-e6c92562f0ae service nova] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] No waiting events found dispatching network-vif-plugged-c292c21d-f51e-42b2-bd75-84a5c6e735c3 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:29:56 user nova-compute[75083]: WARNING nova.compute.manager [req-11f7b328-4d56-48cf-9e47-910c2a6f8b7f req-2e6c8ccd-46e6-4cd6-9c31-e6c92562f0ae service nova] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Received unexpected event network-vif-plugged-c292c21d-f51e-42b2-bd75-84a5c6e735c3 for instance with vm_state active and task_state None.
Nov 29 06:29:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-54c514b1-81b0-4dfb-8237-7b228d16b5ed tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "308813dd-3fd9-488e-a9ee-971309762e99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.376s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:29:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:29:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:30:01 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:30:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:30:07 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:30:11 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:30:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:30:16 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:30:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:30:21 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:30:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:30:26 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:30:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:30:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:30:32 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:30:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:30:35 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:30:36 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:30:36 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:30:37 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:30:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:30:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:30:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:30:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:30:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:30:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:30:39 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:30:39 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:30:39 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:30:39 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:30:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-308813dd-3fd9-488e-a9ee-971309762e99" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:30:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-308813dd-3fd9-488e-a9ee-971309762e99" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:30:39 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:30:39 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lazy-loading 'info_cache' on Instance uuid 308813dd-3fd9-488e-a9ee-971309762e99 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:30:40 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Updating instance_info_cache with network_info: [{"id": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "address": "fa:16:3e:be:2f:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc292c21d-f5", "ovs_interfaceid": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:30:40 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-308813dd-3fd9-488e-a9ee-971309762e99" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:30:40 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:30:40 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:30:40 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:30:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:30:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:30:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:30:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:30:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:30:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:30:43 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:30:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:30:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:30:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:30:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:30:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:30:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:30:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:30:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:30:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:30:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:30:49 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:30:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:30:50 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:30:50 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:30:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=25.080615997314453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:30:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:30:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:30:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 308813dd-3fd9-488e-a9ee-971309762e99 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:30:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:30:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:30:50 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:30:50 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:30:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:30:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:30:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:30:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:30:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:30:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:30:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:30:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:30:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:31:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:31:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:31:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:31:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:31:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:31:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:31:07 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:31:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:31:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:31:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:31:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:31:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "308813dd-3fd9-488e-a9ee-971309762e99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:31:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "308813dd-3fd9-488e-a9ee-971309762e99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:31:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "308813dd-3fd9-488e-a9ee-971309762e99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:31:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "308813dd-3fd9-488e-a9ee-971309762e99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:31:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "308813dd-3fd9-488e-a9ee-971309762e99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:31:28 user nova-compute[75083]: INFO nova.compute.manager [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Terminating instance
Nov 29 06:31:28 user nova-compute[75083]: DEBUG nova.compute.manager [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:31:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:31:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:31:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:31:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:31:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-9ab9ac1c-c62c-4aa1-8f6e-82c3a9e0553f req-ff000fe6-701f-4281-b35a-ff89954b74fd service nova] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Received event network-vif-unplugged-c292c21d-f51e-42b2-bd75-84a5c6e735c3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:31:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9ab9ac1c-c62c-4aa1-8f6e-82c3a9e0553f req-ff000fe6-701f-4281-b35a-ff89954b74fd service nova] Acquiring lock "308813dd-3fd9-488e-a9ee-971309762e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:31:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9ab9ac1c-c62c-4aa1-8f6e-82c3a9e0553f req-ff000fe6-701f-4281-b35a-ff89954b74fd service nova] Lock "308813dd-3fd9-488e-a9ee-971309762e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:31:28 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9ab9ac1c-c62c-4aa1-8f6e-82c3a9e0553f req-ff000fe6-701f-4281-b35a-ff89954b74fd service nova] Lock "308813dd-3fd9-488e-a9ee-971309762e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:31:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-9ab9ac1c-c62c-4aa1-8f6e-82c3a9e0553f req-ff000fe6-701f-4281-b35a-ff89954b74fd service nova] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] No waiting events found dispatching network-vif-unplugged-c292c21d-f51e-42b2-bd75-84a5c6e735c3 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:31:28 user nova-compute[75083]: DEBUG nova.compute.manager [req-9ab9ac1c-c62c-4aa1-8f6e-82c3a9e0553f req-ff000fe6-701f-4281-b35a-ff89954b74fd service nova] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Received event network-vif-unplugged-c292c21d-f51e-42b2-bd75-84a5c6e735c3 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:31:29 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Instance destroyed successfully.
Nov 29 06:31:29 user nova-compute[75083]: DEBUG nova.objects.instance [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lazy-loading 'resources' on Instance uuid 308813dd-3fd9-488e-a9ee-971309762e99 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:29:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-793681596',display_name='tempest-TestVolumeBootPattern-server-793681596',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-793681596',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:29:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21a61afbdd47455bbaa044282feb7c47',ramdisk_id='',reservation_id='r-jw7q9rjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-46466774',owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:29:56Z,user_data=None,user_id='73fd740b5fe248edad95bcc269eee750',uuid=308813dd-3fd9-488e-a9ee-971309762e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "address": "fa:16:3e:be:2f:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc292c21d-f5", "ovs_interfaceid": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converting VIF {"id": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "address": "fa:16:3e:be:2f:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc292c21d-f5", "ovs_interfaceid": "c292c21d-f51e-42b2-bd75-84a5c6e735c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:2f:aa,bridge_name='br-int',has_traffic_filtering=True,id=c292c21d-f51e-42b2-bd75-84a5c6e735c3,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc292c21d-f5') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_vif [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:2f:aa,bridge_name='br-int',has_traffic_filtering=True,id=c292c21d-f51e-42b2-bd75-84a5c6e735c3,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc292c21d-f5') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc292c21d-f5, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f0cf715-0f3e-486a-aae3-88ee4a0a05b5) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:31:29 user nova-compute[75083]: INFO os_vif [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:2f:aa,bridge_name='br-int',has_traffic_filtering=True,id=c292c21d-f51e-42b2-bd75-84a5c6e735c3,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc292c21d-f5')
Nov 29 06:31:29 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DupHGPjq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:31:29 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7c728f-b91b-4178-ab27-aba5ec8eba13]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:31:29 user nova-compute[75083]: No targets found.
Nov 29 06:31:29 user nova-compute[75083]: iSNS:
Nov 29 06:31:29 user nova-compute[75083]: No targets found.
Nov 29 06:31:29 user nova-compute[75083]: STATIC:
Nov 29 06:31:29 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb
Nov 29 06:31:29 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:31:29 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:31:29 user nova-compute[75083]: FIRMWARE:
Nov 29 06:31:29 user nova-compute[75083]: No targets found.
Nov 29 06:31:29 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:31:29 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:31:29 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b4370b-7885-4711-86fa-f4ff2eb8eb5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb7f3aa-6b96-4e65-b58f-8fee4ab65082]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb (non-flash)
Nov 29 06:31:29 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb (non-flash)
Nov 29 06:31:29 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b80fe7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[944f83a6-7beb-4596-bff5-6cc181cf6239]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92d8211-7c72-403a-b3ba-a6b9c246abcc]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[758979be-f6ef-4f5f-9a3d-1e4d29b22bc2]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbd7bf0-6b06-4c7e-8382-b0ad0cdae83c]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb819e71a-4bcf72b3e0d4c10f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b819e71a', '/dev/disk/by-id/scsi-23462636637326233') {{(pid=86165) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba94fadf-0c4c-4996-bf04-c73a466d60bf]: (4, None) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4df52e-7480-46b5-beb1-0f9ec011ce24]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6f3979-3b60-4893-b61d-cd574b119b00]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb, portal: 172.16.0.220,3260]
Nov 29 06:31:29 user nova-compute[75083]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb, portal: 172.16.0.220,3260] successful.
Nov 29 06:31:29 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ac464c-426d-4876-8084-ca68c24ae9cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8affffe9-93c9-4a38-b52d-3887b272b799]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] <== disconnect_volume: return (300ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:31:29 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Deleting instance files /opt/stack/data/nova/instances/308813dd-3fd9-488e-a9ee-971309762e99_del
Nov 29 06:31:29 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Deletion of /opt/stack/data/nova/instances/308813dd-3fd9-488e-a9ee-971309762e99_del complete
Nov 29 06:31:29 user nova-compute[75083]: INFO nova.compute.manager [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 29 06:31:29 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:31:29 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:31:30 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:31:30 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Took 0.45 seconds to deallocate network for instance.
Nov 29 06:31:30 user nova-compute[75083]: DEBUG nova.compute.manager [req-0a6a392b-3049-4517-a3e5-8c211e0616f3 req-f6db1d6f-bd0c-4b49-97e4-5725339c916e service nova] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Received event network-vif-deleted-c292c21d-f51e-42b2-bd75-84a5c6e735c3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:31:30 user nova-compute[75083]: INFO nova.compute.manager [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Took 0.74 seconds to detach 1 volumes for instance.
Nov 29 06:31:31 user nova-compute[75083]: DEBUG nova.compute.manager [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Deleting volume: 78ac464c-426d-4876-8084-ca68c24ae9cb {{(pid=75083) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 06:31:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-0eb0ebcd-8036-4d37-827b-57255b3f5024 req-3a9c4101-6247-47d8-b61c-2024e056b26e service nova] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Received event network-vif-plugged-c292c21d-f51e-42b2-bd75-84a5c6e735c3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:31:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0eb0ebcd-8036-4d37-827b-57255b3f5024 req-3a9c4101-6247-47d8-b61c-2024e056b26e service nova] Acquiring lock "308813dd-3fd9-488e-a9ee-971309762e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:31:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0eb0ebcd-8036-4d37-827b-57255b3f5024 req-3a9c4101-6247-47d8-b61c-2024e056b26e service nova] Lock "308813dd-3fd9-488e-a9ee-971309762e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:31:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0eb0ebcd-8036-4d37-827b-57255b3f5024 req-3a9c4101-6247-47d8-b61c-2024e056b26e service nova] Lock "308813dd-3fd9-488e-a9ee-971309762e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:31:31 user nova-compute[75083]: DEBUG nova.compute.manager [req-0eb0ebcd-8036-4d37-827b-57255b3f5024 req-3a9c4101-6247-47d8-b61c-2024e056b26e service nova] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] No waiting events found dispatching network-vif-plugged-c292c21d-f51e-42b2-bd75-84a5c6e735c3 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:31:31 user nova-compute[75083]: WARNING nova.compute.manager [req-0eb0ebcd-8036-4d37-827b-57255b3f5024 req-3a9c4101-6247-47d8-b61c-2024e056b26e service nova] [instance: 308813dd-3fd9-488e-a9ee-971309762e99] Received unexpected event network-vif-plugged-c292c21d-f51e-42b2-bd75-84a5c6e735c3 for instance with vm_state active and task_state deleting.
Nov 29 06:31:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:31:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:31:31 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:31:31 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:31:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:31:31 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Deleted allocations for instance 308813dd-3fd9-488e-a9ee-971309762e99
Nov 29 06:31:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-17eb7099-d9a6-4b4a-ade8-8dabb9d6a30e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "308813dd-3fd9-488e-a9ee-971309762e99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.756s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:31:33 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:31:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:31:35 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:31:37 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:31:37 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:31:37 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:31:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:31:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:31:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:31:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:31:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:31:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:31:40 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:31:40 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:31:40 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:31:40 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 06:31:41 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:31:42 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:31:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:31:44 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:31:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:31:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:31:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:31:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:31:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:31:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:31:50 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:31:50 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:31:50 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=9141MB free_disk=25.07984161376953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:31:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:31:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:31:51 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:31:51 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:31:51 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:31:51 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:31:51 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:31:51 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:31:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:31:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:32:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:32:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:32:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:32:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:32:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:32:31 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:34 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:32:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:32:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:32:34 user nova-compute[75083]: DEBUG nova.compute.manager [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:32:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:32:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:32:34 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:32:34 user nova-compute[75083]: INFO nova.compute.claims [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Claim successful on node user
Nov 29 06:32:34 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:32:34 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:32:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:32:34 user nova-compute[75083]: DEBUG nova.compute.manager [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:32:34 user nova-compute[75083]: DEBUG nova.compute.manager [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:32:34 user nova-compute[75083]: DEBUG nova.network.neutron [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:32:34 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:32:34 user nova-compute[75083]: DEBUG nova.compute.manager [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:32:34 user nova-compute[75083]: INFO nova.virt.block_device [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Booting with volume f747894e-b1c9-4817-85dd-4c6dfebd934e at /dev/vda
Nov 29 06:32:34 user nova-compute[75083]: DEBUG os_brick.utils [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:32:34 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d9264e-b3bf-4001-aca1-fb0055b29ae4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6b0f52-fc17-4c0e-b0d7-a65cf01b64ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[740a2c7e-14ba-4151-b898-3d4900a0b8aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4538d0d-c189-451f-a10c-40774db87ec6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:32:35 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:32:35 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[731dac23-9f25-4d60-b6dc-d5e8103b1a15]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG os_brick.utils [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Updating existing volume attachment record: eebd76c9-ab96-401c-a036-910036868b4c {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG nova.policy [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73fd740b5fe248edad95bcc269eee750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a61afbdd47455bbaa044282feb7c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 06:32:35 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] There are 0 instances to clean {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 06:32:36 user nova-compute[75083]: DEBUG nova.network.neutron [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Successfully created port: 3a328c35-d862-44c8-9221-cbfe4882cda3 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:32:36 user nova-compute[75083]: DEBUG nova.network.neutron [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Successfully updated port: 3a328c35-d862-44c8-9221-cbfe4882cda3 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:32:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "refresh_cache-e1efac0d-5102-4fc6-b61e-a7f9fd898956" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:32:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquired lock "refresh_cache-e1efac0d-5102-4fc6-b61e-a7f9fd898956" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:32:36 user nova-compute[75083]: DEBUG nova.network.neutron [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:32:36 user nova-compute[75083]: DEBUG nova.compute.manager [req-180fb4b6-8510-4011-8994-e4d89d4f9e28 req-0d74e02f-fcbf-460e-bc9b-926307e0957b service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Received event network-changed-3a328c35-d862-44c8-9221-cbfe4882cda3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:32:36 user nova-compute[75083]: DEBUG nova.compute.manager [req-180fb4b6-8510-4011-8994-e4d89d4f9e28 req-0d74e02f-fcbf-460e-bc9b-926307e0957b service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Refreshing instance network info cache due to event network-changed-3a328c35-d862-44c8-9221-cbfe4882cda3. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:32:36 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-180fb4b6-8510-4011-8994-e4d89d4f9e28 req-0d74e02f-fcbf-460e-bc9b-926307e0957b service nova] Acquiring lock "refresh_cache-e1efac0d-5102-4fc6-b61e-a7f9fd898956" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:32:36 user nova-compute[75083]: DEBUG nova.network.neutron [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:32:37 user nova-compute[75083]: DEBUG nova.network.neutron [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Updating instance_info_cache with network_info: [{"id": "3a328c35-d862-44c8-9221-cbfe4882cda3", "address": "fa:16:3e:bb:32:13", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a328c35-d8", "ovs_interfaceid": "3a328c35-d862-44c8-9221-cbfe4882cda3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:32:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Releasing lock "refresh_cache-e1efac0d-5102-4fc6-b61e-a7f9fd898956" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:32:37 user nova-compute[75083]: DEBUG nova.compute.manager [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Instance network_info: |[{"id": "3a328c35-d862-44c8-9221-cbfe4882cda3", "address": "fa:16:3e:bb:32:13", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a328c35-d8", "ovs_interfaceid": "3a328c35-d862-44c8-9221-cbfe4882cda3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:32:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-180fb4b6-8510-4011-8994-e4d89d4f9e28 req-0d74e02f-fcbf-460e-bc9b-926307e0957b service nova] Acquired lock "refresh_cache-e1efac0d-5102-4fc6-b61e-a7f9fd898956" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:32:37 user nova-compute[75083]: DEBUG nova.network.neutron [req-180fb4b6-8510-4011-8994-e4d89d4f9e28 req-0d74e02f-fcbf-460e-bc9b-926307e0957b service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Refreshing network info cache for port 3a328c35-d862-44c8-9221-cbfe4882cda3 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:32:37 user nova-compute[75083]: DEBUG nova.network.neutron [req-180fb4b6-8510-4011-8994-e4d89d4f9e28 req-0d74e02f-fcbf-460e-bc9b-926307e0957b service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Updated VIF entry in instance network info cache for port 3a328c35-d862-44c8-9221-cbfe4882cda3. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:32:37 user nova-compute[75083]: DEBUG nova.network.neutron [req-180fb4b6-8510-4011-8994-e4d89d4f9e28 req-0d74e02f-fcbf-460e-bc9b-926307e0957b service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Updating instance_info_cache with network_info: [{"id": "3a328c35-d862-44c8-9221-cbfe4882cda3", "address": "fa:16:3e:bb:32:13", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a328c35-d8", "ovs_interfaceid": "3a328c35-d862-44c8-9221-cbfe4882cda3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:32:37 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-180fb4b6-8510-4011-8994-e4d89d4f9e28 req-0d74e02f-fcbf-460e-bc9b-926307e0957b service nova] Releasing lock "refresh_cache-e1efac0d-5102-4fc6-b61e-a7f9fd898956" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:32:37 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:32:37 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:32:37 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:32:37 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:32:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:40 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.compute.manager [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:32:42 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Creating image(s)
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Did not create local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Ensure instance console log exists: /opt/stack/data/nova/instances/e1efac0d-5102-4fc6-b61e-a7f9fd898956/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Start _get_guest_xml network_info=[{"id": "3a328c35-d862-44c8-9221-cbfe4882cda3", "address": "fa:16:3e:bb:32:13", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a328c35-d8", "ovs_interfaceid": "3a328c35-d862-44c8-9221-cbfe4882cda3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'eebd76c9-ab96-401c-a036-910036868b4c', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oAOWHBqZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1efac0d-5102-4fc6-b61e-a7f9fd898956', 'attached_at': '', 'detached_at': '', 'volume_id': 'f747894e-b1c9-4817-85dd-4c6dfebd934e', 'serial': 'f747894e-b1c9-4817-85dd-4c6dfebd934e'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:32:42 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:32:42 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oAOWHBqZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:32:42 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:32:42 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:32:42 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4003ef9c-31d5-4b7a-a5d1-1633297a67e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:32:42 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[443dbce8-149c-4f8c-8560-f0cb1b104461]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e] added
Nov 29 06:32:42 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e16c9d8-354a-4231-8fd9-e6a2370c403b]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b14072-5a77-4b14-be14-4207102dc688]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oAOWHBqZ {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oAOWHBqZ" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[913e32ef-5e13-47b2-a783-f209246172cb]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oAOWHBqZ'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f03e1d-3b6f-45b6-9d62-753e11f5b8b3]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[398f41b2-aa98-4310-abac-fd475f1e4f91]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 06:32:42 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 06:32:42 user nova-compute[75083]:  {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:32:42 user nova-compute[75083]: WARNING os_brick.initiator.connectors.iscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 06:32:42 user nova-compute[75083]: 
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4248f4fa-34c6-4127-9eb0-42e5f967449c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e, portal: 172.16.0.220,3260]
Nov 29 06:32:42 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e, portal: 172.16.0.220,3260] successful.
Nov 29 06:32:42 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7bb261-0728-4f83-8ca2-2a6f6a852b0a]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[689ec7c9-6aa3-49e9-ab7b-7b6801cdf638]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e (non-flash)
Nov 29 06:32:42 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e (non-flash)
Nov 29 06:32:42 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[630a23f9-d049-4ae5-afa5-df3aee49b028]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Skipping network cache update for instance because it is Building. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 06:32:42 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oAOWHBqZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26136353630343131', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136353630343131', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:32:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1205398578',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1205398578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1205398578',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLnoHTZTJJ54SbyqS40NNfv51eYkQ1RFxGPR7GPSg7HvfKYndS0SettRdxakP2PssRPyNoYrX6Yh67+1c/W0lb1kTRJq79fp8Yg1wSJ0ObtjlWqUSDjUZkqfcC8qamxuw==',key_name='tempest-keypair-1508873525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21a61afbdd47455bbaa044282feb7c47',ramdisk_id='',reservation_id='r-r30edw9h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-46466774',owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:32:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fd740b5fe248edad95bcc269eee750',uuid=e1efac0d-5102-4fc6-b61e-a7f9fd898956,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a328c35-d862-44c8-9221-cbfe4882cda3", "address": "fa:16:3e:bb:32:13", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a328c35-d8", "ovs_interfaceid": "3a328c35-d862-44c8-9221-cbfe4882cda3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converting VIF {"id": "3a328c35-d862-44c8-9221-cbfe4882cda3", "address": "fa:16:3e:bb:32:13", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a328c35-d8", "ovs_interfaceid": "3a328c35-d862-44c8-9221-cbfe4882cda3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:32:13,bridge_name='br-int',has_traffic_filtering=True,id=3a328c35-d862-44c8-9221-cbfe4882cda3,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a328c35-d8') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG nova.objects.instance [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lazy-loading 'pci_devices' on Instance uuid e1efac0d-5102-4fc6-b61e-a7f9fd898956 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:32:43 user nova-compute[75083]:   <uuid>e1efac0d-5102-4fc6-b61e-a7f9fd898956</uuid>
Nov 29 06:32:43 user nova-compute[75083]:   <name>instance-00000030</name>
Nov 29 06:32:43 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:32:43 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:32:43 user nova-compute[75083]:   <metadata>
Nov 29 06:32:43 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:32:43 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:32:43 user nova-compute[75083]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1205398578</nova:name>
Nov 29 06:32:43 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:32:42</nova:creationTime>
Nov 29 06:32:43 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:32:43 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:32:43 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:32:43 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:32:43 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:32:43 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:32:43 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:32:43 user nova-compute[75083]:       <nova:owner>
Nov 29 06:32:43 user nova-compute[75083]:         <nova:user uuid="73fd740b5fe248edad95bcc269eee750">tempest-TestVolumeBootPattern-46466774-project-member</nova:user>
Nov 29 06:32:43 user nova-compute[75083]:         <nova:project uuid="21a61afbdd47455bbaa044282feb7c47">tempest-TestVolumeBootPattern-46466774</nova:project>
Nov 29 06:32:43 user nova-compute[75083]:       </nova:owner>
Nov 29 06:32:43 user nova-compute[75083]:       <nova:ports>
Nov 29 06:32:43 user nova-compute[75083]:         <nova:port uuid="3a328c35-d862-44c8-9221-cbfe4882cda3">
Nov 29 06:32:43 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 06:32:43 user nova-compute[75083]:         </nova:port>
Nov 29 06:32:43 user nova-compute[75083]:       </nova:ports>
Nov 29 06:32:43 user nova-compute[75083]:     </nova:instance>
Nov 29 06:32:43 user nova-compute[75083]:   </metadata>
Nov 29 06:32:43 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:32:43 user nova-compute[75083]:     <system>
Nov 29 06:32:43 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:32:43 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:32:43 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:32:43 user nova-compute[75083]:       <entry name="serial">e1efac0d-5102-4fc6-b61e-a7f9fd898956</entry>
Nov 29 06:32:43 user nova-compute[75083]:       <entry name="uuid">e1efac0d-5102-4fc6-b61e-a7f9fd898956</entry>
Nov 29 06:32:43 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:32:43 user nova-compute[75083]:     </system>
Nov 29 06:32:43 user nova-compute[75083]:   </sysinfo>
Nov 29 06:32:43 user nova-compute[75083]:   <os>
Nov 29 06:32:43 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:32:43 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:32:43 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:32:43 user nova-compute[75083]:   </os>
Nov 29 06:32:43 user nova-compute[75083]:   <features>
Nov 29 06:32:43 user nova-compute[75083]:     <acpi/>
Nov 29 06:32:43 user nova-compute[75083]:     <apic/>
Nov 29 06:32:43 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:32:43 user nova-compute[75083]:   </features>
Nov 29 06:32:43 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:32:43 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:32:43 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:32:43 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:32:43 user nova-compute[75083]:   </clock>
Nov 29 06:32:43 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:32:43 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:32:43 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:32:43 user nova-compute[75083]:   </cpu>
Nov 29 06:32:43 user nova-compute[75083]:   <devices>
Nov 29 06:32:43 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 06:32:43 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:32:43 user nova-compute[75083]:       <source dev="/dev/sdb"/>
Nov 29 06:32:43 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:32:43 user nova-compute[75083]:       <serial>f747894e-b1c9-4817-85dd-4c6dfebd934e</serial>
Nov 29 06:32:43 user nova-compute[75083]:     </disk>
Nov 29 06:32:43 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:32:43 user nova-compute[75083]:       <mac address="fa:16:3e:bb:32:13"/>
Nov 29 06:32:43 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:32:43 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:32:43 user nova-compute[75083]:       <target dev="tap3a328c35-d8"/>
Nov 29 06:32:43 user nova-compute[75083]:     </interface>
Nov 29 06:32:43 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:32:43 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/e1efac0d-5102-4fc6-b61e-a7f9fd898956/console.log" append="off"/>
Nov 29 06:32:43 user nova-compute[75083]:     </serial>
Nov 29 06:32:43 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:32:43 user nova-compute[75083]:     <video>
Nov 29 06:32:43 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:32:43 user nova-compute[75083]:     </video>
Nov 29 06:32:43 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:32:43 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:32:43 user nova-compute[75083]:     </rng>
Nov 29 06:32:43 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:32:43 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:32:43 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:32:43 user nova-compute[75083]:     </memballoon>
Nov 29 06:32:43 user nova-compute[75083]:   </devices>
Nov 29 06:32:43 user nova-compute[75083]: </domain>
Nov 29 06:32:43 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:32:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1205398578',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1205398578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1205398578',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLnoHTZTJJ54SbyqS40NNfv51eYkQ1RFxGPR7GPSg7HvfKYndS0SettRdxakP2PssRPyNoYrX6Yh67+1c/W0lb1kTRJq79fp8Yg1wSJ0ObtjlWqUSDjUZkqfcC8qamxuw==',key_name='tempest-keypair-1508873525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21a61afbdd47455bbaa044282feb7c47',ramdisk_id='',reservation_id='r-r30edw9h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-46466774',owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:32:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fd740b5fe248edad95bcc269eee750',uuid=e1efac0d-5102-4fc6-b61e-a7f9fd898956,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a328c35-d862-44c8-9221-cbfe4882cda3", "address": "fa:16:3e:bb:32:13", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a328c35-d8", "ovs_interfaceid": "3a328c35-d862-44c8-9221-cbfe4882cda3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converting VIF {"id": "3a328c35-d862-44c8-9221-cbfe4882cda3", "address": "fa:16:3e:bb:32:13", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a328c35-d8", "ovs_interfaceid": "3a328c35-d862-44c8-9221-cbfe4882cda3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:32:13,bridge_name='br-int',has_traffic_filtering=True,id=3a328c35-d862-44c8-9221-cbfe4882cda3,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a328c35-d8') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG os_vif [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:32:13,bridge_name='br-int',has_traffic_filtering=True,id=3a328c35-d862-44c8-9221-cbfe4882cda3,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a328c35-d8') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '123af2b9-448e-5014-aa6e-27b82b933fd8', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a328c35-d8, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a328c35-d8, col_values=(('qos', UUID('14072006-2fa8-4869-8fec-c13ea07cfaea')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a328c35-d8, col_values=(('external_ids', {'iface-id': '3a328c35-d862-44c8-9221-cbfe4882cda3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:32:13', 'vm-uuid': 'e1efac0d-5102-4fc6-b61e-a7f9fd898956'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:43 user nova-compute[75083]: INFO os_vif [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:32:13,bridge_name='br-int',has_traffic_filtering=True,id=3a328c35-d862-44c8-9221-cbfe4882cda3,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a328c35-d8')
Nov 29 06:32:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:32:43 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] No VIF found with MAC fa:16:3e:bb:32:13, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:32:44 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:32:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-f1834689-cd3c-416b-b1d9-82b69628b53a req-5586362b-ed7c-4576-9a3e-76294881518b service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Received event network-vif-plugged-3a328c35-d862-44c8-9221-cbfe4882cda3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:32:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f1834689-cd3c-416b-b1d9-82b69628b53a req-5586362b-ed7c-4576-9a3e-76294881518b service nova] Acquiring lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:32:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f1834689-cd3c-416b-b1d9-82b69628b53a req-5586362b-ed7c-4576-9a3e-76294881518b service nova] Lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:32:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f1834689-cd3c-416b-b1d9-82b69628b53a req-5586362b-ed7c-4576-9a3e-76294881518b service nova] Lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:32:45 user nova-compute[75083]: DEBUG nova.compute.manager [req-f1834689-cd3c-416b-b1d9-82b69628b53a req-5586362b-ed7c-4576-9a3e-76294881518b service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] No waiting events found dispatching network-vif-plugged-3a328c35-d862-44c8-9221-cbfe4882cda3 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:32:45 user nova-compute[75083]: WARNING nova.compute.manager [req-f1834689-cd3c-416b-b1d9-82b69628b53a req-5586362b-ed7c-4576-9a3e-76294881518b service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Received unexpected event network-vif-plugged-3a328c35-d862-44c8-9221-cbfe4882cda3 for instance with vm_state building and task_state spawning.
Nov 29 06:32:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:46 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:32:46 user nova-compute[75083]: DEBUG nova.compute.manager [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:32:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:32:46 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Instance spawned successfully.
Nov 29 06:32:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:32:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:32:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:32:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:32:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:32:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:32:46 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:32:46 user nova-compute[75083]: INFO nova.compute.manager [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Took 4.91 seconds to spawn the instance on the hypervisor.
Nov 29 06:32:46 user nova-compute[75083]: DEBUG nova.compute.manager [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:32:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:47 user nova-compute[75083]: INFO nova.compute.manager [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Took 12.61 seconds to build instance.
Nov 29 06:32:47 user nova-compute[75083]: DEBUG nova.compute.manager [req-dc9c22b0-d469-4a29-9eae-9107bd2f71b7 req-629d6414-239e-4135-8a3f-070d7420663b service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Received event network-vif-plugged-3a328c35-d862-44c8-9221-cbfe4882cda3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:32:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-dc9c22b0-d469-4a29-9eae-9107bd2f71b7 req-629d6414-239e-4135-8a3f-070d7420663b service nova] Acquiring lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:32:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-dc9c22b0-d469-4a29-9eae-9107bd2f71b7 req-629d6414-239e-4135-8a3f-070d7420663b service nova] Lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:32:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-dc9c22b0-d469-4a29-9eae-9107bd2f71b7 req-629d6414-239e-4135-8a3f-070d7420663b service nova] Lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:32:47 user nova-compute[75083]: DEBUG nova.compute.manager [req-dc9c22b0-d469-4a29-9eae-9107bd2f71b7 req-629d6414-239e-4135-8a3f-070d7420663b service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] No waiting events found dispatching network-vif-plugged-3a328c35-d862-44c8-9221-cbfe4882cda3 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:32:47 user nova-compute[75083]: WARNING nova.compute.manager [req-dc9c22b0-d469-4a29-9eae-9107bd2f71b7 req-629d6414-239e-4135-8a3f-070d7420663b service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Received unexpected event network-vif-plugged-3a328c35-d862-44c8-9221-cbfe4882cda3 for instance with vm_state active and task_state None.
Nov 29 06:32:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-de48a25e-7bbc-4aaa-9853-97e0861384f2 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.740s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:32:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:52 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:32:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:32:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:32:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:32:52 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:32:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:32:52 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:32:52 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:32:52 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=9078MB free_disk=25.077877044677734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:32:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:32:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:32:53 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance e1efac0d-5102-4fc6-b61e-a7f9fd898956 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:32:53 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:32:53 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:32:53 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing inventories for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 06:32:53 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Updating ProviderTree inventory for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 06:32:53 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Updating inventory in ProviderTree for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 06:32:53 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing aggregate associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, aggregates: None {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 06:32:53 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing trait associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, traits: HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 06:32:53 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:32:53 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:32:53 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:32:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:32:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:32:58 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:32:58 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75083) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 06:33:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:33:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:33:07 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:33:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:33:09 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:33:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:33:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:33:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:33:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:33:21 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:33:21 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid e1efac0d-5102-4fc6-b61e-a7f9fd898956 {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:33:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:33:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:33:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:33:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:33:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:33:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:33:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:33:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:33:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:33:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:33:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:33:33 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:33:37 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:33:37 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:33:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:33:39 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:33:39 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:33:42 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:33:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:33:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:33:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:33:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:33:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:33:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:33:44 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:33:44 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:33:44 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:33:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-e1efac0d-5102-4fc6-b61e-a7f9fd898956" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:33:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-e1efac0d-5102-4fc6-b61e-a7f9fd898956" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:33:44 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:33:44 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lazy-loading 'info_cache' on Instance uuid e1efac0d-5102-4fc6-b61e-a7f9fd898956 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:33:45 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Updating instance_info_cache with network_info: [{"id": "3a328c35-d862-44c8-9221-cbfe4882cda3", "address": "fa:16:3e:bb:32:13", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a328c35-d8", "ovs_interfaceid": "3a328c35-d862-44c8-9221-cbfe4882cda3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:33:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-e1efac0d-5102-4fc6-b61e-a7f9fd898956" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:33:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:33:45 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:33:48 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:33:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:33:53 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:33:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:33:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:33:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:33:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:33:53 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:33:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:33:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5007 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:33:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:33:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:33:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:33:53 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:33:53 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:33:53 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:33:53 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=9013MB free_disk=25.077198028564453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:33:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:33:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:33:54 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance e1efac0d-5102-4fc6-b61e-a7f9fd898956 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:33:54 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:33:54 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:33:54 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:33:54 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:33:54 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:33:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:33:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:33:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:33:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:33:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:33:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:33:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:34:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:34:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-037e73ec-3d75-46f1-8e3e-bfabad3161bc req-497a0de8-e0b4-4220-8e24-a021bdf5226f service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Received event network-changed-3a328c35-d862-44c8-9221-cbfe4882cda3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:34:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-037e73ec-3d75-46f1-8e3e-bfabad3161bc req-497a0de8-e0b4-4220-8e24-a021bdf5226f service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Refreshing instance network info cache due to event network-changed-3a328c35-d862-44c8-9221-cbfe4882cda3. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:34:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-037e73ec-3d75-46f1-8e3e-bfabad3161bc req-497a0de8-e0b4-4220-8e24-a021bdf5226f service nova] Acquiring lock "refresh_cache-e1efac0d-5102-4fc6-b61e-a7f9fd898956" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:34:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-037e73ec-3d75-46f1-8e3e-bfabad3161bc req-497a0de8-e0b4-4220-8e24-a021bdf5226f service nova] Acquired lock "refresh_cache-e1efac0d-5102-4fc6-b61e-a7f9fd898956" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:34:25 user nova-compute[75083]: DEBUG nova.network.neutron [req-037e73ec-3d75-46f1-8e3e-bfabad3161bc req-497a0de8-e0b4-4220-8e24-a021bdf5226f service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Refreshing network info cache for port 3a328c35-d862-44c8-9221-cbfe4882cda3 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:34:25 user nova-compute[75083]: DEBUG nova.network.neutron [req-037e73ec-3d75-46f1-8e3e-bfabad3161bc req-497a0de8-e0b4-4220-8e24-a021bdf5226f service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Updated VIF entry in instance network info cache for port 3a328c35-d862-44c8-9221-cbfe4882cda3. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:34:25 user nova-compute[75083]: DEBUG nova.network.neutron [req-037e73ec-3d75-46f1-8e3e-bfabad3161bc req-497a0de8-e0b4-4220-8e24-a021bdf5226f service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Updating instance_info_cache with network_info: [{"id": "3a328c35-d862-44c8-9221-cbfe4882cda3", "address": "fa:16:3e:bb:32:13", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a328c35-d8", "ovs_interfaceid": "3a328c35-d862-44c8-9221-cbfe4882cda3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:34:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-037e73ec-3d75-46f1-8e3e-bfabad3161bc req-497a0de8-e0b4-4220-8e24-a021bdf5226f service nova] Releasing lock "refresh_cache-e1efac0d-5102-4fc6-b61e-a7f9fd898956" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:34:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "4214735c-8d4b-463d-92fb-b69787450338" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:34:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "4214735c-8d4b-463d-92fb-b69787450338" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:34:31 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:34:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:34:31 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:34:31 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:34:31 user nova-compute[75083]: INFO nova.compute.claims [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Claim successful on node user
Nov 29 06:34:31 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:34:32 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:34:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.213s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:34:32 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:34:32 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:34:32 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:34:32 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:34:32 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:34:32 user nova-compute[75083]: INFO nova.virt.block_device [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Booting with volume snapshot be924c18-2254-40f5-8e90-f4ef702a16af at /dev/vda
Nov 29 06:34:32 user nova-compute[75083]: DEBUG nova.policy [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73fd740b5fe248edad95bcc269eee750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a61afbdd47455bbaa044282feb7c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:34:32 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Successfully created port: 446b03ed-dd40-4afc-ab1c-e827c72ca406 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:34:33 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Successfully updated port: 446b03ed-dd40-4afc-ab1c-e827c72ca406 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:34:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "refresh_cache-4214735c-8d4b-463d-92fb-b69787450338" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:34:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquired lock "refresh_cache-4214735c-8d4b-463d-92fb-b69787450338" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:34:33 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:34:33 user nova-compute[75083]: DEBUG nova.compute.manager [req-feec82d6-2b05-42eb-9961-f7d973907ce0 req-9613cdaf-8663-4a81-b60c-6125a16b832b service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Received event network-changed-446b03ed-dd40-4afc-ab1c-e827c72ca406 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:34:33 user nova-compute[75083]: DEBUG nova.compute.manager [req-feec82d6-2b05-42eb-9961-f7d973907ce0 req-9613cdaf-8663-4a81-b60c-6125a16b832b service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Refreshing instance network info cache due to event network-changed-446b03ed-dd40-4afc-ab1c-e827c72ca406. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:34:33 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-feec82d6-2b05-42eb-9961-f7d973907ce0 req-9613cdaf-8663-4a81-b60c-6125a16b832b service nova] Acquiring lock "refresh_cache-4214735c-8d4b-463d-92fb-b69787450338" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:34:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:33 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:34:33 user nova-compute[75083]: DEBUG nova.network.neutron [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Updating instance_info_cache with network_info: [{"id": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "address": "fa:16:3e:b0:af:3c", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap446b03ed-dd", "ovs_interfaceid": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:34:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Releasing lock "refresh_cache-4214735c-8d4b-463d-92fb-b69787450338" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:34:34 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Instance network_info: |[{"id": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "address": "fa:16:3e:b0:af:3c", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap446b03ed-dd", "ovs_interfaceid": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:34:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-feec82d6-2b05-42eb-9961-f7d973907ce0 req-9613cdaf-8663-4a81-b60c-6125a16b832b service nova] Acquired lock "refresh_cache-4214735c-8d4b-463d-92fb-b69787450338" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:34:34 user nova-compute[75083]: DEBUG nova.network.neutron [req-feec82d6-2b05-42eb-9961-f7d973907ce0 req-9613cdaf-8663-4a81-b60c-6125a16b832b service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Refreshing network info cache for port 446b03ed-dd40-4afc-ab1c-e827c72ca406 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:34:34 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:34:34 user nova-compute[75083]: DEBUG nova.network.neutron [req-feec82d6-2b05-42eb-9961-f7d973907ce0 req-9613cdaf-8663-4a81-b60c-6125a16b832b service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Updated VIF entry in instance network info cache for port 446b03ed-dd40-4afc-ab1c-e827c72ca406. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:34:34 user nova-compute[75083]: DEBUG nova.network.neutron [req-feec82d6-2b05-42eb-9961-f7d973907ce0 req-9613cdaf-8663-4a81-b60c-6125a16b832b service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Updating instance_info_cache with network_info: [{"id": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "address": "fa:16:3e:b0:af:3c", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap446b03ed-dd", "ovs_interfaceid": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:34:34 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-feec82d6-2b05-42eb-9961-f7d973907ce0 req-9613cdaf-8663-4a81-b60c-6125a16b832b service nova] Releasing lock "refresh_cache-4214735c-8d4b-463d-92fb-b69787450338" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:34:37 user nova-compute[75083]: DEBUG os_brick.utils [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:34:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:34:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:34:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f99f2e0-63bb-4c57-b248-9750efa31b88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:34:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:34:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:34:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ad4e5f-7b80-4cdc-ad1b-f6c8035817e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:34:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:34:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:34:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f1827a-b767-49bc-8274-54ca1c9ee750]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:34:37 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c01e9f9-b25a-450a-9dc9-583264e43237]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:34:37 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:34:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:34:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:34:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:34:38 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:34:38 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:34:38 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c31d60f-bc0f-44b9-930a-5898912bfc15]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:34:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:34:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:34:38 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:34:38 user nova-compute[75083]: DEBUG os_brick.utils [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:34:38 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Updating existing volume attachment record: d57ea97f-2beb-45bf-8afd-ec5d2bb22019 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:34:38 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:34:38 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:34:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:34:40 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:34:40 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:34:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:42 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:34:43 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:34:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:44 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:34:44 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:34:44 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:34:44 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Skipping network cache update for instance because it is Building. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 06:34:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-e1efac0d-5102-4fc6-b61e-a7f9fd898956" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:34:44 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-e1efac0d-5102-4fc6-b61e-a7f9fd898956" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:34:44 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:34:44 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lazy-loading 'info_cache' on Instance uuid e1efac0d-5102-4fc6-b61e-a7f9fd898956 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:34:45 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Updating instance_info_cache with network_info: [{"id": "3a328c35-d862-44c8-9221-cbfe4882cda3", "address": "fa:16:3e:bb:32:13", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a328c35-d8", "ovs_interfaceid": "3a328c35-d862-44c8-9221-cbfe4882cda3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:34:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-e1efac0d-5102-4fc6-b61e-a7f9fd898956" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:34:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:34:45 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:34:47 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Creating image(s)
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Did not create local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Ensure instance console log exists: /opt/stack/data/nova/instances/4214735c-8d4b-463d-92fb-b69787450338/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Start _get_guest_xml network_info=[{"id": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "address": "fa:16:3e:b0:af:3c", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap446b03ed-dd", "ovs_interfaceid": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T06:34:27Z,direct_url=<?>,disk_format='qcow2',id=06ab1ee1-64af-46f7-8c1c-9da27e0b7710,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-708082919',owner='21a61afbdd47455bbaa044282feb7c47',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T06:34:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'd57ea97f-2beb-45bf-8afd-ec5d2bb22019', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FryHnsOT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4214735c-8d4b-463d-92fb-b69787450338', 'attached_at': '', 'detached_at': '', 'volume_id': '3b4a83ce-57e8-4817-b643-8b0ba7f262b7', 'serial': '3b4a83ce-57e8-4817-b643-8b0ba7f262b7'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:34:47 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:34:47 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T06:34:27Z,direct_url=<?>,disk_format='qcow2',id=06ab1ee1-64af-46f7-8c1c-9da27e0b7710,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-708082919',owner='21a61afbdd47455bbaa044282feb7c47',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T06:34:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FryHnsOT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:34:47 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:34:47 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:34:47 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ecd0be-85ed-43a5-8bbe-1144a7499c42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:34:47 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0297901f-c795-4ae6-849f-0b9e503c87b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7] added
Nov 29 06:34:47 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb384b3-aa08-402a-9e88-34e81711ab89]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49fc685-acfe-42af-96a7-d7aaa648b1e6]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FryHnsOT {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FryHnsOT" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cb2e99-f5fd-4337-b91d-19460e2abc3e]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FryHnsOT'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd8e093-2d16-45a2-a1a0-acc957f8c7bf]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[762b1901-4b43-470e-8fcf-d02fad7461a5]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e (non-flash)
Nov 29 06:34:47 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e (non-flash)
Nov 29 06:34:47 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dd1826-1185-417f-9ddb-d5b9faae0752]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7, portal: 172.16.0.220,3260]
Nov 29 06:34:47 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7, portal: 172.16.0.220,3260] successful.
Nov 29 06:34:47 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefa6576-d0a9-4fb7-a922-ab70a2bab1bd]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dd15b6-70b9-4048-aae2-3dec0e1c839f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e (non-flash)
Nov 29 06:34:47 user nova-compute[75083]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 (non-flash)
Nov 29 06:34:47 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e (non-flash)
Nov 29 06:34:47 user nova-compute[75083]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 (non-flash)
Nov 29 06:34:47 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:34:47 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:34:48 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:34:48 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc13ac7-7452-4caa-ae27-59360e8b6af7]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:34:48 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:34:48 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FryHnsOT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:34:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23963343237343036', 'path': '/dev/sdc'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963343237343036', 'path': '/dev/sdc'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:34:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2135496653',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2135496653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2135496653',id=49,image_ref='06ab1ee1-64af-46f7-8c1c-9da27e0b7710',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4nVaC9TtKbKVJZ1Uu7BhTt/kQ4ovMj7sLccZi+7idNicDS3ZYB9ZQj57VJtg4hIAgBreBUbJl/QCSsd7K/hfcVWkd4VmmxXxLOPOPd7sYCYYML1j+MzdmVGlZlpjBVjg==',key_name='tempest-keypair-878418706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21a61afbdd47455bbaa044282feb7c47',ramdisk_id='',reservation_id='r-u63qmtxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-46466774',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-46466774',owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:34:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fd740b5fe248edad95bcc269eee750',uuid=4214735c-8d4b-463d-92fb-b69787450338,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "address": "fa:16:3e:b0:af:3c", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap446b03ed-dd", "ovs_interfaceid": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converting VIF {"id": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "address": "fa:16:3e:b0:af:3c", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap446b03ed-dd", "ovs_interfaceid": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=446b03ed-dd40-4afc-ab1c-e827c72ca406,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap446b03ed-dd') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG nova.objects.instance [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lazy-loading 'pci_devices' on Instance uuid 4214735c-8d4b-463d-92fb-b69787450338 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:34:49 user nova-compute[75083]:   <uuid>4214735c-8d4b-463d-92fb-b69787450338</uuid>
Nov 29 06:34:49 user nova-compute[75083]:   <name>instance-00000031</name>
Nov 29 06:34:49 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:34:49 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:34:49 user nova-compute[75083]:   <metadata>
Nov 29 06:34:49 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:34:49 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:34:49 user nova-compute[75083]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-2135496653</nova:name>
Nov 29 06:34:49 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:34:47</nova:creationTime>
Nov 29 06:34:49 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:34:49 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:34:49 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:34:49 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:34:49 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:34:49 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:34:49 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:34:49 user nova-compute[75083]:       <nova:owner>
Nov 29 06:34:49 user nova-compute[75083]:         <nova:user uuid="73fd740b5fe248edad95bcc269eee750">tempest-TestVolumeBootPattern-46466774-project-member</nova:user>
Nov 29 06:34:49 user nova-compute[75083]:         <nova:project uuid="21a61afbdd47455bbaa044282feb7c47">tempest-TestVolumeBootPattern-46466774</nova:project>
Nov 29 06:34:49 user nova-compute[75083]:       </nova:owner>
Nov 29 06:34:49 user nova-compute[75083]:       <nova:root type="image" uuid="06ab1ee1-64af-46f7-8c1c-9da27e0b7710"/>
Nov 29 06:34:49 user nova-compute[75083]:       <nova:ports>
Nov 29 06:34:49 user nova-compute[75083]:         <nova:port uuid="446b03ed-dd40-4afc-ab1c-e827c72ca406">
Nov 29 06:34:49 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 06:34:49 user nova-compute[75083]:         </nova:port>
Nov 29 06:34:49 user nova-compute[75083]:       </nova:ports>
Nov 29 06:34:49 user nova-compute[75083]:     </nova:instance>
Nov 29 06:34:49 user nova-compute[75083]:   </metadata>
Nov 29 06:34:49 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:34:49 user nova-compute[75083]:     <system>
Nov 29 06:34:49 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:34:49 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:34:49 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:34:49 user nova-compute[75083]:       <entry name="serial">4214735c-8d4b-463d-92fb-b69787450338</entry>
Nov 29 06:34:49 user nova-compute[75083]:       <entry name="uuid">4214735c-8d4b-463d-92fb-b69787450338</entry>
Nov 29 06:34:49 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:34:49 user nova-compute[75083]:     </system>
Nov 29 06:34:49 user nova-compute[75083]:   </sysinfo>
Nov 29 06:34:49 user nova-compute[75083]:   <os>
Nov 29 06:34:49 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:34:49 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:34:49 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:34:49 user nova-compute[75083]:   </os>
Nov 29 06:34:49 user nova-compute[75083]:   <features>
Nov 29 06:34:49 user nova-compute[75083]:     <acpi/>
Nov 29 06:34:49 user nova-compute[75083]:     <apic/>
Nov 29 06:34:49 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:34:49 user nova-compute[75083]:   </features>
Nov 29 06:34:49 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:34:49 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:34:49 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:34:49 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:34:49 user nova-compute[75083]:   </clock>
Nov 29 06:34:49 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:34:49 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:34:49 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:34:49 user nova-compute[75083]:   </cpu>
Nov 29 06:34:49 user nova-compute[75083]:   <devices>
Nov 29 06:34:49 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 06:34:49 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:34:49 user nova-compute[75083]:       <source dev="/dev/sdc"/>
Nov 29 06:34:49 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:34:49 user nova-compute[75083]:       <serial>3b4a83ce-57e8-4817-b643-8b0ba7f262b7</serial>
Nov 29 06:34:49 user nova-compute[75083]:     </disk>
Nov 29 06:34:49 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:34:49 user nova-compute[75083]:       <mac address="fa:16:3e:b0:af:3c"/>
Nov 29 06:34:49 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:34:49 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:34:49 user nova-compute[75083]:       <target dev="tap446b03ed-dd"/>
Nov 29 06:34:49 user nova-compute[75083]:     </interface>
Nov 29 06:34:49 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:34:49 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/4214735c-8d4b-463d-92fb-b69787450338/console.log" append="off"/>
Nov 29 06:34:49 user nova-compute[75083]:     </serial>
Nov 29 06:34:49 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:34:49 user nova-compute[75083]:     <video>
Nov 29 06:34:49 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:34:49 user nova-compute[75083]:     </video>
Nov 29 06:34:49 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:34:49 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:34:49 user nova-compute[75083]:     </rng>
Nov 29 06:34:49 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:34:49 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:34:49 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:34:49 user nova-compute[75083]:     </memballoon>
Nov 29 06:34:49 user nova-compute[75083]:   </devices>
Nov 29 06:34:49 user nova-compute[75083]: </domain>
Nov 29 06:34:49 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:34:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2135496653',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2135496653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2135496653',id=49,image_ref='06ab1ee1-64af-46f7-8c1c-9da27e0b7710',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4nVaC9TtKbKVJZ1Uu7BhTt/kQ4ovMj7sLccZi+7idNicDS3ZYB9ZQj57VJtg4hIAgBreBUbJl/QCSsd7K/hfcVWkd4VmmxXxLOPOPd7sYCYYML1j+MzdmVGlZlpjBVjg==',key_name='tempest-keypair-878418706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21a61afbdd47455bbaa044282feb7c47',ramdisk_id='',reservation_id='r-u63qmtxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-46466774',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-46466774',owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:34:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fd740b5fe248edad95bcc269eee750',uuid=4214735c-8d4b-463d-92fb-b69787450338,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "address": "fa:16:3e:b0:af:3c", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap446b03ed-dd", "ovs_interfaceid": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converting VIF {"id": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "address": "fa:16:3e:b0:af:3c", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap446b03ed-dd", "ovs_interfaceid": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=446b03ed-dd40-4afc-ab1c-e827c72ca406,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap446b03ed-dd') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG os_vif [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=446b03ed-dd40-4afc-ab1c-e827c72ca406,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap446b03ed-dd') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ff234f9-4ed3-5a8a-a3f3-8665cca3621d', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap446b03ed-dd, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap446b03ed-dd, col_values=(('qos', UUID('971b0f35-7def-4be6-8599-f478f6436809')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap446b03ed-dd, col_values=(('external_ids', {'iface-id': '446b03ed-dd40-4afc-ab1c-e827c72ca406', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:af:3c', 'vm-uuid': '4214735c-8d4b-463d-92fb-b69787450338'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:49 user nova-compute[75083]: INFO os_vif [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=446b03ed-dd40-4afc-ab1c-e827c72ca406,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap446b03ed-dd')
Nov 29 06:34:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:34:49 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] No VIF found with MAC fa:16:3e:b0:af:3c, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:34:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:50 user nova-compute[75083]: DEBUG nova.compute.manager [req-f5b7e349-7e86-4e14-a3c0-1425f8351807 req-450720d7-1bde-4ce6-9beb-0f2b34b3511d service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Received event network-vif-plugged-446b03ed-dd40-4afc-ab1c-e827c72ca406 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:34:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f5b7e349-7e86-4e14-a3c0-1425f8351807 req-450720d7-1bde-4ce6-9beb-0f2b34b3511d service nova] Acquiring lock "4214735c-8d4b-463d-92fb-b69787450338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:34:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f5b7e349-7e86-4e14-a3c0-1425f8351807 req-450720d7-1bde-4ce6-9beb-0f2b34b3511d service nova] Lock "4214735c-8d4b-463d-92fb-b69787450338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:34:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f5b7e349-7e86-4e14-a3c0-1425f8351807 req-450720d7-1bde-4ce6-9beb-0f2b34b3511d service nova] Lock "4214735c-8d4b-463d-92fb-b69787450338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:34:50 user nova-compute[75083]: DEBUG nova.compute.manager [req-f5b7e349-7e86-4e14-a3c0-1425f8351807 req-450720d7-1bde-4ce6-9beb-0f2b34b3511d service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] No waiting events found dispatching network-vif-plugged-446b03ed-dd40-4afc-ab1c-e827c72ca406 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:34:50 user nova-compute[75083]: WARNING nova.compute.manager [req-f5b7e349-7e86-4e14-a3c0-1425f8351807 req-450720d7-1bde-4ce6-9beb-0f2b34b3511d service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Received unexpected event network-vif-plugged-446b03ed-dd40-4afc-ab1c-e827c72ca406 for instance with vm_state building and task_state spawning.
Nov 29 06:34:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:34:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:34:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:34:52 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Instance spawned successfully.
Nov 29 06:34:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:34:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:34:52 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:34:52 user nova-compute[75083]: INFO nova.compute.manager [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 29 06:34:52 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:34:52 user nova-compute[75083]: DEBUG nova.compute.manager [req-0c1d869f-1524-4ab8-bef2-4141a6b80a4f req-cf363bf4-b524-474b-931d-e651d7e2843b service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Received event network-vif-plugged-446b03ed-dd40-4afc-ab1c-e827c72ca406 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:34:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0c1d869f-1524-4ab8-bef2-4141a6b80a4f req-cf363bf4-b524-474b-931d-e651d7e2843b service nova] Acquiring lock "4214735c-8d4b-463d-92fb-b69787450338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:34:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0c1d869f-1524-4ab8-bef2-4141a6b80a4f req-cf363bf4-b524-474b-931d-e651d7e2843b service nova] Lock "4214735c-8d4b-463d-92fb-b69787450338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:34:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0c1d869f-1524-4ab8-bef2-4141a6b80a4f req-cf363bf4-b524-474b-931d-e651d7e2843b service nova] Lock "4214735c-8d4b-463d-92fb-b69787450338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:34:52 user nova-compute[75083]: DEBUG nova.compute.manager [req-0c1d869f-1524-4ab8-bef2-4141a6b80a4f req-cf363bf4-b524-474b-931d-e651d7e2843b service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] No waiting events found dispatching network-vif-plugged-446b03ed-dd40-4afc-ab1c-e827c72ca406 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:34:52 user nova-compute[75083]: WARNING nova.compute.manager [req-0c1d869f-1524-4ab8-bef2-4141a6b80a4f req-cf363bf4-b524-474b-931d-e651d7e2843b service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Received unexpected event network-vif-plugged-446b03ed-dd40-4afc-ab1c-e827c72ca406 for instance with vm_state building and task_state spawning.
Nov 29 06:34:52 user nova-compute[75083]: INFO nova.compute.manager [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Took 20.82 seconds to build instance.
Nov 29 06:34:52 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ba834a87-59af-49d0-9d6a-c445c13f0e21 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "4214735c-8d4b-463d-92fb-b69787450338" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.921s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:34:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:55 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:34:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:34:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:34:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:34:55 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:34:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:34:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:34:56 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:34:56 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:34:56 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8947MB free_disk=25.07525634765625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:34:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:34:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:34:56 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance e1efac0d-5102-4fc6-b61e-a7f9fd898956 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:34:56 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4214735c-8d4b-463d-92fb-b69787450338 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:34:56 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:34:56 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:34:56 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:34:56 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:34:56 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:34:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:34:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:34:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:35:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:35:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:35:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:35:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:35:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:35:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:35:07 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:35:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:35:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:35:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:35:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:35:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:35:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:35:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:35:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:35:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:35:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:35:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:35:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:35:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:35:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:35:35 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:35:38 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:35:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:35:39 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:35:42 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:35:42 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:35:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:35:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:35:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:35:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:35:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:35:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:35:44 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:35:44 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:35:45 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:35:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:35:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:35:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-e1efac0d-5102-4fc6-b61e-a7f9fd898956" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:35:45 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-e1efac0d-5102-4fc6-b61e-a7f9fd898956" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:35:45 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:35:45 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lazy-loading 'info_cache' on Instance uuid e1efac0d-5102-4fc6-b61e-a7f9fd898956 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:35:46 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Updating instance_info_cache with network_info: [{"id": "3a328c35-d862-44c8-9221-cbfe4882cda3", "address": "fa:16:3e:bb:32:13", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a328c35-d8", "ovs_interfaceid": "3a328c35-d862-44c8-9221-cbfe4882cda3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:35:46 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-e1efac0d-5102-4fc6-b61e-a7f9fd898956" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:35:46 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:35:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:35:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:35:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:35:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:35:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:35:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:35:52 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:35:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:35:57 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:35:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:35:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:35:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:35:57 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:35:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:35:57 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:35:58 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:35:58 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:35:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8928MB free_disk=25.07461166381836GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:35:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:35:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:35:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance e1efac0d-5102-4fc6-b61e-a7f9fd898956 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:35:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 4214735c-8d4b-463d-92fb-b69787450338 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:35:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:35:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:35:58 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:35:58 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:35:58 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:35:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:35:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:35:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:35:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:35:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:35:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:35:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:36:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:36:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:36:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:36:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:36:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:36:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:36:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:36:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:36:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:36:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:36:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:36:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:36:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:36:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:36:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-39a1507d-7369-48ae-b4c3-bbedf059f328 req-01a90152-d99f-4fc3-aa14-aafe952df443 service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Received event network-changed-446b03ed-dd40-4afc-ab1c-e827c72ca406 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:36:23 user nova-compute[75083]: DEBUG nova.compute.manager [req-39a1507d-7369-48ae-b4c3-bbedf059f328 req-01a90152-d99f-4fc3-aa14-aafe952df443 service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Refreshing instance network info cache due to event network-changed-446b03ed-dd40-4afc-ab1c-e827c72ca406. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:36:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-39a1507d-7369-48ae-b4c3-bbedf059f328 req-01a90152-d99f-4fc3-aa14-aafe952df443 service nova] Acquiring lock "refresh_cache-4214735c-8d4b-463d-92fb-b69787450338" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:36:23 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-39a1507d-7369-48ae-b4c3-bbedf059f328 req-01a90152-d99f-4fc3-aa14-aafe952df443 service nova] Acquired lock "refresh_cache-4214735c-8d4b-463d-92fb-b69787450338" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:36:23 user nova-compute[75083]: DEBUG nova.network.neutron [req-39a1507d-7369-48ae-b4c3-bbedf059f328 req-01a90152-d99f-4fc3-aa14-aafe952df443 service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Refreshing network info cache for port 446b03ed-dd40-4afc-ab1c-e827c72ca406 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:36:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:36:24 user nova-compute[75083]: DEBUG nova.network.neutron [req-39a1507d-7369-48ae-b4c3-bbedf059f328 req-01a90152-d99f-4fc3-aa14-aafe952df443 service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Updated VIF entry in instance network info cache for port 446b03ed-dd40-4afc-ab1c-e827c72ca406. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:36:24 user nova-compute[75083]: DEBUG nova.network.neutron [req-39a1507d-7369-48ae-b4c3-bbedf059f328 req-01a90152-d99f-4fc3-aa14-aafe952df443 service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Updating instance_info_cache with network_info: [{"id": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "address": "fa:16:3e:b0:af:3c", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap446b03ed-dd", "ovs_interfaceid": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:36:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-39a1507d-7369-48ae-b4c3-bbedf059f328 req-01a90152-d99f-4fc3-aa14-aafe952df443 service nova] Releasing lock "refresh_cache-4214735c-8d4b-463d-92fb-b69787450338" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:36:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "4214735c-8d4b-463d-92fb-b69787450338" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:36:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "4214735c-8d4b-463d-92fb-b69787450338" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:36:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "4214735c-8d4b-463d-92fb-b69787450338-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:36:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "4214735c-8d4b-463d-92fb-b69787450338-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:36:24 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "4214735c-8d4b-463d-92fb-b69787450338-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:36:24 user nova-compute[75083]: INFO nova.compute.manager [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Terminating instance
Nov 29 06:36:24 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:36:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:36:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:36:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:36:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:36:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:36:25 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Instance destroyed successfully.
Nov 29 06:36:25 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lazy-loading 'resources' on Instance uuid 4214735c-8d4b-463d-92fb-b69787450338 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:34:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2135496653',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2135496653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2135496653',id=49,image_ref='06ab1ee1-64af-46f7-8c1c-9da27e0b7710',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4nVaC9TtKbKVJZ1Uu7BhTt/kQ4ovMj7sLccZi+7idNicDS3ZYB9ZQj57VJtg4hIAgBreBUbJl/QCSsd7K/hfcVWkd4VmmxXxLOPOPd7sYCYYML1j+MzdmVGlZlpjBVjg==',key_name='tempest-keypair-878418706',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:34:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21a61afbdd47455bbaa044282feb7c47',ramdisk_id='',reservation_id='r-u63qmtxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-46466774',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-46466774',owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:34:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fd740b5fe248edad95bcc269eee750',uuid=4214735c-8d4b-463d-92fb-b69787450338,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "address": "fa:16:3e:b0:af:3c", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap446b03ed-dd", "ovs_interfaceid": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converting VIF {"id": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "address": "fa:16:3e:b0:af:3c", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap446b03ed-dd", "ovs_interfaceid": "446b03ed-dd40-4afc-ab1c-e827c72ca406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=446b03ed-dd40-4afc-ab1c-e827c72ca406,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap446b03ed-dd') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_vif [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=446b03ed-dd40-4afc-ab1c-e827c72ca406,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap446b03ed-dd') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap446b03ed-dd, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=971b0f35-7def-4be6-8599-f478f6436809) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:36:25 user nova-compute[75083]: INFO os_vif [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=446b03ed-dd40-4afc-ab1c-e827c72ca406,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap446b03ed-dd')
Nov 29 06:36:25 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FryHnsOT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:36:25 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f3c958-f1fb-4989-80ad-583f56b62c87]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:36:25 user nova-compute[75083]: No targets found.
Nov 29 06:36:25 user nova-compute[75083]: iSNS:
Nov 29 06:36:25 user nova-compute[75083]: No targets found.
Nov 29 06:36:25 user nova-compute[75083]: STATIC:
Nov 29 06:36:25 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7
Nov 29 06:36:25 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:36:25 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:36:25 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e
Nov 29 06:36:25 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:36:25 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:36:25 user nova-compute[75083]: FIRMWARE:
Nov 29 06:36:25 user nova-compute[75083]: No targets found.
Nov 29 06:36:25 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:36:25 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:36:25 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0417da7-6f84-4626-a52e-f2b7f853bf47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba15b24f-c795-4663-beb4-3fb105b368d9]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e (non-flash)
Nov 29 06:36:25 user nova-compute[75083]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 (non-flash)
Nov 29 06:36:25 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e (non-flash)
Nov 29 06:36:25 user nova-compute[75083]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 (non-flash)
Nov 29 06:36:25 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b81b8160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7'): ({'sdc'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Removing single pathed devices sdc {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-76c9fc05-f61e-4cfa-ab3b-315575e9a241 req-4563044f-af4f-4f67-b1fa-a05596274676 service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Received event network-vif-unplugged-446b03ed-dd40-4afc-ab1c-e827c72ca406 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-76c9fc05-f61e-4cfa-ab3b-315575e9a241 req-4563044f-af4f-4f67-b1fa-a05596274676 service nova] Acquiring lock "4214735c-8d4b-463d-92fb-b69787450338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-76c9fc05-f61e-4cfa-ab3b-315575e9a241 req-4563044f-af4f-4f67-b1fa-a05596274676 service nova] Lock "4214735c-8d4b-463d-92fb-b69787450338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-76c9fc05-f61e-4cfa-ab3b-315575e9a241 req-4563044f-af4f-4f67-b1fa-a05596274676 service nova] Lock "4214735c-8d4b-463d-92fb-b69787450338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-76c9fc05-f61e-4cfa-ab3b-315575e9a241 req-4563044f-af4f-4f67-b1fa-a05596274676 service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] No waiting events found dispatching network-vif-unplugged-446b03ed-dd40-4afc-ab1c-e827c72ca406 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-76c9fc05-f61e-4cfa-ab3b-315575e9a241 req-4563044f-af4f-4f67-b1fa-a05596274676 service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Received event network-vif-unplugged-446b03ed-dd40-4afc-ab1c-e827c72ca406 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-76c9fc05-f61e-4cfa-ab3b-315575e9a241 req-4563044f-af4f-4f67-b1fa-a05596274676 service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Received event network-vif-plugged-446b03ed-dd40-4afc-ab1c-e827c72ca406 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-76c9fc05-f61e-4cfa-ab3b-315575e9a241 req-4563044f-af4f-4f67-b1fa-a05596274676 service nova] Acquiring lock "4214735c-8d4b-463d-92fb-b69787450338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-76c9fc05-f61e-4cfa-ab3b-315575e9a241 req-4563044f-af4f-4f67-b1fa-a05596274676 service nova] Lock "4214735c-8d4b-463d-92fb-b69787450338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-76c9fc05-f61e-4cfa-ab3b-315575e9a241 req-4563044f-af4f-4f67-b1fa-a05596274676 service nova] Lock "4214735c-8d4b-463d-92fb-b69787450338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG nova.compute.manager [req-76c9fc05-f61e-4cfa-ab3b-315575e9a241 req-4563044f-af4f-4f67-b1fa-a05596274676 service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] No waiting events found dispatching network-vif-plugged-446b03ed-dd40-4afc-ab1c-e827c72ca406 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:36:25 user nova-compute[75083]: WARNING nova.compute.manager [req-76c9fc05-f61e-4cfa-ab3b-315575e9a241 req-4563044f-af4f-4f67-b1fa-a05596274676 service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Received unexpected event network-vif-plugged-446b03ed-dd40-4afc-ab1c-e827c72ca406 for instance with vm_state active and task_state deleting.
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[01399849-5476-45f7-9f2b-b6c189704d87]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa458b9-a626-4f0d-90fa-16bfd2e247e2]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Flushing IO for device /dev/sdc {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2315aa4-24f1-42e8-b558-285610cd4fbb]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e4a4a5-f27c-4318-9dc3-b0851c76ee1e]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23963343237343036', '/dev/disk/by-id/scsi-1SCST_BIO8e660907-9c4274068118245b', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8e660907') {{(pid=86165) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7774e7a6-9cac-4d23-b3a3-3acda1c753eb]: (4, None) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f760462c-9172-4a97-9cf3-146058e40dba]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f6224f-4953-4fde-984e-59fe8d6d3b9c]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7, portal: 172.16.0.220,3260]
Nov 29 06:36:25 user nova-compute[75083]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7, portal: 172.16.0.220,3260] successful.
Nov 29 06:36:25 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a83ce-57e8-4817-b643-8b0ba7f262b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c39c0cc-25c3-4348-b435-9ad26e28a9f6]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] <== disconnect_volume: return (339ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:36:25 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Deleting instance files /opt/stack/data/nova/instances/4214735c-8d4b-463d-92fb-b69787450338_del
Nov 29 06:36:25 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Deletion of /opt/stack/data/nova/instances/4214735c-8d4b-463d-92fb-b69787450338_del complete
Nov 29 06:36:25 user nova-compute[75083]: INFO nova.compute.manager [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 29 06:36:25 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:36:25 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 4214735c-8d4b-463d-92fb-b69787450338] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:36:26 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:36:26 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Took 0.86 seconds to deallocate network for instance.
Nov 29 06:36:26 user nova-compute[75083]: DEBUG nova.compute.manager [req-98585e99-5ff0-498c-9543-781895dbbaf3 req-16687230-c5c9-4a0c-9f3f-c092b45be413 service nova] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Received event network-vif-deleted-446b03ed-dd40-4afc-ab1c-e827c72ca406 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:36:27 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:36:27 user nova-compute[75083]: INFO nova.compute.manager [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Took 0.75 seconds to detach 1 volumes for instance.
Nov 29 06:36:27 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 4214735c-8d4b-463d-92fb-b69787450338] Deleting volume: 3b4a83ce-57e8-4817-b643-8b0ba7f262b7 {{(pid=75083) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 06:36:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:36:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:36:27 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:36:27 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:36:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:36:27 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Deleted allocations for instance 4214735c-8d4b-463d-92fb-b69787450338
Nov 29 06:36:27 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9462adbd-eeff-489b-b01c-d811f586eb69 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "4214735c-8d4b-463d-92fb-b69787450338" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.228s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:36:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:36:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:36:36 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:36:38 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:36:39 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:36:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:36:43 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:36:43 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:36:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:36:45 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:36:45 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:36:45 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:36:47 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:36:47 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:36:47 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 06:36:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:36:53 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:36:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:36:59 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:36:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:36:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:36:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:36:59 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:36:59 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:37:00 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:37:00 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:37:00 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=9005MB free_disk=25.073741912841797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:37:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:37:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:37:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:37:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5006 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:37:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:37:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:37:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:00 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance e1efac0d-5102-4fc6-b61e-a7f9fd898956 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:37:00 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:37:00 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:37:00 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:37:00 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:37:00 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:37:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:37:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:37:18 user nova-compute[75083]: INFO nova.compute.manager [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Terminating instance
Nov 29 06:37:18 user nova-compute[75083]: DEBUG nova.compute.manager [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-979eb7bd-595d-4bb6-88da-805d2f6713e0 req-ef5768f4-79a8-41ed-bae7-f2320af89a83 service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Received event network-vif-unplugged-3a328c35-d862-44c8-9221-cbfe4882cda3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-979eb7bd-595d-4bb6-88da-805d2f6713e0 req-ef5768f4-79a8-41ed-bae7-f2320af89a83 service nova] Acquiring lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-979eb7bd-595d-4bb6-88da-805d2f6713e0 req-ef5768f4-79a8-41ed-bae7-f2320af89a83 service nova] Lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-979eb7bd-595d-4bb6-88da-805d2f6713e0 req-ef5768f4-79a8-41ed-bae7-f2320af89a83 service nova] Lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-979eb7bd-595d-4bb6-88da-805d2f6713e0 req-ef5768f4-79a8-41ed-bae7-f2320af89a83 service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] No waiting events found dispatching network-vif-unplugged-3a328c35-d862-44c8-9221-cbfe4882cda3 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG nova.compute.manager [req-979eb7bd-595d-4bb6-88da-805d2f6713e0 req-ef5768f4-79a8-41ed-bae7-f2320af89a83 service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Received event network-vif-unplugged-3a328c35-d862-44c8-9221-cbfe4882cda3 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:37:18 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Instance destroyed successfully.
Nov 29 06:37:18 user nova-compute[75083]: DEBUG nova.objects.instance [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lazy-loading 'resources' on Instance uuid e1efac0d-5102-4fc6-b61e-a7f9fd898956 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:32:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1205398578',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1205398578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1205398578',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLnoHTZTJJ54SbyqS40NNfv51eYkQ1RFxGPR7GPSg7HvfKYndS0SettRdxakP2PssRPyNoYrX6Yh67+1c/W0lb1kTRJq79fp8Yg1wSJ0ObtjlWqUSDjUZkqfcC8qamxuw==',key_name='tempest-keypair-1508873525',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:32:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21a61afbdd47455bbaa044282feb7c47',ramdisk_id='',reservation_id='r-r30edw9h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-46466774',owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:32:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fd740b5fe248edad95bcc269eee750',uuid=e1efac0d-5102-4fc6-b61e-a7f9fd898956,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a328c35-d862-44c8-9221-cbfe4882cda3", "address": "fa:16:3e:bb:32:13", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a328c35-d8", "ovs_interfaceid": "3a328c35-d862-44c8-9221-cbfe4882cda3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converting VIF {"id": "3a328c35-d862-44c8-9221-cbfe4882cda3", "address": "fa:16:3e:bb:32:13", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a328c35-d8", "ovs_interfaceid": "3a328c35-d862-44c8-9221-cbfe4882cda3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:32:13,bridge_name='br-int',has_traffic_filtering=True,id=3a328c35-d862-44c8-9221-cbfe4882cda3,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a328c35-d8') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG os_vif [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:32:13,bridge_name='br-int',has_traffic_filtering=True,id=3a328c35-d862-44c8-9221-cbfe4882cda3,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a328c35-d8') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a328c35-d8, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=14072006-2fa8-4869-8fec-c13ea07cfaea) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:37:18 user nova-compute[75083]: INFO os_vif [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:32:13,bridge_name='br-int',has_traffic_filtering=True,id=3a328c35-d862-44c8-9221-cbfe4882cda3,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a328c35-d8')
Nov 29 06:37:18 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oAOWHBqZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:37:18 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:37:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad1dc7e-690f-4904-973a-6ae965294a6f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:37:18 user nova-compute[75083]: No targets found.
Nov 29 06:37:18 user nova-compute[75083]: iSNS:
Nov 29 06:37:18 user nova-compute[75083]: No targets found.
Nov 29 06:37:18 user nova-compute[75083]: STATIC:
Nov 29 06:37:18 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e
Nov 29 06:37:18 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:37:18 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:37:18 user nova-compute[75083]: FIRMWARE:
Nov 29 06:37:18 user nova-compute[75083]: No targets found.
Nov 29 06:37:18 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:37:18 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:37:18 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fb84b1-de00-4995-a0a1-9976e2434484]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[592ea90b-32cb-425a-8ece-2b0f2ea4c2f8]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e (non-flash)
Nov 29 06:37:18 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e (non-flash)
Nov 29 06:37:18 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b81bbd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3569edb3-4ab0-40e9-be03-6dfbd659f538]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:37:18 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e0bd78-2970-483c-ad20-ce9a84085e3e]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91e7616-c2d2-49af-af53-d26eabdecfb2]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7dd364-c877-4390-8b0c-7ba95b2a41c6]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26136353630343131', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d3f86591', '/dev/disk/by-id/scsi-1SCST_BIOd3f86591-a65604110d0f3360') {{(pid=86165) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6538ea95-948c-4599-88f0-4f22ce30fc0c]: (4, None) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3595edb-0a82-48c6-a016-c44dfcd49193]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[619b3600-2250-488c-9474-ed2d3e86b461]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e, portal: 172.16.0.220,3260]
Nov 29 06:37:19 user nova-compute[75083]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e, portal: 172.16.0.220,3260] successful.
Nov 29 06:37:19 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f747894e-b1c9-4817-85dd-4c6dfebd934e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca69515-2aea-4e7f-bfbc-1f86367f2aae]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] <== disconnect_volume: return (305ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:37:19 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Deleting instance files /opt/stack/data/nova/instances/e1efac0d-5102-4fc6-b61e-a7f9fd898956_del
Nov 29 06:37:19 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Deletion of /opt/stack/data/nova/instances/e1efac0d-5102-4fc6-b61e-a7f9fd898956_del complete
Nov 29 06:37:19 user nova-compute[75083]: INFO nova.compute.manager [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 29 06:37:19 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:37:19 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:37:20 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:37:20 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Took 0.97 seconds to deallocate network for instance.
Nov 29 06:37:20 user nova-compute[75083]: DEBUG nova.compute.manager [req-9a3c6e17-e067-4701-a186-78a08cfecbc7 req-39ebd291-0aec-457f-902e-0884c6fc11f3 service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Received event network-vif-deleted-3a328c35-d862-44c8-9221-cbfe4882cda3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:37:20 user nova-compute[75083]: INFO nova.compute.manager [req-9a3c6e17-e067-4701-a186-78a08cfecbc7 req-39ebd291-0aec-457f-902e-0884c6fc11f3 service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Neutron deleted interface 3a328c35-d862-44c8-9221-cbfe4882cda3; detaching it from the instance and deleting it from the info cache
Nov 29 06:37:20 user nova-compute[75083]: DEBUG nova.network.neutron [req-9a3c6e17-e067-4701-a186-78a08cfecbc7 req-39ebd291-0aec-457f-902e-0884c6fc11f3 service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:37:20 user nova-compute[75083]: DEBUG nova.compute.manager [req-9a3c6e17-e067-4701-a186-78a08cfecbc7 req-39ebd291-0aec-457f-902e-0884c6fc11f3 service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Detach interface failed, port_id=3a328c35-d862-44c8-9221-cbfe4882cda3, reason: Instance e1efac0d-5102-4fc6-b61e-a7f9fd898956 could not be found. {{(pid=75083) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 06:37:20 user nova-compute[75083]: DEBUG nova.compute.manager [req-55c6f0d6-dad2-4525-ab0f-e6b6f827bbc2 req-25191ae6-b715-4b63-9a7a-16c00c089ac2 service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Received event network-vif-plugged-3a328c35-d862-44c8-9221-cbfe4882cda3 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:37:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-55c6f0d6-dad2-4525-ab0f-e6b6f827bbc2 req-25191ae6-b715-4b63-9a7a-16c00c089ac2 service nova] Acquiring lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:37:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-55c6f0d6-dad2-4525-ab0f-e6b6f827bbc2 req-25191ae6-b715-4b63-9a7a-16c00c089ac2 service nova] Lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:37:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-55c6f0d6-dad2-4525-ab0f-e6b6f827bbc2 req-25191ae6-b715-4b63-9a7a-16c00c089ac2 service nova] Lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:37:20 user nova-compute[75083]: DEBUG nova.compute.manager [req-55c6f0d6-dad2-4525-ab0f-e6b6f827bbc2 req-25191ae6-b715-4b63-9a7a-16c00c089ac2 service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] No waiting events found dispatching network-vif-plugged-3a328c35-d862-44c8-9221-cbfe4882cda3 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:37:20 user nova-compute[75083]: WARNING nova.compute.manager [req-55c6f0d6-dad2-4525-ab0f-e6b6f827bbc2 req-25191ae6-b715-4b63-9a7a-16c00c089ac2 service nova] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Received unexpected event network-vif-plugged-3a328c35-d862-44c8-9221-cbfe4882cda3 for instance with vm_state active and task_state deleting.
Nov 29 06:37:20 user nova-compute[75083]: INFO nova.compute.manager [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Took 0.77 seconds to detach 1 volumes for instance.
Nov 29 06:37:21 user nova-compute[75083]: DEBUG nova.compute.manager [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: e1efac0d-5102-4fc6-b61e-a7f9fd898956] Deleting volume: f747894e-b1c9-4817-85dd-4c6dfebd934e {{(pid=75083) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 06:37:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:37:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:37:21 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:37:21 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:37:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:37:21 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Deleted allocations for instance e1efac0d-5102-4fc6-b61e-a7f9fd898956
Nov 29 06:37:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-526d7a00-1262-4485-a098-e4a4806b899e tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "e1efac0d-5102-4fc6-b61e-a7f9fd898956" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.312s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:37:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:37:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:37:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:37:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:37:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:36 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:37:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:37:39 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:37:41 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:37:43 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:37:43 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:37:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:37:45 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:37:46 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:37:47 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:37:47 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:37:47 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:37:47 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 06:37:48 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:37:48 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 06:37:48 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] There are 0 instances to clean {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 06:37:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:54 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:37:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:37:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:37:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:37:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:37:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:37:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:01 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:38:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:38:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:38:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:38:01 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:38:01 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:38:01 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:38:01 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=9133MB free_disk=25.072906494140625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:38:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:38:01 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:38:02 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:38:02 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:38:02 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing inventories for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 06:38:02 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Updating ProviderTree inventory for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 06:38:02 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Updating inventory in ProviderTree for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 06:38:02 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing aggregate associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, aggregates: None {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 06:38:02 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing trait associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, traits: HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 06:38:02 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:38:02 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:38:02 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:38:02 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:38:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:38:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:38:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:38:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:38:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:06 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:38:06 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75083) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 06:38:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:38:19 user nova-compute[75083]: INFO nova.compute.claims [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Claim successful on node user
Nov 29 06:38:19 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.196s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG nova.network.neutron [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:38:19 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:38:19 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:38:19 user nova-compute[75083]: INFO nova.virt.block_device [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Booting with volume f13b2e52-83cf-4a5f-86f3-9a54be08c50c at /dev/vda
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG nova.policy [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73fd740b5fe248edad95bcc269eee750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a61afbdd47455bbaa044282feb7c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG os_brick.utils [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f209a251-f649-44a6-bad6-19d2990c205a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4304da4b-b7c7-4b9a-adaa-fb98b17861df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d85d63-6910-404f-a06e-850e4d4fdd97]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b50d10-2dba-4854-832d-864877f4fbaa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:38:19 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:38:19 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7deeaa-f997-4001-89d2-2e79f7defa93]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG os_brick.utils [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:38:19 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Updating existing volume attachment record: df5a2076-8ce4-4be7-a8b3-530a973cffbb {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:38:20 user nova-compute[75083]: DEBUG nova.network.neutron [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Successfully created port: be942253-d15c-4af8-ba53-4b9d67757927 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:38:20 user nova-compute[75083]: DEBUG nova.network.neutron [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Successfully updated port: be942253-d15c-4af8-ba53-4b9d67757927 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:38:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "refresh_cache-835cb9d6-eeb8-4029-ae6e-85fe3831d773" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:38:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquired lock "refresh_cache-835cb9d6-eeb8-4029-ae6e-85fe3831d773" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:38:20 user nova-compute[75083]: DEBUG nova.network.neutron [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:38:20 user nova-compute[75083]: DEBUG nova.compute.manager [req-3add05ab-b6c7-417e-be00-864c6a0eb15f req-7228fa24-3ad7-4e24-9c8d-98700dd7fd74 service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Received event network-changed-be942253-d15c-4af8-ba53-4b9d67757927 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:38:20 user nova-compute[75083]: DEBUG nova.compute.manager [req-3add05ab-b6c7-417e-be00-864c6a0eb15f req-7228fa24-3ad7-4e24-9c8d-98700dd7fd74 service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Refreshing instance network info cache due to event network-changed-be942253-d15c-4af8-ba53-4b9d67757927. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:38:20 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3add05ab-b6c7-417e-be00-864c6a0eb15f req-7228fa24-3ad7-4e24-9c8d-98700dd7fd74 service nova] Acquiring lock "refresh_cache-835cb9d6-eeb8-4029-ae6e-85fe3831d773" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:38:21 user nova-compute[75083]: DEBUG nova.network.neutron [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:38:21 user nova-compute[75083]: DEBUG nova.network.neutron [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Updating instance_info_cache with network_info: [{"id": "be942253-d15c-4af8-ba53-4b9d67757927", "address": "fa:16:3e:da:3b:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe942253-d1", "ovs_interfaceid": "be942253-d15c-4af8-ba53-4b9d67757927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:38:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Releasing lock "refresh_cache-835cb9d6-eeb8-4029-ae6e-85fe3831d773" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:38:21 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Instance network_info: |[{"id": "be942253-d15c-4af8-ba53-4b9d67757927", "address": "fa:16:3e:da:3b:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe942253-d1", "ovs_interfaceid": "be942253-d15c-4af8-ba53-4b9d67757927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:38:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3add05ab-b6c7-417e-be00-864c6a0eb15f req-7228fa24-3ad7-4e24-9c8d-98700dd7fd74 service nova] Acquired lock "refresh_cache-835cb9d6-eeb8-4029-ae6e-85fe3831d773" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:38:21 user nova-compute[75083]: DEBUG nova.network.neutron [req-3add05ab-b6c7-417e-be00-864c6a0eb15f req-7228fa24-3ad7-4e24-9c8d-98700dd7fd74 service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Refreshing network info cache for port be942253-d15c-4af8-ba53-4b9d67757927 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:38:21 user nova-compute[75083]: DEBUG nova.network.neutron [req-3add05ab-b6c7-417e-be00-864c6a0eb15f req-7228fa24-3ad7-4e24-9c8d-98700dd7fd74 service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Updated VIF entry in instance network info cache for port be942253-d15c-4af8-ba53-4b9d67757927. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:38:21 user nova-compute[75083]: DEBUG nova.network.neutron [req-3add05ab-b6c7-417e-be00-864c6a0eb15f req-7228fa24-3ad7-4e24-9c8d-98700dd7fd74 service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Updating instance_info_cache with network_info: [{"id": "be942253-d15c-4af8-ba53-4b9d67757927", "address": "fa:16:3e:da:3b:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe942253-d1", "ovs_interfaceid": "be942253-d15c-4af8-ba53-4b9d67757927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:38:21 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3add05ab-b6c7-417e-be00-864c6a0eb15f req-7228fa24-3ad7-4e24-9c8d-98700dd7fd74 service nova] Releasing lock "refresh_cache-835cb9d6-eeb8-4029-ae6e-85fe3831d773" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:38:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:38:26 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:38:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:38:26 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Creating image(s)
Nov 29 06:38:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Did not create local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 06:38:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Ensure instance console log exists: /opt/stack/data/nova/instances/835cb9d6-eeb8-4029-ae6e-85fe3831d773/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:38:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:38:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:38:26 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:38:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Start _get_guest_xml network_info=[{"id": "be942253-d15c-4af8-ba53-4b9d67757927", "address": "fa:16:3e:da:3b:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe942253-d1", "ovs_interfaceid": "be942253-d15c-4af8-ba53-4b9d67757927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'df5a2076-8ce4-4be7-a8b3-530a973cffbb', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrLobdpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '835cb9d6-eeb8-4029-ae6e-85fe3831d773', 'attached_at': '', 'detached_at': '', 'volume_id': 'f13b2e52-83cf-4a5f-86f3-9a54be08c50c', 'serial': 'f13b2e52-83cf-4a5f-86f3-9a54be08c50c'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:38:26 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:38:26 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:38:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:38:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:38:26 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrLobdpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:38:27 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:38:27 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:38:27 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4f22ad-79a6-449c-bdc1-16214b805699]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:38:27 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[957216b5-b373-458d-b237-efe433ac5e1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c] added
Nov 29 06:38:27 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[535ecf5b-d1d2-40fe-b5d1-ba74777b5a77]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[029d3960-7054-494a-8fba-9e8ca4de4f56]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YrLobdpJ {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YrLobdpJ" returned: 0 in 0.030s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[77940ae1-46c1-4477-87c6-7b357a27e21c]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YrLobdpJ'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a91c64-f7c1-49a0-88f3-36d515514783]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1464ae3-b39b-429c-a021-9f13f9f59736]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 06:38:27 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 06:38:27 user nova-compute[75083]:  {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:38:27 user nova-compute[75083]: WARNING os_brick.initiator.connectors.iscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 06:38:27 user nova-compute[75083]: 
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[102d50fd-4f07-4411-aa6b-1de072c0fa0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c, portal: 172.16.0.220,3260]
Nov 29 06:38:27 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c, portal: 172.16.0.220,3260] successful.
Nov 29 06:38:27 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[836bb6e4-00f5-4756-9941-e7ffa619aaf0]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[db451d59-f6e2-4c1a-bd3c-b700a8ed4135]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)
Nov 29 06:38:27 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)
Nov 29 06:38:27 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[53993d28-dfd2-432b-82bd-dd557993acfa]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:38:27 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrLobdpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23737323734646338', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737323734646338', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2014492830',display_name='tempest-TestVolumeBootPattern-server-2014492830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2014492830',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhDUTFfwJIi9mzf/M769bKE2kGOxCbxL1Uu07fAF79Rkeuv2NHJDb1KJKxk7Lz+saRt3p1hMRIGehAQcPUJ3hP1O9CtPV0BLeDzCspiZHRus2Vh3hRVNFm6SpcHtcgejA==',key_name='tempest-TestVolumeBootPattern-951630595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21a61afbdd47455bbaa044282feb7c47',ramdisk_id='',reservation_id='r-0k4dz5ry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-46466774',owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:38:20Z,user_data=None,user_id='73fd740b5fe248edad95bcc269eee750',uuid=835cb9d6-eeb8-4029-ae6e-85fe3831d773,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be942253-d15c-4af8-ba53-4b9d67757927", "address": "fa:16:3e:da:3b:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe942253-d1", "ovs_interfaceid": "be942253-d15c-4af8-ba53-4b9d67757927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converting VIF {"id": "be942253-d15c-4af8-ba53-4b9d67757927", "address": "fa:16:3e:da:3b:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe942253-d1", "ovs_interfaceid": "be942253-d15c-4af8-ba53-4b9d67757927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:3b:aa,bridge_name='br-int',has_traffic_filtering=True,id=be942253-d15c-4af8-ba53-4b9d67757927,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe942253-d1') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG nova.objects.instance [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lazy-loading 'pci_devices' on Instance uuid 835cb9d6-eeb8-4029-ae6e-85fe3831d773 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:38:28 user nova-compute[75083]:   <uuid>835cb9d6-eeb8-4029-ae6e-85fe3831d773</uuid>
Nov 29 06:38:28 user nova-compute[75083]:   <name>instance-00000032</name>
Nov 29 06:38:28 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:38:28 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:38:28 user nova-compute[75083]:   <metadata>
Nov 29 06:38:28 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:38:28 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:38:28 user nova-compute[75083]:       <nova:name>tempest-TestVolumeBootPattern-server-2014492830</nova:name>
Nov 29 06:38:28 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:38:26</nova:creationTime>
Nov 29 06:38:28 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:38:28 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:38:28 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:38:28 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:38:28 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:38:28 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:38:28 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:38:28 user nova-compute[75083]:       <nova:owner>
Nov 29 06:38:28 user nova-compute[75083]:         <nova:user uuid="73fd740b5fe248edad95bcc269eee750">tempest-TestVolumeBootPattern-46466774-project-member</nova:user>
Nov 29 06:38:28 user nova-compute[75083]:         <nova:project uuid="21a61afbdd47455bbaa044282feb7c47">tempest-TestVolumeBootPattern-46466774</nova:project>
Nov 29 06:38:28 user nova-compute[75083]:       </nova:owner>
Nov 29 06:38:28 user nova-compute[75083]:       <nova:ports>
Nov 29 06:38:28 user nova-compute[75083]:         <nova:port uuid="be942253-d15c-4af8-ba53-4b9d67757927">
Nov 29 06:38:28 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 06:38:28 user nova-compute[75083]:         </nova:port>
Nov 29 06:38:28 user nova-compute[75083]:       </nova:ports>
Nov 29 06:38:28 user nova-compute[75083]:     </nova:instance>
Nov 29 06:38:28 user nova-compute[75083]:   </metadata>
Nov 29 06:38:28 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:38:28 user nova-compute[75083]:     <system>
Nov 29 06:38:28 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:38:28 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:38:28 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:38:28 user nova-compute[75083]:       <entry name="serial">835cb9d6-eeb8-4029-ae6e-85fe3831d773</entry>
Nov 29 06:38:28 user nova-compute[75083]:       <entry name="uuid">835cb9d6-eeb8-4029-ae6e-85fe3831d773</entry>
Nov 29 06:38:28 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:38:28 user nova-compute[75083]:     </system>
Nov 29 06:38:28 user nova-compute[75083]:   </sysinfo>
Nov 29 06:38:28 user nova-compute[75083]:   <os>
Nov 29 06:38:28 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:38:28 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:38:28 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:38:28 user nova-compute[75083]:   </os>
Nov 29 06:38:28 user nova-compute[75083]:   <features>
Nov 29 06:38:28 user nova-compute[75083]:     <acpi/>
Nov 29 06:38:28 user nova-compute[75083]:     <apic/>
Nov 29 06:38:28 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:38:28 user nova-compute[75083]:   </features>
Nov 29 06:38:28 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:38:28 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:38:28 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:38:28 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:38:28 user nova-compute[75083]:   </clock>
Nov 29 06:38:28 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:38:28 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:38:28 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:38:28 user nova-compute[75083]:   </cpu>
Nov 29 06:38:28 user nova-compute[75083]:   <devices>
Nov 29 06:38:28 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 06:38:28 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:38:28 user nova-compute[75083]:       <source dev="/dev/sdb"/>
Nov 29 06:38:28 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:38:28 user nova-compute[75083]:       <serial>f13b2e52-83cf-4a5f-86f3-9a54be08c50c</serial>
Nov 29 06:38:28 user nova-compute[75083]:     </disk>
Nov 29 06:38:28 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:38:28 user nova-compute[75083]:       <mac address="fa:16:3e:da:3b:aa"/>
Nov 29 06:38:28 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:38:28 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:38:28 user nova-compute[75083]:       <target dev="tapbe942253-d1"/>
Nov 29 06:38:28 user nova-compute[75083]:     </interface>
Nov 29 06:38:28 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:38:28 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/835cb9d6-eeb8-4029-ae6e-85fe3831d773/console.log" append="off"/>
Nov 29 06:38:28 user nova-compute[75083]:     </serial>
Nov 29 06:38:28 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:38:28 user nova-compute[75083]:     <video>
Nov 29 06:38:28 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:38:28 user nova-compute[75083]:     </video>
Nov 29 06:38:28 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:38:28 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:38:28 user nova-compute[75083]:     </rng>
Nov 29 06:38:28 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:38:28 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:38:28 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:38:28 user nova-compute[75083]:     </memballoon>
Nov 29 06:38:28 user nova-compute[75083]:   </devices>
Nov 29 06:38:28 user nova-compute[75083]: </domain>
Nov 29 06:38:28 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2014492830',display_name='tempest-TestVolumeBootPattern-server-2014492830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2014492830',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhDUTFfwJIi9mzf/M769bKE2kGOxCbxL1Uu07fAF79Rkeuv2NHJDb1KJKxk7Lz+saRt3p1hMRIGehAQcPUJ3hP1O9CtPV0BLeDzCspiZHRus2Vh3hRVNFm6SpcHtcgejA==',key_name='tempest-TestVolumeBootPattern-951630595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21a61afbdd47455bbaa044282feb7c47',ramdisk_id='',reservation_id='r-0k4dz5ry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-46466774',owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:38:20Z,user_data=None,user_id='73fd740b5fe248edad95bcc269eee750',uuid=835cb9d6-eeb8-4029-ae6e-85fe3831d773,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be942253-d15c-4af8-ba53-4b9d67757927", "address": "fa:16:3e:da:3b:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe942253-d1", "ovs_interfaceid": "be942253-d15c-4af8-ba53-4b9d67757927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converting VIF {"id": "be942253-d15c-4af8-ba53-4b9d67757927", "address": "fa:16:3e:da:3b:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe942253-d1", "ovs_interfaceid": "be942253-d15c-4af8-ba53-4b9d67757927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:3b:aa,bridge_name='br-int',has_traffic_filtering=True,id=be942253-d15c-4af8-ba53-4b9d67757927,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe942253-d1') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG os_vif [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:3b:aa,bridge_name='br-int',has_traffic_filtering=True,id=be942253-d15c-4af8-ba53-4b9d67757927,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe942253-d1') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48c27318-6c4e-5b37-be93-dd72bc29020e', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe942253-d1, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe942253-d1, col_values=(('qos', UUID('8f34a9c5-8050-404f-a6e8-b0b84f2e238c')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe942253-d1, col_values=(('external_ids', {'iface-id': 'be942253-d15c-4af8-ba53-4b9d67757927', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:3b:aa', 'vm-uuid': '835cb9d6-eeb8-4029-ae6e-85fe3831d773'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:28 user nova-compute[75083]: INFO os_vif [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:3b:aa,bridge_name='br-int',has_traffic_filtering=True,id=be942253-d15c-4af8-ba53-4b9d67757927,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe942253-d1')
Nov 29 06:38:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:38:28 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] No VIF found with MAC fa:16:3e:da:3b:aa, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:38:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:30 user nova-compute[75083]: DEBUG nova.compute.manager [req-cb59314f-7abd-4307-9348-d3c975bc38b1 req-eea6cddc-1dc8-4f20-a2a1-d1c2bce0ca9f service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Received event network-vif-plugged-be942253-d15c-4af8-ba53-4b9d67757927 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:38:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-cb59314f-7abd-4307-9348-d3c975bc38b1 req-eea6cddc-1dc8-4f20-a2a1-d1c2bce0ca9f service nova] Acquiring lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:38:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-cb59314f-7abd-4307-9348-d3c975bc38b1 req-eea6cddc-1dc8-4f20-a2a1-d1c2bce0ca9f service nova] Lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:38:30 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-cb59314f-7abd-4307-9348-d3c975bc38b1 req-eea6cddc-1dc8-4f20-a2a1-d1c2bce0ca9f service nova] Lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:38:30 user nova-compute[75083]: DEBUG nova.compute.manager [req-cb59314f-7abd-4307-9348-d3c975bc38b1 req-eea6cddc-1dc8-4f20-a2a1-d1c2bce0ca9f service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] No waiting events found dispatching network-vif-plugged-be942253-d15c-4af8-ba53-4b9d67757927 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:38:30 user nova-compute[75083]: WARNING nova.compute.manager [req-cb59314f-7abd-4307-9348-d3c975bc38b1 req-eea6cddc-1dc8-4f20-a2a1-d1c2bce0ca9f service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Received unexpected event network-vif-plugged-be942253-d15c-4af8-ba53-4b9d67757927 for instance with vm_state building and task_state spawning.
Nov 29 06:38:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:32 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:38:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:38:32 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Instance spawned successfully.
Nov 29 06:38:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:38:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:38:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:38:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:38:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:38:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:38:32 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:38:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:32 user nova-compute[75083]: INFO nova.compute.manager [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 29 06:38:32 user nova-compute[75083]: DEBUG nova.compute.manager [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:38:32 user nova-compute[75083]: DEBUG nova.compute.manager [req-b62bddf3-a07d-427a-81d9-0e3174af2d6d req-659f7c81-e0f1-422e-8bf1-42a94093e8a7 service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Received event network-vif-plugged-be942253-d15c-4af8-ba53-4b9d67757927 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:38:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b62bddf3-a07d-427a-81d9-0e3174af2d6d req-659f7c81-e0f1-422e-8bf1-42a94093e8a7 service nova] Acquiring lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:38:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b62bddf3-a07d-427a-81d9-0e3174af2d6d req-659f7c81-e0f1-422e-8bf1-42a94093e8a7 service nova] Lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:38:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b62bddf3-a07d-427a-81d9-0e3174af2d6d req-659f7c81-e0f1-422e-8bf1-42a94093e8a7 service nova] Lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:38:32 user nova-compute[75083]: DEBUG nova.compute.manager [req-b62bddf3-a07d-427a-81d9-0e3174af2d6d req-659f7c81-e0f1-422e-8bf1-42a94093e8a7 service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] No waiting events found dispatching network-vif-plugged-be942253-d15c-4af8-ba53-4b9d67757927 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:38:32 user nova-compute[75083]: WARNING nova.compute.manager [req-b62bddf3-a07d-427a-81d9-0e3174af2d6d req-659f7c81-e0f1-422e-8bf1-42a94093e8a7 service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Received unexpected event network-vif-plugged-be942253-d15c-4af8-ba53-4b9d67757927 for instance with vm_state building and task_state spawning.
Nov 29 06:38:32 user nova-compute[75083]: INFO nova.compute.manager [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Took 13.12 seconds to build instance.
Nov 29 06:38:32 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-d8bdc529-ca67-48cf-bc21-27bbde5d7604 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.221s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:38:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:35 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:38:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:41 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:38:41 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:38:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:43 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:38:43 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:38:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:47 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:38:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:48 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:38:48 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:38:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:38:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:38:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:38:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-835cb9d6-eeb8-4029-ae6e-85fe3831d773" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:38:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-835cb9d6-eeb8-4029-ae6e-85fe3831d773" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:38:49 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:38:49 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lazy-loading 'info_cache' on Instance uuid 835cb9d6-eeb8-4029-ae6e-85fe3831d773 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:38:50 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Updating instance_info_cache with network_info: [{"id": "be942253-d15c-4af8-ba53-4b9d67757927", "address": "fa:16:3e:da:3b:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe942253-d1", "ovs_interfaceid": "be942253-d15c-4af8-ba53-4b9d67757927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:38:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-835cb9d6-eeb8-4029-ae6e-85fe3831d773" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:38:50 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:38:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:55 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:38:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:38:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:39:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:39:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:39:03 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:39:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:39:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:39:03 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:39:03 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:39:03 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:39:04 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:39:04 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:39:04 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8970MB free_disk=25.062908172607422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:39:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:39:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:39:04 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 835cb9d6-eeb8-4029-ae6e-85fe3831d773 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:39:04 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:39:04 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:39:04 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:39:04 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:39:04 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:39:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:39:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:39:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:39:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:39:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:39:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:39:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:39:36 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:39:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:39:42 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:39:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:39:43 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:39:43 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:39:43 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:39:47 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:39:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:39:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:39:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:39:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:39:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-835cb9d6-eeb8-4029-ae6e-85fe3831d773" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:39:49 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-835cb9d6-eeb8-4029-ae6e-85fe3831d773" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:39:49 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:39:49 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lazy-loading 'info_cache' on Instance uuid 835cb9d6-eeb8-4029-ae6e-85fe3831d773 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:39:50 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Updating instance_info_cache with network_info: [{"id": "be942253-d15c-4af8-ba53-4b9d67757927", "address": "fa:16:3e:da:3b:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe942253-d1", "ovs_interfaceid": "be942253-d15c-4af8-ba53-4b9d67757927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:39:50 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-835cb9d6-eeb8-4029-ae6e-85fe3831d773" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:39:50 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:39:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:39:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:39:57 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:39:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:39:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:39:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:39:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:39:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:39:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:04 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:40:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:40:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:40:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:40:04 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:40:04 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:40:05 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:40:05 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:40:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=9014MB free_disk=25.062374114990234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:40:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:40:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:40:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 835cb9d6-eeb8-4029-ae6e-85fe3831d773 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:40:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:40:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:40:05 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:40:05 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:40:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:40:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.412s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:40:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:40:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:40:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:40:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:40:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:11 user nova-compute[75083]: DEBUG nova.compute.manager [req-2d1dba08-294c-40fc-ac38-ae677f2eed08 req-d6465017-b86f-4746-b11a-70549cac6fc5 service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Received event network-changed-be942253-d15c-4af8-ba53-4b9d67757927 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:40:11 user nova-compute[75083]: DEBUG nova.compute.manager [req-2d1dba08-294c-40fc-ac38-ae677f2eed08 req-d6465017-b86f-4746-b11a-70549cac6fc5 service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Refreshing instance network info cache due to event network-changed-be942253-d15c-4af8-ba53-4b9d67757927. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:40:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2d1dba08-294c-40fc-ac38-ae677f2eed08 req-d6465017-b86f-4746-b11a-70549cac6fc5 service nova] Acquiring lock "refresh_cache-835cb9d6-eeb8-4029-ae6e-85fe3831d773" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:40:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2d1dba08-294c-40fc-ac38-ae677f2eed08 req-d6465017-b86f-4746-b11a-70549cac6fc5 service nova] Acquired lock "refresh_cache-835cb9d6-eeb8-4029-ae6e-85fe3831d773" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:40:11 user nova-compute[75083]: DEBUG nova.network.neutron [req-2d1dba08-294c-40fc-ac38-ae677f2eed08 req-d6465017-b86f-4746-b11a-70549cac6fc5 service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Refreshing network info cache for port be942253-d15c-4af8-ba53-4b9d67757927 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:40:11 user nova-compute[75083]: DEBUG nova.network.neutron [req-2d1dba08-294c-40fc-ac38-ae677f2eed08 req-d6465017-b86f-4746-b11a-70549cac6fc5 service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Updated VIF entry in instance network info cache for port be942253-d15c-4af8-ba53-4b9d67757927. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:40:11 user nova-compute[75083]: DEBUG nova.network.neutron [req-2d1dba08-294c-40fc-ac38-ae677f2eed08 req-d6465017-b86f-4746-b11a-70549cac6fc5 service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Updating instance_info_cache with network_info: [{"id": "be942253-d15c-4af8-ba53-4b9d67757927", "address": "fa:16:3e:da:3b:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe942253-d1", "ovs_interfaceid": "be942253-d15c-4af8-ba53-4b9d67757927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:40:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-2d1dba08-294c-40fc-ac38-ae677f2eed08 req-d6465017-b86f-4746-b11a-70549cac6fc5 service nova] Releasing lock "refresh_cache-835cb9d6-eeb8-4029-ae6e-85fe3831d773" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:40:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:40:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:40:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:40:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:40:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:40:12 user nova-compute[75083]: INFO nova.compute.manager [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Terminating instance
Nov 29 06:40:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:40:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:12 user nova-compute[75083]: DEBUG nova.compute.manager [req-ebfd208c-341f-4265-8a42-b973cd8e17b1 req-761e6b73-1b09-4edc-acd8-23d976f891e9 service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Received event network-vif-unplugged-be942253-d15c-4af8-ba53-4b9d67757927 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:40:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ebfd208c-341f-4265-8a42-b973cd8e17b1 req-761e6b73-1b09-4edc-acd8-23d976f891e9 service nova] Acquiring lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:40:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ebfd208c-341f-4265-8a42-b973cd8e17b1 req-761e6b73-1b09-4edc-acd8-23d976f891e9 service nova] Lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:40:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ebfd208c-341f-4265-8a42-b973cd8e17b1 req-761e6b73-1b09-4edc-acd8-23d976f891e9 service nova] Lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:40:12 user nova-compute[75083]: DEBUG nova.compute.manager [req-ebfd208c-341f-4265-8a42-b973cd8e17b1 req-761e6b73-1b09-4edc-acd8-23d976f891e9 service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] No waiting events found dispatching network-vif-unplugged-be942253-d15c-4af8-ba53-4b9d67757927 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:40:12 user nova-compute[75083]: DEBUG nova.compute.manager [req-ebfd208c-341f-4265-8a42-b973cd8e17b1 req-761e6b73-1b09-4edc-acd8-23d976f891e9 service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Received event network-vif-unplugged-be942253-d15c-4af8-ba53-4b9d67757927 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:40:13 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Instance destroyed successfully.
Nov 29 06:40:13 user nova-compute[75083]: DEBUG nova.objects.instance [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lazy-loading 'resources' on Instance uuid 835cb9d6-eeb8-4029-ae6e-85fe3831d773 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2014492830',display_name='tempest-TestVolumeBootPattern-server-2014492830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2014492830',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhDUTFfwJIi9mzf/M769bKE2kGOxCbxL1Uu07fAF79Rkeuv2NHJDb1KJKxk7Lz+saRt3p1hMRIGehAQcPUJ3hP1O9CtPV0BLeDzCspiZHRus2Vh3hRVNFm6SpcHtcgejA==',key_name='tempest-TestVolumeBootPattern-951630595',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:38:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21a61afbdd47455bbaa044282feb7c47',ramdisk_id='',reservation_id='r-0k4dz5ry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-46466774',owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:38:32Z,user_data=None,user_id='73fd740b5fe248edad95bcc269eee750',uuid=835cb9d6-eeb8-4029-ae6e-85fe3831d773,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be942253-d15c-4af8-ba53-4b9d67757927", "address": "fa:16:3e:da:3b:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe942253-d1", "ovs_interfaceid": "be942253-d15c-4af8-ba53-4b9d67757927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converting VIF {"id": "be942253-d15c-4af8-ba53-4b9d67757927", "address": "fa:16:3e:da:3b:aa", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe942253-d1", "ovs_interfaceid": "be942253-d15c-4af8-ba53-4b9d67757927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:3b:aa,bridge_name='br-int',has_traffic_filtering=True,id=be942253-d15c-4af8-ba53-4b9d67757927,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe942253-d1') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_vif [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:3b:aa,bridge_name='br-int',has_traffic_filtering=True,id=be942253-d15c-4af8-ba53-4b9d67757927,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe942253-d1') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe942253-d1, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f34a9c5-8050-404f-a6e8-b0b84f2e238c) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:13 user nova-compute[75083]: INFO os_vif [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:3b:aa,bridge_name='br-int',has_traffic_filtering=True,id=be942253-d15c-4af8-ba53-4b9d67757927,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe942253-d1')
Nov 29 06:40:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrLobdpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:40:13 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[547d2a20-584b-4348-909e-7429e1e28359]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:40:13 user nova-compute[75083]: No targets found.
Nov 29 06:40:13 user nova-compute[75083]: iSNS:
Nov 29 06:40:13 user nova-compute[75083]: No targets found.
Nov 29 06:40:13 user nova-compute[75083]: STATIC:
Nov 29 06:40:13 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c
Nov 29 06:40:13 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:40:13 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:40:13 user nova-compute[75083]: FIRMWARE:
Nov 29 06:40:13 user nova-compute[75083]: No targets found.
Nov 29 06:40:13 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:40:13 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:40:13 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[beebb77d-1b95-42d9-be0a-fc4addbc32fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fce48a-43c3-40a7-a5ee-30ec7026260c]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)
Nov 29 06:40:13 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)
Nov 29 06:40:13 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b8172440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca1e6a5-cc86-49c1-9698-f6ed4b999901]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f30277-57a3-4f23-9eb9-1b475d2bdc49]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d810f1db-3d0e-4566-b395-bb5b94873941]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9884a1-d6bf-4e73-9abd-681513b6e8e2]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dcc4cd-9c2e-46e2-ae0a-397dec5dfd72]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8905c2c0-0200-41b1-b615-940997513a1e]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c, portal: 172.16.0.220,3260]
Nov 29 06:40:13 user nova-compute[75083]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c, portal: 172.16.0.220,3260] successful.
Nov 29 06:40:13 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0206b2-b51c-47f6-ab23-1d6f21e8ff15]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] <== disconnect_volume: return (298ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:40:13 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Deleting instance files /opt/stack/data/nova/instances/835cb9d6-eeb8-4029-ae6e-85fe3831d773_del
Nov 29 06:40:13 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Deletion of /opt/stack/data/nova/instances/835cb9d6-eeb8-4029-ae6e-85fe3831d773_del complete
Nov 29 06:40:13 user nova-compute[75083]: INFO nova.compute.manager [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 29 06:40:13 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:40:13 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:40:14 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:40:14 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Took 0.64 seconds to deallocate network for instance.
Nov 29 06:40:14 user nova-compute[75083]: DEBUG nova.compute.manager [req-0fb4e512-3b94-4984-bfe2-d76a3c2c84a2 req-c7fe5071-079b-417c-85a7-e0e704ff969b service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Received event network-vif-plugged-be942253-d15c-4af8-ba53-4b9d67757927 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:40:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0fb4e512-3b94-4984-bfe2-d76a3c2c84a2 req-c7fe5071-079b-417c-85a7-e0e704ff969b service nova] Acquiring lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:40:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0fb4e512-3b94-4984-bfe2-d76a3c2c84a2 req-c7fe5071-079b-417c-85a7-e0e704ff969b service nova] Lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:40:14 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-0fb4e512-3b94-4984-bfe2-d76a3c2c84a2 req-c7fe5071-079b-417c-85a7-e0e704ff969b service nova] Lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:40:14 user nova-compute[75083]: DEBUG nova.compute.manager [req-0fb4e512-3b94-4984-bfe2-d76a3c2c84a2 req-c7fe5071-079b-417c-85a7-e0e704ff969b service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] No waiting events found dispatching network-vif-plugged-be942253-d15c-4af8-ba53-4b9d67757927 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:40:14 user nova-compute[75083]: WARNING nova.compute.manager [req-0fb4e512-3b94-4984-bfe2-d76a3c2c84a2 req-c7fe5071-079b-417c-85a7-e0e704ff969b service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Received unexpected event network-vif-plugged-be942253-d15c-4af8-ba53-4b9d67757927 for instance with vm_state active and task_state deleting.
Nov 29 06:40:14 user nova-compute[75083]: DEBUG nova.compute.manager [req-0fb4e512-3b94-4984-bfe2-d76a3c2c84a2 req-c7fe5071-079b-417c-85a7-e0e704ff969b service nova] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Received event network-vif-deleted-be942253-d15c-4af8-ba53-4b9d67757927 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:40:15 user nova-compute[75083]: INFO nova.compute.manager [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 835cb9d6-eeb8-4029-ae6e-85fe3831d773] Took 0.85 seconds to detach 1 volumes for instance.
Nov 29 06:40:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:40:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:40:15 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:40:15 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:40:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:40:15 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Deleted allocations for instance 835cb9d6-eeb8-4029-ae6e-85fe3831d773
Nov 29 06:40:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-178a635b-b189-40d9-9fb8-fce21a3cf920 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "835cb9d6-eeb8-4029-ae6e-85fe3831d773" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.932s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:40:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:40:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:40:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:40:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:40:38 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:40:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:40:43 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:40:43 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:40:44 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:40:45 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:40:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:40:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:40:51 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:40:51 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:40:51 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:40:51 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:40:51 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 06:40:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:40:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:40:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:40:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:40:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:40:59 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:41:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:41:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:41:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:41:04 user nova-compute[75083]: DEBUG nova.compute.manager [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:41:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:41:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:41:04 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:41:04 user nova-compute[75083]: INFO nova.compute.claims [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Claim successful on node user
Nov 29 06:41:04 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.274s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG nova.compute.manager [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG nova.compute.manager [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG nova.network.neutron [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:41:05 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:41:05 user nova-compute[75083]: DEBUG nova.compute.manager [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG nova.policy [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73fd740b5fe248edad95bcc269eee750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a61afbdd47455bbaa044282feb7c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:41:05 user nova-compute[75083]: INFO nova.virt.block_device [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Booting with volume f13b2e52-83cf-4a5f-86f3-9a54be08c50c at /dev/vda
Nov 29 06:41:05 user nova-compute[75083]: DEBUG os_brick.utils [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[31816f3b-c913-43a0-97d2-c4ac8d088217]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cc89ed-2cdb-49ee-a07d-705e86ee20ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[05438e7a-014d-4802-a1c4-641c101c63de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d233ca-ea2a-472c-bd57-4b96032a7013]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:41:05 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:41:05 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaaf63d-e4b4-4f48-9f50-6e0ab0919f9a]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG os_brick.utils [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Updating existing volume attachment record: 1f9b773f-a43f-4af2-ac2c-33d7f0b17ec6 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:41:05 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:41:06 user nova-compute[75083]: DEBUG nova.network.neutron [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Successfully created port: bde939d7-e915-4b75-a4d1-37646df5a309 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:41:06 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:41:06 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:41:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=9143MB free_disk=25.061317443847656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:41:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:41:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:41:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 12a1a411-7fac-40bb-986c-9a8fab7d7cac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:41:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:41:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:41:06 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:41:06 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:41:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:41:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:41:06 user nova-compute[75083]: DEBUG nova.network.neutron [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Successfully updated port: bde939d7-e915-4b75-a4d1-37646df5a309 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:41:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:41:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquired lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:41:06 user nova-compute[75083]: DEBUG nova.network.neutron [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:41:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-7e655a13-4303-4b54-b08c-c9c03c4ef5ad req-3f83872c-6eab-460a-892e-2c3765cf1005 service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Received event network-changed-bde939d7-e915-4b75-a4d1-37646df5a309 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:41:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-7e655a13-4303-4b54-b08c-c9c03c4ef5ad req-3f83872c-6eab-460a-892e-2c3765cf1005 service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Refreshing instance network info cache due to event network-changed-bde939d7-e915-4b75-a4d1-37646df5a309. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:41:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7e655a13-4303-4b54-b08c-c9c03c4ef5ad req-3f83872c-6eab-460a-892e-2c3765cf1005 service nova] Acquiring lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:41:06 user nova-compute[75083]: DEBUG nova.network.neutron [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:41:07 user nova-compute[75083]: DEBUG nova.network.neutron [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Updating instance_info_cache with network_info: [{"id": "bde939d7-e915-4b75-a4d1-37646df5a309", "address": "fa:16:3e:e0:40:44", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde939d7-e9", "ovs_interfaceid": "bde939d7-e915-4b75-a4d1-37646df5a309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:41:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Releasing lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:41:07 user nova-compute[75083]: DEBUG nova.compute.manager [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Instance network_info: |[{"id": "bde939d7-e915-4b75-a4d1-37646df5a309", "address": "fa:16:3e:e0:40:44", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde939d7-e9", "ovs_interfaceid": "bde939d7-e915-4b75-a4d1-37646df5a309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:41:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7e655a13-4303-4b54-b08c-c9c03c4ef5ad req-3f83872c-6eab-460a-892e-2c3765cf1005 service nova] Acquired lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:41:07 user nova-compute[75083]: DEBUG nova.network.neutron [req-7e655a13-4303-4b54-b08c-c9c03c4ef5ad req-3f83872c-6eab-460a-892e-2c3765cf1005 service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Refreshing network info cache for port bde939d7-e915-4b75-a4d1-37646df5a309 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:41:07 user nova-compute[75083]: DEBUG nova.network.neutron [req-7e655a13-4303-4b54-b08c-c9c03c4ef5ad req-3f83872c-6eab-460a-892e-2c3765cf1005 service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Updated VIF entry in instance network info cache for port bde939d7-e915-4b75-a4d1-37646df5a309. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:41:07 user nova-compute[75083]: DEBUG nova.network.neutron [req-7e655a13-4303-4b54-b08c-c9c03c4ef5ad req-3f83872c-6eab-460a-892e-2c3765cf1005 service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Updating instance_info_cache with network_info: [{"id": "bde939d7-e915-4b75-a4d1-37646df5a309", "address": "fa:16:3e:e0:40:44", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde939d7-e9", "ovs_interfaceid": "bde939d7-e915-4b75-a4d1-37646df5a309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:41:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-7e655a13-4303-4b54-b08c-c9c03c4ef5ad req-3f83872c-6eab-460a-892e-2c3765cf1005 service nova] Releasing lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:41:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:41:12 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Creating image(s)
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Did not create local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Ensure instance console log exists: /opt/stack/data/nova/instances/12a1a411-7fac-40bb-986c-9a8fab7d7cac/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Start _get_guest_xml network_info=[{"id": "bde939d7-e915-4b75-a4d1-37646df5a309", "address": "fa:16:3e:e0:40:44", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde939d7-e9", "ovs_interfaceid": "bde939d7-e915-4b75-a4d1-37646df5a309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '1f9b773f-a43f-4af2-ac2c-33d7f0b17ec6', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrLobdpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '12a1a411-7fac-40bb-986c-9a8fab7d7cac', 'attached_at': '', 'detached_at': '', 'volume_id': 'f13b2e52-83cf-4a5f-86f3-9a54be08c50c', 'serial': 'f13b2e52-83cf-4a5f-86f3-9a54be08c50c'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:41:12 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:41:12 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrLobdpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:41:12 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:41:12 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:41:12 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[048f467d-f57d-4612-9e3c-f22ac114168b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:41:12 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5763e100-bc86-4c2a-83d5-9fcbc909c16e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c] added
Nov 29 06:41:12 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07b48ee-ba20-42f9-adb3-415553e6bf40]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b76d6f6-3f21-429c-8eda-5c5b07539f41]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YrLobdpJ {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YrLobdpJ" returned: 0 in 0.017s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6e57e1-7ce8-4321-8a15-2a938ad1f6c0]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YrLobdpJ'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5124717-b9b7-4a5a-8cf8-6bbc8676e5c1]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[88095e36-bc4c-4e59-800f-7f4d33494041]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 06:41:12 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 06:41:12 user nova-compute[75083]:  {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:41:12 user nova-compute[75083]: WARNING os_brick.initiator.connectors.iscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 06:41:12 user nova-compute[75083]: 
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6666d92-4b0a-4599-9b39-ed14f5566c7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c, portal: 172.16.0.220,3260]
Nov 29 06:41:12 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c, portal: 172.16.0.220,3260] successful.
Nov 29 06:41:12 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[799028cb-2d51-476c-9bd4-a71ae0f30a03]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d76ed74-fcaa-4337-99c4-4d0b4a834434]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)
Nov 29 06:41:12 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)
Nov 29 06:41:12 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7a11fe-4c77-49d2-b2bb-4da2eebcf67d]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:41:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrLobdpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:41:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:41:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:41:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23737323734646338', 'path': '/dev/sdb'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:41:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737323734646338', 'path': '/dev/sdb'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:41:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1010045530',display_name='tempest-TestVolumeBootPattern-server-1010045530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1010045530',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhDUTFfwJIi9mzf/M769bKE2kGOxCbxL1Uu07fAF79Rkeuv2NHJDb1KJKxk7Lz+saRt3p1hMRIGehAQcPUJ3hP1O9CtPV0BLeDzCspiZHRus2Vh3hRVNFm6SpcHtcgejA==',key_name='tempest-TestVolumeBootPattern-951630595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21a61afbdd47455bbaa044282feb7c47',ramdisk_id='',reservation_id='r-lk5akce7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-46466774',owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:41:05Z,user_data=None,user_id='73fd740b5fe248edad95bcc269eee750',uuid=12a1a411-7fac-40bb-986c-9a8fab7d7cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bde939d7-e915-4b75-a4d1-37646df5a309", "address": "fa:16:3e:e0:40:44", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde939d7-e9", "ovs_interfaceid": "bde939d7-e915-4b75-a4d1-37646df5a309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converting VIF {"id": "bde939d7-e915-4b75-a4d1-37646df5a309", "address": "fa:16:3e:e0:40:44", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde939d7-e9", "ovs_interfaceid": "bde939d7-e915-4b75-a4d1-37646df5a309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:40:44,bridge_name='br-int',has_traffic_filtering=True,id=bde939d7-e915-4b75-a4d1-37646df5a309,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde939d7-e9') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG nova.objects.instance [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lazy-loading 'pci_devices' on Instance uuid 12a1a411-7fac-40bb-986c-9a8fab7d7cac {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:41:14 user nova-compute[75083]:   <uuid>12a1a411-7fac-40bb-986c-9a8fab7d7cac</uuid>
Nov 29 06:41:14 user nova-compute[75083]:   <name>instance-00000033</name>
Nov 29 06:41:14 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:41:14 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:41:14 user nova-compute[75083]:   <metadata>
Nov 29 06:41:14 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:41:14 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:41:14 user nova-compute[75083]:       <nova:name>tempest-TestVolumeBootPattern-server-1010045530</nova:name>
Nov 29 06:41:14 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:41:12</nova:creationTime>
Nov 29 06:41:14 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:41:14 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:41:14 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:41:14 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:41:14 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:41:14 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:41:14 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:41:14 user nova-compute[75083]:       <nova:owner>
Nov 29 06:41:14 user nova-compute[75083]:         <nova:user uuid="73fd740b5fe248edad95bcc269eee750">tempest-TestVolumeBootPattern-46466774-project-member</nova:user>
Nov 29 06:41:14 user nova-compute[75083]:         <nova:project uuid="21a61afbdd47455bbaa044282feb7c47">tempest-TestVolumeBootPattern-46466774</nova:project>
Nov 29 06:41:14 user nova-compute[75083]:       </nova:owner>
Nov 29 06:41:14 user nova-compute[75083]:       <nova:ports>
Nov 29 06:41:14 user nova-compute[75083]:         <nova:port uuid="bde939d7-e915-4b75-a4d1-37646df5a309">
Nov 29 06:41:14 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 06:41:14 user nova-compute[75083]:         </nova:port>
Nov 29 06:41:14 user nova-compute[75083]:       </nova:ports>
Nov 29 06:41:14 user nova-compute[75083]:     </nova:instance>
Nov 29 06:41:14 user nova-compute[75083]:   </metadata>
Nov 29 06:41:14 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:41:14 user nova-compute[75083]:     <system>
Nov 29 06:41:14 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:41:14 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:41:14 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:41:14 user nova-compute[75083]:       <entry name="serial">12a1a411-7fac-40bb-986c-9a8fab7d7cac</entry>
Nov 29 06:41:14 user nova-compute[75083]:       <entry name="uuid">12a1a411-7fac-40bb-986c-9a8fab7d7cac</entry>
Nov 29 06:41:14 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:41:14 user nova-compute[75083]:     </system>
Nov 29 06:41:14 user nova-compute[75083]:   </sysinfo>
Nov 29 06:41:14 user nova-compute[75083]:   <os>
Nov 29 06:41:14 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:41:14 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:41:14 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:41:14 user nova-compute[75083]:   </os>
Nov 29 06:41:14 user nova-compute[75083]:   <features>
Nov 29 06:41:14 user nova-compute[75083]:     <acpi/>
Nov 29 06:41:14 user nova-compute[75083]:     <apic/>
Nov 29 06:41:14 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:41:14 user nova-compute[75083]:   </features>
Nov 29 06:41:14 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:41:14 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:41:14 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:41:14 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:41:14 user nova-compute[75083]:   </clock>
Nov 29 06:41:14 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:41:14 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:41:14 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:41:14 user nova-compute[75083]:   </cpu>
Nov 29 06:41:14 user nova-compute[75083]:   <devices>
Nov 29 06:41:14 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 06:41:14 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:41:14 user nova-compute[75083]:       <source dev="/dev/sdb"/>
Nov 29 06:41:14 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:41:14 user nova-compute[75083]:       <serial>f13b2e52-83cf-4a5f-86f3-9a54be08c50c</serial>
Nov 29 06:41:14 user nova-compute[75083]:     </disk>
Nov 29 06:41:14 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:41:14 user nova-compute[75083]:       <mac address="fa:16:3e:e0:40:44"/>
Nov 29 06:41:14 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:41:14 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:41:14 user nova-compute[75083]:       <target dev="tapbde939d7-e9"/>
Nov 29 06:41:14 user nova-compute[75083]:     </interface>
Nov 29 06:41:14 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:41:14 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/12a1a411-7fac-40bb-986c-9a8fab7d7cac/console.log" append="off"/>
Nov 29 06:41:14 user nova-compute[75083]:     </serial>
Nov 29 06:41:14 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:41:14 user nova-compute[75083]:     <video>
Nov 29 06:41:14 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:41:14 user nova-compute[75083]:     </video>
Nov 29 06:41:14 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:41:14 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:41:14 user nova-compute[75083]:     </rng>
Nov 29 06:41:14 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:41:14 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:41:14 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:41:14 user nova-compute[75083]:     </memballoon>
Nov 29 06:41:14 user nova-compute[75083]:   </devices>
Nov 29 06:41:14 user nova-compute[75083]: </domain>
Nov 29 06:41:14 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:41:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1010045530',display_name='tempest-TestVolumeBootPattern-server-1010045530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1010045530',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhDUTFfwJIi9mzf/M769bKE2kGOxCbxL1Uu07fAF79Rkeuv2NHJDb1KJKxk7Lz+saRt3p1hMRIGehAQcPUJ3hP1O9CtPV0BLeDzCspiZHRus2Vh3hRVNFm6SpcHtcgejA==',key_name='tempest-TestVolumeBootPattern-951630595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21a61afbdd47455bbaa044282feb7c47',ramdisk_id='',reservation_id='r-lk5akce7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-46466774',owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:41:05Z,user_data=None,user_id='73fd740b5fe248edad95bcc269eee750',uuid=12a1a411-7fac-40bb-986c-9a8fab7d7cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bde939d7-e915-4b75-a4d1-37646df5a309", "address": "fa:16:3e:e0:40:44", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde939d7-e9", "ovs_interfaceid": "bde939d7-e915-4b75-a4d1-37646df5a309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converting VIF {"id": "bde939d7-e915-4b75-a4d1-37646df5a309", "address": "fa:16:3e:e0:40:44", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde939d7-e9", "ovs_interfaceid": "bde939d7-e915-4b75-a4d1-37646df5a309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:40:44,bridge_name='br-int',has_traffic_filtering=True,id=bde939d7-e915-4b75-a4d1-37646df5a309,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde939d7-e9') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG os_vif [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:40:44,bridge_name='br-int',has_traffic_filtering=True,id=bde939d7-e915-4b75-a4d1-37646df5a309,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde939d7-e9') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eae1b323-5447-5788-8bee-885e5f94309c', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbde939d7-e9, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbde939d7-e9, col_values=(('qos', UUID('76d45aaa-c228-4c67-9058-fa10faa05ea4')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbde939d7-e9, col_values=(('external_ids', {'iface-id': 'bde939d7-e915-4b75-a4d1-37646df5a309', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:40:44', 'vm-uuid': '12a1a411-7fac-40bb-986c-9a8fab7d7cac'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:14 user nova-compute[75083]: INFO os_vif [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:40:44,bridge_name='br-int',has_traffic_filtering=True,id=bde939d7-e915-4b75-a4d1-37646df5a309,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde939d7-e9')
Nov 29 06:41:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:41:14 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] No VIF found with MAC fa:16:3e:e0:40:44, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:41:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:15 user nova-compute[75083]: DEBUG nova.compute.manager [req-a7426bb5-c042-44f6-999e-3ae146848b15 req-ba3c930b-f1f1-438d-bcff-59d844115ce8 service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Received event network-vif-plugged-bde939d7-e915-4b75-a4d1-37646df5a309 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:41:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a7426bb5-c042-44f6-999e-3ae146848b15 req-ba3c930b-f1f1-438d-bcff-59d844115ce8 service nova] Acquiring lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:41:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a7426bb5-c042-44f6-999e-3ae146848b15 req-ba3c930b-f1f1-438d-bcff-59d844115ce8 service nova] Lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:41:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-a7426bb5-c042-44f6-999e-3ae146848b15 req-ba3c930b-f1f1-438d-bcff-59d844115ce8 service nova] Lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:41:15 user nova-compute[75083]: DEBUG nova.compute.manager [req-a7426bb5-c042-44f6-999e-3ae146848b15 req-ba3c930b-f1f1-438d-bcff-59d844115ce8 service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] No waiting events found dispatching network-vif-plugged-bde939d7-e915-4b75-a4d1-37646df5a309 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:41:15 user nova-compute[75083]: WARNING nova.compute.manager [req-a7426bb5-c042-44f6-999e-3ae146848b15 req-ba3c930b-f1f1-438d-bcff-59d844115ce8 service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Received unexpected event network-vif-plugged-bde939d7-e915-4b75-a4d1-37646df5a309 for instance with vm_state building and task_state spawning.
Nov 29 06:41:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:17 user nova-compute[75083]: DEBUG nova.compute.manager [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:41:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:41:17 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Instance spawned successfully.
Nov 29 06:41:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:41:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:41:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:41:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:41:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:41:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:41:17 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:41:17 user nova-compute[75083]: INFO nova.compute.manager [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 29 06:41:17 user nova-compute[75083]: DEBUG nova.compute.manager [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:41:17 user nova-compute[75083]: INFO nova.compute.manager [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Took 12.95 seconds to build instance.
Nov 29 06:41:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-cbcd4a6c-840f-4360-9fd2-66a3afe4b823 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.050s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:41:17 user nova-compute[75083]: DEBUG nova.compute.manager [req-53af9178-a20a-44ee-8b19-95c50baab08f req-e6da0dd4-443e-40e7-918b-9f5ba213303a service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Received event network-vif-plugged-bde939d7-e915-4b75-a4d1-37646df5a309 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:41:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53af9178-a20a-44ee-8b19-95c50baab08f req-e6da0dd4-443e-40e7-918b-9f5ba213303a service nova] Acquiring lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:41:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53af9178-a20a-44ee-8b19-95c50baab08f req-e6da0dd4-443e-40e7-918b-9f5ba213303a service nova] Lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:41:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-53af9178-a20a-44ee-8b19-95c50baab08f req-e6da0dd4-443e-40e7-918b-9f5ba213303a service nova] Lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:41:17 user nova-compute[75083]: DEBUG nova.compute.manager [req-53af9178-a20a-44ee-8b19-95c50baab08f req-e6da0dd4-443e-40e7-918b-9f5ba213303a service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] No waiting events found dispatching network-vif-plugged-bde939d7-e915-4b75-a4d1-37646df5a309 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:41:17 user nova-compute[75083]: WARNING nova.compute.manager [req-53af9178-a20a-44ee-8b19-95c50baab08f req-e6da0dd4-443e-40e7-918b-9f5ba213303a service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Received unexpected event network-vif-plugged-bde939d7-e915-4b75-a4d1-37646df5a309 for instance with vm_state active and task_state None.
Nov 29 06:41:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:22 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:39 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:41:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:44 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:41:44 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:41:44 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:41:46 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:41:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:41:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:41:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:41:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:41:53 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:41:53 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:41:53 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:41:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:41:53 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:41:53 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:41:53 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lazy-loading 'info_cache' on Instance uuid 12a1a411-7fac-40bb-986c-9a8fab7d7cac {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:41:54 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Updating instance_info_cache with network_info: [{"id": "bde939d7-e915-4b75-a4d1-37646df5a309", "address": "fa:16:3e:e0:40:44", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde939d7-e9", "ovs_interfaceid": "bde939d7-e915-4b75-a4d1-37646df5a309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:41:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:41:54 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:41:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:41:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:42:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:42:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:42:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:42:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:42:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:42:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:42:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:42:06 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:42:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:42:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:42:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:42:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:42:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:42:07 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:42:07 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:42:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=9015MB free_disk=25.059803009033203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:42:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:42:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:42:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 12a1a411-7fac-40bb-986c-9a8fab7d7cac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:42:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:42:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:42:07 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:42:07 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:42:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:42:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:42:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:42:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:42:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:42:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:42:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:42:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:42:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:42:19 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:42:24 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:42:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:42:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:42:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:42:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:42:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:42:29 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:42:34 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:42:39 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:42:41 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:42:44 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:42:45 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:42:45 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:42:46 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:42:47 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:42:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:42:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:42:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:42:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:42:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:42:49 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:42:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:42:52 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:42:53 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:42:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:42:54 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:42:54 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:42:54 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:42:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:42:54 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:42:54 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:42:54 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lazy-loading 'info_cache' on Instance uuid 12a1a411-7fac-40bb-986c-9a8fab7d7cac {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:42:55 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Updating instance_info_cache with network_info: [{"id": "bde939d7-e915-4b75-a4d1-37646df5a309", "address": "fa:16:3e:e0:40:44", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde939d7-e9", "ovs_interfaceid": "bde939d7-e915-4b75-a4d1-37646df5a309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:42:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:42:55 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:42:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:42:56 user nova-compute[75083]: DEBUG nova.compute.manager [req-b0a91514-875b-4f8f-8965-5bd58c533914 req-c4da2d69-6105-4499-a56b-95813c8be4f8 service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Received event network-changed-bde939d7-e915-4b75-a4d1-37646df5a309 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:42:56 user nova-compute[75083]: DEBUG nova.compute.manager [req-b0a91514-875b-4f8f-8965-5bd58c533914 req-c4da2d69-6105-4499-a56b-95813c8be4f8 service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Refreshing instance network info cache due to event network-changed-bde939d7-e915-4b75-a4d1-37646df5a309. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:42:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b0a91514-875b-4f8f-8965-5bd58c533914 req-c4da2d69-6105-4499-a56b-95813c8be4f8 service nova] Acquiring lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:42:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b0a91514-875b-4f8f-8965-5bd58c533914 req-c4da2d69-6105-4499-a56b-95813c8be4f8 service nova] Acquired lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:42:56 user nova-compute[75083]: DEBUG nova.network.neutron [req-b0a91514-875b-4f8f-8965-5bd58c533914 req-c4da2d69-6105-4499-a56b-95813c8be4f8 service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Refreshing network info cache for port bde939d7-e915-4b75-a4d1-37646df5a309 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:42:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:42:57 user nova-compute[75083]: DEBUG nova.network.neutron [req-b0a91514-875b-4f8f-8965-5bd58c533914 req-c4da2d69-6105-4499-a56b-95813c8be4f8 service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Updated VIF entry in instance network info cache for port bde939d7-e915-4b75-a4d1-37646df5a309. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:42:57 user nova-compute[75083]: DEBUG nova.network.neutron [req-b0a91514-875b-4f8f-8965-5bd58c533914 req-c4da2d69-6105-4499-a56b-95813c8be4f8 service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Updating instance_info_cache with network_info: [{"id": "bde939d7-e915-4b75-a4d1-37646df5a309", "address": "fa:16:3e:e0:40:44", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde939d7-e9", "ovs_interfaceid": "bde939d7-e915-4b75-a4d1-37646df5a309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:42:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-b0a91514-875b-4f8f-8965-5bd58c533914 req-c4da2d69-6105-4499-a56b-95813c8be4f8 service nova] Releasing lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:42:59 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:43:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:43:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 06:43:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] There are 0 instances to clean {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 06:43:02 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:04 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:43:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:43:04 user nova-compute[75083]: DEBUG nova.compute.manager [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Starting instance... {{(pid=75083) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 06:43:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:43:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:43:04 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75083) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 06:43:04 user nova-compute[75083]: INFO nova.compute.claims [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Claim successful on node user
Nov 29 06:43:04 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Refreshing inventories for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 06:43:04 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Updating ProviderTree inventory for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 06:43:04 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Updating inventory in ProviderTree for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 06:43:04 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Refreshing aggregate associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, aggregates: None {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 06:43:04 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Refreshing trait associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, traits: HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 06:43:04 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:43:04 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:43:04 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:43:04 user nova-compute[75083]: DEBUG nova.compute.manager [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Start building networks asynchronously for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 06:43:04 user nova-compute[75083]: DEBUG nova.compute.manager [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Allocating IP information in the background. {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 06:43:04 user nova-compute[75083]: DEBUG nova.network.neutron [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] allocate_for_instance() {{(pid=75083) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 06:43:04 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 06:43:04 user nova-compute[75083]: DEBUG nova.compute.manager [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Start building block device mappings for instance. {{(pid=75083) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG nova.policy [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73fd740b5fe248edad95bcc269eee750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a61afbdd47455bbaa044282feb7c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75083) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 06:43:05 user nova-compute[75083]: INFO nova.virt.block_device [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Booting with volume 9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 at /dev/vda
Nov 29 06:43:05 user nova-compute[75083]: DEBUG os_brick.utils [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cd077d-7aeb-4791-af3b-30a824438913]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e9f10f08619\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d050b72f-3ff9-48d2-8907-60ed237852ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cecb96f-bb7a-4237-b6cf-85bd05cc2979]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec5fe72-6742-40bd-a353-4800e639f62b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Running cmd (subprocess): nvme version {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] 'nvme version' failed. Not Retrying. {{(pid=75083) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] nvme not present on system {{(pid=75083) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 06:43:05 user nova-compute[75083]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 06:43:05 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e25d8a-22fb-4863-ade6-38572b4d30ed]: (4, '') {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75083) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.lightos [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] LIGHTOS: no hostnqn found. {{(pid=75083) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG os_brick.utils [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e9f10f08619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG nova.virt.block_device [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Updating existing volume attachment record: 4bea0e51-0ce1-462a-883e-57adaf67ddc0 {{(pid=75083) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 06:43:05 user nova-compute[75083]: DEBUG nova.network.neutron [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Successfully created port: 78b34394-2c9c-4e5d-a7b3-31c543f452f1 {{(pid=75083) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 06:43:06 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:43:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:43:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:43:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:43:06 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:43:06 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:43:06 user nova-compute[75083]: DEBUG nova.network.neutron [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Successfully updated port: 78b34394-2c9c-4e5d-a7b3-31c543f452f1 {{(pid=75083) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 06:43:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-9eeca301-5d03-404b-a09f-245b51fa0776 req-938da318-1209-45a0-abf5-8c8ec3622931 service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Received event network-changed-78b34394-2c9c-4e5d-a7b3-31c543f452f1 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:43:06 user nova-compute[75083]: DEBUG nova.compute.manager [req-9eeca301-5d03-404b-a09f-245b51fa0776 req-938da318-1209-45a0-abf5-8c8ec3622931 service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Refreshing instance network info cache due to event network-changed-78b34394-2c9c-4e5d-a7b3-31c543f452f1. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:43:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9eeca301-5d03-404b-a09f-245b51fa0776 req-938da318-1209-45a0-abf5-8c8ec3622931 service nova] Acquiring lock "refresh_cache-d605bb8e-45e1-455e-bd96-a8b86b58eb05" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:43:06 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9eeca301-5d03-404b-a09f-245b51fa0776 req-938da318-1209-45a0-abf5-8c8ec3622931 service nova] Acquired lock "refresh_cache-d605bb8e-45e1-455e-bd96-a8b86b58eb05" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG nova.network.neutron [req-9eeca301-5d03-404b-a09f-245b51fa0776 req-938da318-1209-45a0-abf5-8c8ec3622931 service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Refreshing network info cache for port 78b34394-2c9c-4e5d-a7b3-31c543f452f1 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:43:07 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:43:07 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:43:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=9006MB free_disk=25.058792114257812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "refresh_cache-d605bb8e-45e1-455e-bd96-a8b86b58eb05" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG nova.network.neutron [req-9eeca301-5d03-404b-a09f-245b51fa0776 req-938da318-1209-45a0-abf5-8c8ec3622931 service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 12a1a411-7fac-40bb-986c-9a8fab7d7cac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance d605bb8e-45e1-455e-bd96-a8b86b58eb05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG nova.network.neutron [req-9eeca301-5d03-404b-a09f-245b51fa0776 req-938da318-1209-45a0-abf5-8c8ec3622931 service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9eeca301-5d03-404b-a09f-245b51fa0776 req-938da318-1209-45a0-abf5-8c8ec3622931 service nova] Releasing lock "refresh_cache-d605bb8e-45e1-455e-bd96-a8b86b58eb05" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquired lock "refresh_cache-d605bb8e-45e1-455e-bd96-a8b86b58eb05" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG nova.network.neutron [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Building network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75083) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG nova.network.neutron [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Instance cache missing network info. {{(pid=75083) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG nova.network.neutron [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Updating instance_info_cache with network_info: [{"id": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "address": "fa:16:3e:fb:54:79", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b34394-2c", "ovs_interfaceid": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Releasing lock "refresh_cache-d605bb8e-45e1-455e-bd96-a8b86b58eb05" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:43:07 user nova-compute[75083]: DEBUG nova.compute.manager [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Instance network_info: |[{"id": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "address": "fa:16:3e:fb:54:79", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b34394-2c", "ovs_interfaceid": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75083) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 06:43:09 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.compute.manager [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Start spawning the instance on the hypervisor. {{(pid=75083) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Creating instance directory {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 06:43:12 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Creating image(s)
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Did not create local disks {{(pid=75083) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Ensure instance console log exists: /opt/stack/data/nova/instances/d605bb8e-45e1-455e-bd96-a8b86b58eb05/console.log {{(pid=75083) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Start _get_guest_xml network_info=[{"id": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "address": "fa:16:3e:fb:54:79", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b34394-2c", "ovs_interfaceid": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '4bea0e51-0ce1-462a-883e-57adaf67ddc0', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLEwhkod', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd605bb8e-45e1-455e-bd96-a8b86b58eb05', 'attached_at': '', 'detached_at': '', 'volume_id': '9aa7fa18-45c5-4a25-a148-3e6cf7a230b0', 'serial': '9aa7fa18-45c5-4a25-a148-3e6cf7a230b0'}, 'volume_type': None} {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 06:43:12 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:43:12 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] CPU controller missing on host. {{(pid=75083) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.host [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] CPU controller found on host. {{(pid=75083) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75083) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T05:42:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Flavor limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Image limits 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Flavor pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Image pref 0:0:0 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Got 1 possible topologies {{(pid=75083) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.hardware [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75083) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Calling os-brick to attach iSCSI Volume {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLEwhkod', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:43:12 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:43:12 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:43:12 user nova-compute[75083]: INFO os_brick.initiator.connectors.iscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9286ea7c-da3a-4dc6-8ac1-4c85241cb3a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 06:43:12 user nova-compute[75083]:  {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[731d9d60-dff6-4cee-bec7-7e1af0e655e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0] added\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0] added
Nov 29 06:43:12 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5241918-27c0-4e10-b8e5-731f56c1f1d6]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[17adb3e7-daf0-4e0a-a7f6-bce7557c8b99]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CLEwhkod {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CLEwhkod" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f00fef-c4d1-45d6-bf15-584c4dd47f7e]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CLEwhkod'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[df819190-ec37-4dfc-b8b6-63e447bc3258]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a6944c-b7bd-4e96-a788-5ebf71685eaa]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)
Nov 29 06:43:12 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)
Nov 29 06:43:12 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 --login {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[10844b7d-080c-4417-af4a-2b9431323bf5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0, portal: 172.16.0.220,3260]
Nov 29 06:43:12 user nova-compute[75083]: Login to [iface: default, target: iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0, portal: 172.16.0.220,3260] successful.
Nov 29 06:43:12 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a8cc44-1640-4dcd-aa21-3141f6f42a2a]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1ddd06-27dd-47dd-abfc-2047e2b31b26]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)
Nov 29 06:43:12 user nova-compute[75083]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 (non-flash)
Nov 29 06:43:12 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)
Nov 29 06:43:12 user nova-compute[75083]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 (non-flash)
Nov 29 06:43:12 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Connected to 172.16.0.220:3260 {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=75083) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75083) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea2c19d-8b15-4c5c-a33b-50743bc1838c]: (4, ('- - 0', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75083) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 06:43:12 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLEwhkod', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75083) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23036323831396362', 'path': '/dev/sdc'} {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036323831396362', 'path': '/dev/sdc'} {{(pid=75083) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-171343672',display_name='tempest-TestVolumeBootPattern-server-171343672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-171343672',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhDUTFfwJIi9mzf/M769bKE2kGOxCbxL1Uu07fAF79Rkeuv2NHJDb1KJKxk7Lz+saRt3p1hMRIGehAQcPUJ3hP1O9CtPV0BLeDzCspiZHRus2Vh3hRVNFm6SpcHtcgejA==',key_name='tempest-TestVolumeBootPattern-951630595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21a61afbdd47455bbaa044282feb7c47',ramdisk_id='',reservation_id='r-4kpbhmgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-46466774',owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:43:05Z,user_data=None,user_id='73fd740b5fe248edad95bcc269eee750',uuid=d605bb8e-45e1-455e-bd96-a8b86b58eb05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "address": "fa:16:3e:fb:54:79", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b34394-2c", "ovs_interfaceid": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75083) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converting VIF {"id": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "address": "fa:16:3e:fb:54:79", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b34394-2c", "ovs_interfaceid": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:54:79,bridge_name='br-int',has_traffic_filtering=True,id=78b34394-2c9c-4e5d-a7b3-31c543f452f1,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b34394-2c') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG nova.objects.instance [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lazy-loading 'pci_devices' on Instance uuid d605bb8e-45e1-455e-bd96-a8b86b58eb05 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] End _get_guest_xml xml=<domain type="kvm">
Nov 29 06:43:13 user nova-compute[75083]:   <uuid>d605bb8e-45e1-455e-bd96-a8b86b58eb05</uuid>
Nov 29 06:43:13 user nova-compute[75083]:   <name>instance-00000034</name>
Nov 29 06:43:13 user nova-compute[75083]:   <memory>524288</memory>
Nov 29 06:43:13 user nova-compute[75083]:   <vcpu>1</vcpu>
Nov 29 06:43:13 user nova-compute[75083]:   <metadata>
Nov 29 06:43:13 user nova-compute[75083]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 06:43:13 user nova-compute[75083]:       <nova:package version="0.0.0"/>
Nov 29 06:43:13 user nova-compute[75083]:       <nova:name>tempest-TestVolumeBootPattern-server-171343672</nova:name>
Nov 29 06:43:13 user nova-compute[75083]:       <nova:creationTime>2023-11-29 06:43:12</nova:creationTime>
Nov 29 06:43:13 user nova-compute[75083]:       <nova:flavor name="m1.tiny">
Nov 29 06:43:13 user nova-compute[75083]:         <nova:memory>512</nova:memory>
Nov 29 06:43:13 user nova-compute[75083]:         <nova:disk>1</nova:disk>
Nov 29 06:43:13 user nova-compute[75083]:         <nova:swap>0</nova:swap>
Nov 29 06:43:13 user nova-compute[75083]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 06:43:13 user nova-compute[75083]:         <nova:vcpus>1</nova:vcpus>
Nov 29 06:43:13 user nova-compute[75083]:       </nova:flavor>
Nov 29 06:43:13 user nova-compute[75083]:       <nova:owner>
Nov 29 06:43:13 user nova-compute[75083]:         <nova:user uuid="73fd740b5fe248edad95bcc269eee750">tempest-TestVolumeBootPattern-46466774-project-member</nova:user>
Nov 29 06:43:13 user nova-compute[75083]:         <nova:project uuid="21a61afbdd47455bbaa044282feb7c47">tempest-TestVolumeBootPattern-46466774</nova:project>
Nov 29 06:43:13 user nova-compute[75083]:       </nova:owner>
Nov 29 06:43:13 user nova-compute[75083]:       <nova:ports>
Nov 29 06:43:13 user nova-compute[75083]:         <nova:port uuid="78b34394-2c9c-4e5d-a7b3-31c543f452f1">
Nov 29 06:43:13 user nova-compute[75083]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 06:43:13 user nova-compute[75083]:         </nova:port>
Nov 29 06:43:13 user nova-compute[75083]:       </nova:ports>
Nov 29 06:43:13 user nova-compute[75083]:     </nova:instance>
Nov 29 06:43:13 user nova-compute[75083]:   </metadata>
Nov 29 06:43:13 user nova-compute[75083]:   <sysinfo type="smbios">
Nov 29 06:43:13 user nova-compute[75083]:     <system>
Nov 29 06:43:13 user nova-compute[75083]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 06:43:13 user nova-compute[75083]:       <entry name="product">OpenStack Nova</entry>
Nov 29 06:43:13 user nova-compute[75083]:       <entry name="version">0.0.0</entry>
Nov 29 06:43:13 user nova-compute[75083]:       <entry name="serial">d605bb8e-45e1-455e-bd96-a8b86b58eb05</entry>
Nov 29 06:43:13 user nova-compute[75083]:       <entry name="uuid">d605bb8e-45e1-455e-bd96-a8b86b58eb05</entry>
Nov 29 06:43:13 user nova-compute[75083]:       <entry name="family">Virtual Machine</entry>
Nov 29 06:43:13 user nova-compute[75083]:     </system>
Nov 29 06:43:13 user nova-compute[75083]:   </sysinfo>
Nov 29 06:43:13 user nova-compute[75083]:   <os>
Nov 29 06:43:13 user nova-compute[75083]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 06:43:13 user nova-compute[75083]:     <boot dev="hd"/>
Nov 29 06:43:13 user nova-compute[75083]:     <smbios mode="sysinfo"/>
Nov 29 06:43:13 user nova-compute[75083]:   </os>
Nov 29 06:43:13 user nova-compute[75083]:   <features>
Nov 29 06:43:13 user nova-compute[75083]:     <acpi/>
Nov 29 06:43:13 user nova-compute[75083]:     <apic/>
Nov 29 06:43:13 user nova-compute[75083]:     <vmcoreinfo/>
Nov 29 06:43:13 user nova-compute[75083]:   </features>
Nov 29 06:43:13 user nova-compute[75083]:   <clock offset="utc">
Nov 29 06:43:13 user nova-compute[75083]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 06:43:13 user nova-compute[75083]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 06:43:13 user nova-compute[75083]:     <timer name="hpet" present="no"/>
Nov 29 06:43:13 user nova-compute[75083]:   </clock>
Nov 29 06:43:13 user nova-compute[75083]:   <cpu mode="custom" match="exact">
Nov 29 06:43:13 user nova-compute[75083]:     <model>Nehalem</model>
Nov 29 06:43:13 user nova-compute[75083]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 06:43:13 user nova-compute[75083]:   </cpu>
Nov 29 06:43:13 user nova-compute[75083]:   <devices>
Nov 29 06:43:13 user nova-compute[75083]:     <disk type="block" device="disk">
Nov 29 06:43:13 user nova-compute[75083]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 06:43:13 user nova-compute[75083]:       <source dev="/dev/sdc"/>
Nov 29 06:43:13 user nova-compute[75083]:       <target dev="vda" bus="virtio"/>
Nov 29 06:43:13 user nova-compute[75083]:       <serial>9aa7fa18-45c5-4a25-a148-3e6cf7a230b0</serial>
Nov 29 06:43:13 user nova-compute[75083]:     </disk>
Nov 29 06:43:13 user nova-compute[75083]:     <interface type="ethernet">
Nov 29 06:43:13 user nova-compute[75083]:       <mac address="fa:16:3e:fb:54:79"/>
Nov 29 06:43:13 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:43:13 user nova-compute[75083]:       <mtu size="1442"/>
Nov 29 06:43:13 user nova-compute[75083]:       <target dev="tap78b34394-2c"/>
Nov 29 06:43:13 user nova-compute[75083]:     </interface>
Nov 29 06:43:13 user nova-compute[75083]:     <serial type="pty">
Nov 29 06:43:13 user nova-compute[75083]:       <log file="/opt/stack/data/nova/instances/d605bb8e-45e1-455e-bd96-a8b86b58eb05/console.log" append="off"/>
Nov 29 06:43:13 user nova-compute[75083]:     </serial>
Nov 29 06:43:13 user nova-compute[75083]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 06:43:13 user nova-compute[75083]:     <video>
Nov 29 06:43:13 user nova-compute[75083]:       <model type="virtio"/>
Nov 29 06:43:13 user nova-compute[75083]:     </video>
Nov 29 06:43:13 user nova-compute[75083]:     <rng model="virtio">
Nov 29 06:43:13 user nova-compute[75083]:       <backend model="random">/dev/urandom</backend>
Nov 29 06:43:13 user nova-compute[75083]:     </rng>
Nov 29 06:43:13 user nova-compute[75083]:     <controller type="usb" index="0" model="none"/>
Nov 29 06:43:13 user nova-compute[75083]:     <memballoon model="virtio">
Nov 29 06:43:13 user nova-compute[75083]:       <stats period="10"/>
Nov 29 06:43:13 user nova-compute[75083]:     </memballoon>
Nov 29 06:43:13 user nova-compute[75083]:   </devices>
Nov 29 06:43:13 user nova-compute[75083]: </domain>
Nov 29 06:43:13 user nova-compute[75083]:  {{(pid=75083) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-171343672',display_name='tempest-TestVolumeBootPattern-server-171343672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-171343672',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhDUTFfwJIi9mzf/M769bKE2kGOxCbxL1Uu07fAF79Rkeuv2NHJDb1KJKxk7Lz+saRt3p1hMRIGehAQcPUJ3hP1O9CtPV0BLeDzCspiZHRus2Vh3hRVNFm6SpcHtcgejA==',key_name='tempest-TestVolumeBootPattern-951630595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21a61afbdd47455bbaa044282feb7c47',ramdisk_id='',reservation_id='r-4kpbhmgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-46466774',owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T06:43:05Z,user_data=None,user_id='73fd740b5fe248edad95bcc269eee750',uuid=d605bb8e-45e1-455e-bd96-a8b86b58eb05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "address": "fa:16:3e:fb:54:79", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b34394-2c", "ovs_interfaceid": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converting VIF {"id": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "address": "fa:16:3e:fb:54:79", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b34394-2c", "ovs_interfaceid": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:54:79,bridge_name='br-int',has_traffic_filtering=True,id=78b34394-2c9c-4e5d-a7b3-31c543f452f1,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b34394-2c') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG os_vif [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:54:79,bridge_name='br-int',has_traffic_filtering=True,id=78b34394-2c9c-4e5d-a7b3-31c543f452f1,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b34394-2c') {{(pid=75083) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '636b0276-066d-5d3b-9a8e-2cfabc465076', '_type': 'linux-noop'}}, row=False) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78b34394-2c, may_exist=True, interface_attrs={}) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78b34394-2c, col_values=(('qos', UUID('b2342628-e7a2-4f6b-95c0-b14a185c71b2')),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78b34394-2c, col_values=(('external_ids', {'iface-id': '78b34394-2c9c-4e5d-a7b3-31c543f452f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:54:79', 'vm-uuid': 'd605bb8e-45e1-455e-bd96-a8b86b58eb05'}),), if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:13 user nova-compute[75083]: INFO os_vif [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:54:79,bridge_name='br-int',has_traffic_filtering=True,id=78b34394-2c9c-4e5d-a7b3-31c543f452f1,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b34394-2c')
Nov 29 06:43:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] No BDM found with device name vda, not building metadata. {{(pid=75083) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 06:43:13 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] No VIF found with MAC fa:16:3e:fb:54:79, not building metadata {{(pid=75083) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 06:43:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:14 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:15 user nova-compute[75083]: DEBUG nova.compute.manager [req-49128b27-397b-4346-8c50-6cba0cd71beb req-3d8572dc-adae-4f45-a06a-0f8f38e105db service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Received event network-vif-plugged-78b34394-2c9c-4e5d-a7b3-31c543f452f1 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:43:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-49128b27-397b-4346-8c50-6cba0cd71beb req-3d8572dc-adae-4f45-a06a-0f8f38e105db service nova] Acquiring lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:43:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-49128b27-397b-4346-8c50-6cba0cd71beb req-3d8572dc-adae-4f45-a06a-0f8f38e105db service nova] Lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:43:15 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-49128b27-397b-4346-8c50-6cba0cd71beb req-3d8572dc-adae-4f45-a06a-0f8f38e105db service nova] Lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:43:15 user nova-compute[75083]: DEBUG nova.compute.manager [req-49128b27-397b-4346-8c50-6cba0cd71beb req-3d8572dc-adae-4f45-a06a-0f8f38e105db service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] No waiting events found dispatching network-vif-plugged-78b34394-2c9c-4e5d-a7b3-31c543f452f1 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:43:15 user nova-compute[75083]: WARNING nova.compute.manager [req-49128b27-397b-4346-8c50-6cba0cd71beb req-3d8572dc-adae-4f45-a06a-0f8f38e105db service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Received unexpected event network-vif-plugged-78b34394-2c9c-4e5d-a7b3-31c543f452f1 for instance with vm_state building and task_state spawning.
Nov 29 06:43:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:16 user nova-compute[75083]: DEBUG nova.compute.manager [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Instance event wait completed in 0 seconds for  {{(pid=75083) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 06:43:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Guest created on hypervisor {{(pid=75083) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 06:43:16 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Instance spawned successfully.
Nov 29 06:43:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 06:43:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Found default for hw_cdrom_bus of ide {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:43:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Found default for hw_disk_bus of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:43:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Found default for hw_input_bus of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:43:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Found default for hw_pointer_model of None {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:43:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Found default for hw_video_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:43:16 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Found default for hw_vif_model of virtio {{(pid=75083) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 06:43:17 user nova-compute[75083]: INFO nova.compute.manager [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Took 4.89 seconds to spawn the instance on the hypervisor.
Nov 29 06:43:17 user nova-compute[75083]: DEBUG nova.compute.manager [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Checking state {{(pid=75083) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 06:43:17 user nova-compute[75083]: DEBUG nova.compute.manager [req-eff210a0-ee87-4ff0-af49-ce7bebeb4261 req-4b21d1c2-d0de-490a-a998-88e7c82992dc service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Received event network-vif-plugged-78b34394-2c9c-4e5d-a7b3-31c543f452f1 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:43:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-eff210a0-ee87-4ff0-af49-ce7bebeb4261 req-4b21d1c2-d0de-490a-a998-88e7c82992dc service nova] Acquiring lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:43:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-eff210a0-ee87-4ff0-af49-ce7bebeb4261 req-4b21d1c2-d0de-490a-a998-88e7c82992dc service nova] Lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:43:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-eff210a0-ee87-4ff0-af49-ce7bebeb4261 req-4b21d1c2-d0de-490a-a998-88e7c82992dc service nova] Lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:43:17 user nova-compute[75083]: DEBUG nova.compute.manager [req-eff210a0-ee87-4ff0-af49-ce7bebeb4261 req-4b21d1c2-d0de-490a-a998-88e7c82992dc service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] No waiting events found dispatching network-vif-plugged-78b34394-2c9c-4e5d-a7b3-31c543f452f1 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:43:17 user nova-compute[75083]: WARNING nova.compute.manager [req-eff210a0-ee87-4ff0-af49-ce7bebeb4261 req-4b21d1c2-d0de-490a-a998-88e7c82992dc service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Received unexpected event network-vif-plugged-78b34394-2c9c-4e5d-a7b3-31c543f452f1 for instance with vm_state building and task_state spawning.
Nov 29 06:43:17 user nova-compute[75083]: INFO nova.compute.manager [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Took 12.64 seconds to build instance.
Nov 29 06:43:17 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:17 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-6a93f8f2-1b60-432a-9efc-55df90c14b97 tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.792s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:43:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:28 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:43:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:43:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:43:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:43:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:43:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:32 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:34 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:43:37 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:38 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:43:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid 12a1a411-7fac-40bb-986c-9a8fab7d7cac {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:43:38 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Triggering sync for uuid d605bb8e-45e1-455e-bd96-a8b86b58eb05 {{(pid=75083) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 06:43:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:43:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:43:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:43:38 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:43:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:43:39 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:43:41 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:43:42 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:47 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:47 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:43:47 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:43:47 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:43:47 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:43:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:43:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:54 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:43:55 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:43:55 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:43:55 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:43:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:43:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquired lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:43:55 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Forcefully refreshing network info cache for instance {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 06:43:55 user nova-compute[75083]: DEBUG nova.objects.instance [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lazy-loading 'info_cache' on Instance uuid 12a1a411-7fac-40bb-986c-9a8fab7d7cac {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:43:56 user nova-compute[75083]: DEBUG nova.network.neutron [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Updating instance_info_cache with network_info: [{"id": "bde939d7-e915-4b75-a4d1-37646df5a309", "address": "fa:16:3e:e0:40:44", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde939d7-e9", "ovs_interfaceid": "bde939d7-e915-4b75-a4d1-37646df5a309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:43:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Releasing lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:43:56 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Updated the network info_cache for instance {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 06:43:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:43:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:43:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75083) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 06:43:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:43:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75083) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 06:43:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:44:01 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:44:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:44:07 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:44:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:44:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:44:07 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:44:07 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:44:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:44:07 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:44:08 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:44:08 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:44:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8896MB free_disk=25.05736541748047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:44:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:44:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:44:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 12a1a411-7fac-40bb-986c-9a8fab7d7cac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:44:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance d605bb8e-45e1-455e-bd96-a8b86b58eb05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:44:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:44:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:44:08 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:44:08 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:44:08 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:44:08 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:44:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:44:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:44:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:44:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:44:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:44:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:44:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:44:42 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:44:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:44:47 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:44:48 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:44:48 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:44:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:44:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:44:51 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:44:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:44:54 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:44:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:44:55 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:44:56 user nova-compute[75083]: DEBUG nova.compute.manager [req-9df552a6-b486-4e20-89f1-951ae0740584 req-00d808ad-8e3f-46a8-abac-026f842d73e2 service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Received event network-changed-78b34394-2c9c-4e5d-a7b3-31c543f452f1 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:44:56 user nova-compute[75083]: DEBUG nova.compute.manager [req-9df552a6-b486-4e20-89f1-951ae0740584 req-00d808ad-8e3f-46a8-abac-026f842d73e2 service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Refreshing instance network info cache due to event network-changed-78b34394-2c9c-4e5d-a7b3-31c543f452f1. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:44:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9df552a6-b486-4e20-89f1-951ae0740584 req-00d808ad-8e3f-46a8-abac-026f842d73e2 service nova] Acquiring lock "refresh_cache-d605bb8e-45e1-455e-bd96-a8b86b58eb05" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:44:56 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9df552a6-b486-4e20-89f1-951ae0740584 req-00d808ad-8e3f-46a8-abac-026f842d73e2 service nova] Acquired lock "refresh_cache-d605bb8e-45e1-455e-bd96-a8b86b58eb05" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:44:56 user nova-compute[75083]: DEBUG nova.network.neutron [req-9df552a6-b486-4e20-89f1-951ae0740584 req-00d808ad-8e3f-46a8-abac-026f842d73e2 service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Refreshing network info cache for port 78b34394-2c9c-4e5d-a7b3-31c543f452f1 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG nova.network.neutron [req-9df552a6-b486-4e20-89f1-951ae0740584 req-00d808ad-8e3f-46a8-abac-026f842d73e2 service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Updated VIF entry in instance network info cache for port 78b34394-2c9c-4e5d-a7b3-31c543f452f1. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG nova.network.neutron [req-9df552a6-b486-4e20-89f1-951ae0740584 req-00d808ad-8e3f-46a8-abac-026f842d73e2 service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Updating instance_info_cache with network_info: [{"id": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "address": "fa:16:3e:fb:54:79", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b34394-2c", "ovs_interfaceid": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-9df552a6-b486-4e20-89f1-951ae0740584 req-00d808ad-8e3f-46a8-abac-026f842d73e2 service nova] Releasing lock "refresh_cache-d605bb8e-45e1-455e-bd96-a8b86b58eb05" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-117d36f8-6c01-4e49-8e11-3345a19e3952 req-410b1f72-9a6e-4c81-9a09-d4e05e41ba84 service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Received event network-changed-78b34394-2c9c-4e5d-a7b3-31c543f452f1 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-117d36f8-6c01-4e49-8e11-3345a19e3952 req-410b1f72-9a6e-4c81-9a09-d4e05e41ba84 service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Refreshing instance network info cache due to event network-changed-78b34394-2c9c-4e5d-a7b3-31c543f452f1. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-117d36f8-6c01-4e49-8e11-3345a19e3952 req-410b1f72-9a6e-4c81-9a09-d4e05e41ba84 service nova] Acquiring lock "refresh_cache-d605bb8e-45e1-455e-bd96-a8b86b58eb05" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-117d36f8-6c01-4e49-8e11-3345a19e3952 req-410b1f72-9a6e-4c81-9a09-d4e05e41ba84 service nova] Acquired lock "refresh_cache-d605bb8e-45e1-455e-bd96-a8b86b58eb05" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG nova.network.neutron [req-117d36f8-6c01-4e49-8e11-3345a19e3952 req-410b1f72-9a6e-4c81-9a09-d4e05e41ba84 service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Refreshing network info cache for port 78b34394-2c9c-4e5d-a7b3-31c543f452f1 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:44:57 user nova-compute[75083]: INFO nova.compute.manager [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Terminating instance
Nov 29 06:44:57 user nova-compute[75083]: DEBUG nova.compute.manager [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Skipping network cache update for instance because it is being deleted. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG nova.network.neutron [req-117d36f8-6c01-4e49-8e11-3345a19e3952 req-410b1f72-9a6e-4c81-9a09-d4e05e41ba84 service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Updated VIF entry in instance network info cache for port 78b34394-2c9c-4e5d-a7b3-31c543f452f1. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:44:57 user nova-compute[75083]: DEBUG nova.network.neutron [req-117d36f8-6c01-4e49-8e11-3345a19e3952 req-410b1f72-9a6e-4c81-9a09-d4e05e41ba84 service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Updating instance_info_cache with network_info: [{"id": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "address": "fa:16:3e:fb:54:79", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b34394-2c", "ovs_interfaceid": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-117d36f8-6c01-4e49-8e11-3345a19e3952 req-410b1f72-9a6e-4c81-9a09-d4e05e41ba84 service nova] Releasing lock "refresh_cache-d605bb8e-45e1-455e-bd96-a8b86b58eb05" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:44:58 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Instance destroyed successfully.
Nov 29 06:44:58 user nova-compute[75083]: DEBUG nova.objects.instance [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lazy-loading 'resources' on Instance uuid d605bb8e-45e1-455e-bd96-a8b86b58eb05 {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-171343672',display_name='tempest-TestVolumeBootPattern-server-171343672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-171343672',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhDUTFfwJIi9mzf/M769bKE2kGOxCbxL1Uu07fAF79Rkeuv2NHJDb1KJKxk7Lz+saRt3p1hMRIGehAQcPUJ3hP1O9CtPV0BLeDzCspiZHRus2Vh3hRVNFm6SpcHtcgejA==',key_name='tempest-TestVolumeBootPattern-951630595',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:43:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21a61afbdd47455bbaa044282feb7c47',ramdisk_id='',reservation_id='r-4kpbhmgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-46466774',owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:43:17Z,user_data=None,user_id='73fd740b5fe248edad95bcc269eee750',uuid=d605bb8e-45e1-455e-bd96-a8b86b58eb05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "address": "fa:16:3e:fb:54:79", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b34394-2c", "ovs_interfaceid": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converting VIF {"id": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "address": "fa:16:3e:fb:54:79", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b34394-2c", "ovs_interfaceid": "78b34394-2c9c-4e5d-a7b3-31c543f452f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:54:79,bridge_name='br-int',has_traffic_filtering=True,id=78b34394-2c9c-4e5d-a7b3-31c543f452f1,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b34394-2c') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_vif [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:54:79,bridge_name='br-int',has_traffic_filtering=True,id=78b34394-2c9c-4e5d-a7b3-31c543f452f1,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b34394-2c') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78b34394-2c, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2342628-e7a2-4f6b-95c0-b14a185c71b2) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:44:58 user nova-compute[75083]: INFO os_vif [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:54:79,bridge_name='br-int',has_traffic_filtering=True,id=78b34394-2c9c-4e5d-a7b3-31c543f452f1,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b34394-2c')
Nov 29 06:44:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLEwhkod', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:44:58 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f5f0c8-cd22-4bc0-8ca1-baf379c6e551]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:44:58 user nova-compute[75083]: No targets found.
Nov 29 06:44:58 user nova-compute[75083]: iSNS:
Nov 29 06:44:58 user nova-compute[75083]: No targets found.
Nov 29 06:44:58 user nova-compute[75083]: STATIC:
Nov 29 06:44:58 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0
Nov 29 06:44:58 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:44:58 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:44:58 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c
Nov 29 06:44:58 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:44:58 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:44:58 user nova-compute[75083]: FIRMWARE:
Nov 29 06:44:58 user nova-compute[75083]: No targets found.
Nov 29 06:44:58 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:44:58 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:44:58 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[306fe7cc-9e5c-4d62-acc9-b95300db0566]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[92132bf8-f7c9-43bd-b9ed-d0f071c60730]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)
Nov 29 06:44:58 user nova-compute[75083]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 (non-flash)
Nov 29 06:44:58 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)
Nov 29 06:44:58 user nova-compute[75083]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 (non-flash)
Nov 29 06:44:58 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b8173be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0'): ({'sdc'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Removing single pathed devices sdc {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[272ff357-1e53-4356-8aca-8c145941b475]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd30e9d2-fd91-4b5d-b3c5-c050fc1e2776]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Flushing IO for device /dev/sdc {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a629f878-ebe3-4554-a140-3c9365b627bf]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5428f3f-12b5-438a-a6de-38650078272a]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] SCSI volumes sdc have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_756ab1d7', '/dev/disk/by-id/scsi-1SCST_BIO756ab1d7-062819cb63ca5b80', '/dev/disk/by-id/scsi-23036323831396362') {{(pid=86165) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb1afb3-3858-43ff-b03c-eff4d2036699]: (4, None) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[966fbaaf-39ad-448a-a40e-6728c844d705]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63cc246-af5b-4d24-b26c-fb4aa203f49c]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0, portal: 172.16.0.220,3260]
Nov 29 06:44:58 user nova-compute[75083]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0, portal: 172.16.0.220,3260] successful.
Nov 29 06:44:58 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa7fa18-45c5-4a25-a148-3e6cf7a230b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed262f8-bb9c-43e8-b5f2-966d25af42a9]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] <== disconnect_volume: return (277ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:44:58 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Deleting instance files /opt/stack/data/nova/instances/d605bb8e-45e1-455e-bd96-a8b86b58eb05_del
Nov 29 06:44:58 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Deletion of /opt/stack/data/nova/instances/d605bb8e-45e1-455e-bd96-a8b86b58eb05_del complete
Nov 29 06:44:58 user nova-compute[75083]: INFO nova.compute.manager [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 29 06:44:58 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:44:58 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:44:58 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Took 0.42 seconds to deallocate network for instance.
Nov 29 06:44:59 user nova-compute[75083]: DEBUG nova.compute.manager [req-3ff2b839-ee8c-441f-9296-a7ee6db68a15 req-bb2eae46-517a-46c2-a21e-21d14bbaa60e service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Received event network-vif-unplugged-78b34394-2c9c-4e5d-a7b3-31c543f452f1 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:44:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3ff2b839-ee8c-441f-9296-a7ee6db68a15 req-bb2eae46-517a-46c2-a21e-21d14bbaa60e service nova] Acquiring lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:44:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3ff2b839-ee8c-441f-9296-a7ee6db68a15 req-bb2eae46-517a-46c2-a21e-21d14bbaa60e service nova] Lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:44:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3ff2b839-ee8c-441f-9296-a7ee6db68a15 req-bb2eae46-517a-46c2-a21e-21d14bbaa60e service nova] Lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:44:59 user nova-compute[75083]: DEBUG nova.compute.manager [req-3ff2b839-ee8c-441f-9296-a7ee6db68a15 req-bb2eae46-517a-46c2-a21e-21d14bbaa60e service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] No waiting events found dispatching network-vif-unplugged-78b34394-2c9c-4e5d-a7b3-31c543f452f1 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:44:59 user nova-compute[75083]: DEBUG nova.compute.manager [req-3ff2b839-ee8c-441f-9296-a7ee6db68a15 req-bb2eae46-517a-46c2-a21e-21d14bbaa60e service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Received event network-vif-unplugged-78b34394-2c9c-4e5d-a7b3-31c543f452f1 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:44:59 user nova-compute[75083]: DEBUG nova.compute.manager [req-3ff2b839-ee8c-441f-9296-a7ee6db68a15 req-bb2eae46-517a-46c2-a21e-21d14bbaa60e service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Received event network-vif-plugged-78b34394-2c9c-4e5d-a7b3-31c543f452f1 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:44:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3ff2b839-ee8c-441f-9296-a7ee6db68a15 req-bb2eae46-517a-46c2-a21e-21d14bbaa60e service nova] Acquiring lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:44:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3ff2b839-ee8c-441f-9296-a7ee6db68a15 req-bb2eae46-517a-46c2-a21e-21d14bbaa60e service nova] Lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:44:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-3ff2b839-ee8c-441f-9296-a7ee6db68a15 req-bb2eae46-517a-46c2-a21e-21d14bbaa60e service nova] Lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:44:59 user nova-compute[75083]: DEBUG nova.compute.manager [req-3ff2b839-ee8c-441f-9296-a7ee6db68a15 req-bb2eae46-517a-46c2-a21e-21d14bbaa60e service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] No waiting events found dispatching network-vif-plugged-78b34394-2c9c-4e5d-a7b3-31c543f452f1 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:44:59 user nova-compute[75083]: WARNING nova.compute.manager [req-3ff2b839-ee8c-441f-9296-a7ee6db68a15 req-bb2eae46-517a-46c2-a21e-21d14bbaa60e service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Received unexpected event network-vif-plugged-78b34394-2c9c-4e5d-a7b3-31c543f452f1 for instance with vm_state active and task_state deleting.
Nov 29 06:44:59 user nova-compute[75083]: DEBUG nova.compute.manager [req-3ff2b839-ee8c-441f-9296-a7ee6db68a15 req-bb2eae46-517a-46c2-a21e-21d14bbaa60e service nova] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Received event network-vif-deleted-78b34394-2c9c-4e5d-a7b3-31c543f452f1 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:44:59 user nova-compute[75083]: INFO nova.compute.manager [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: d605bb8e-45e1-455e-bd96-a8b86b58eb05] Took 0.78 seconds to detach 1 volumes for instance.
Nov 29 06:44:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:44:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:44:59 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:44:59 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:44:59 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:45:00 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Deleted allocations for instance d605bb8e-45e1-455e-bd96-a8b86b58eb05
Nov 29 06:45:00 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-ecd779f0-e410-46cf-8f00-01db1748036a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "d605bb8e-45e1-455e-bd96-a8b86b58eb05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.683s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:45:01 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:45:03 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:45:08 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:45:09 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:45:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:45:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:45:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:45:09 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:45:09 user nova-compute[75083]: DEBUG nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75083) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 06:45:10 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:45:10 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:45:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=8988MB free_disk=25.05648422241211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:45:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:45:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:45:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Instance 12a1a411-7fac-40bb-986c-9a8fab7d7cac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75083) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 06:45:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:45:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:45:10 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:45:10 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:45:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:45:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:45:13 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:45:18 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:45:23 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:45:28 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:45:33 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:45:38 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:45:42 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:45:43 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:45:47 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:45:48 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:45:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:45:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:45:50 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:45:53 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:45:53 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:45:54 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-ffbfbf65-e143-4529-8c8e-35837e43d72a req-4b4bd8c0-a59d-427f-9f4c-33a935b4d02c service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Received event network-changed-bde939d7-e915-4b75-a4d1-37646df5a309 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-ffbfbf65-e143-4529-8c8e-35837e43d72a req-4b4bd8c0-a59d-427f-9f4c-33a935b4d02c service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Refreshing instance network info cache due to event network-changed-bde939d7-e915-4b75-a4d1-37646df5a309. {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ffbfbf65-e143-4529-8c8e-35837e43d72a req-4b4bd8c0-a59d-427f-9f4c-33a935b4d02c service nova] Acquiring lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ffbfbf65-e143-4529-8c8e-35837e43d72a req-4b4bd8c0-a59d-427f-9f4c-33a935b4d02c service nova] Acquired lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG nova.network.neutron [req-ffbfbf65-e143-4529-8c8e-35837e43d72a req-4b4bd8c0-a59d-427f-9f4c-33a935b4d02c service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Refreshing network info cache for port bde939d7-e915-4b75-a4d1-37646df5a309 {{(pid=75083) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:45:55 user nova-compute[75083]: INFO nova.compute.manager [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Terminating instance
Nov 29 06:45:55 user nova-compute[75083]: DEBUG nova.compute.manager [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Start destroying the instance on the hypervisor. {{(pid=75083) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG nova.network.neutron [req-ffbfbf65-e143-4529-8c8e-35837e43d72a req-4b4bd8c0-a59d-427f-9f4c-33a935b4d02c service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Updated VIF entry in instance network info cache for port bde939d7-e915-4b75-a4d1-37646df5a309. {{(pid=75083) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG nova.network.neutron [req-ffbfbf65-e143-4529-8c8e-35837e43d72a req-4b4bd8c0-a59d-427f-9f4c-33a935b4d02c service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Updating instance_info_cache with network_info: [{"id": "bde939d7-e915-4b75-a4d1-37646df5a309", "address": "fa:16:3e:e0:40:44", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde939d7-e9", "ovs_interfaceid": "bde939d7-e915-4b75-a4d1-37646df5a309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-ffbfbf65-e143-4529-8c8e-35837e43d72a req-4b4bd8c0-a59d-427f-9f4c-33a935b4d02c service nova] Releasing lock "refresh_cache-12a1a411-7fac-40bb-986c-9a8fab7d7cac" {{(pid=75083) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 06:45:55 user nova-compute[75083]: INFO nova.virt.libvirt.driver [-] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Instance destroyed successfully.
Nov 29 06:45:55 user nova-compute[75083]: DEBUG nova.objects.instance [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lazy-loading 'resources' on Instance uuid 12a1a411-7fac-40bb-986c-9a8fab7d7cac {{(pid=75083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.vif [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T06:41:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1010045530',display_name='tempest-TestVolumeBootPattern-server-1010045530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1010045530',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhDUTFfwJIi9mzf/M769bKE2kGOxCbxL1Uu07fAF79Rkeuv2NHJDb1KJKxk7Lz+saRt3p1hMRIGehAQcPUJ3hP1O9CtPV0BLeDzCspiZHRus2Vh3hRVNFm6SpcHtcgejA==',key_name='tempest-TestVolumeBootPattern-951630595',keypairs=<?>,launch_index=0,launched_at=2023-11-29T06:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21a61afbdd47455bbaa044282feb7c47',ramdisk_id='',reservation_id='r-lk5akce7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-46466774',owner_user_name='tempest-TestVolumeBootPattern-46466774-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T06:41:18Z,user_data=None,user_id='73fd740b5fe248edad95bcc269eee750',uuid=12a1a411-7fac-40bb-986c-9a8fab7d7cac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bde939d7-e915-4b75-a4d1-37646df5a309", "address": "fa:16:3e:e0:40:44", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde939d7-e9", "ovs_interfaceid": "bde939d7-e915-4b75-a4d1-37646df5a309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converting VIF {"id": "bde939d7-e915-4b75-a4d1-37646df5a309", "address": "fa:16:3e:e0:40:44", "network": {"id": "6ba16ec3-31b4-4a55-96f7-d9e66ccd426b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1072036458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21a61afbdd47455bbaa044282feb7c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde939d7-e9", "ovs_interfaceid": "bde939d7-e915-4b75-a4d1-37646df5a309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG nova.network.os_vif_util [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:40:44,bridge_name='br-int',has_traffic_filtering=True,id=bde939d7-e915-4b75-a4d1-37646df5a309,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde939d7-e9') {{(pid=75083) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG os_vif [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:40:44,bridge_name='br-int',has_traffic_filtering=True,id=bde939d7-e915-4b75-a4d1-37646df5a309,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde939d7-e9') {{(pid=75083) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbde939d7-e9, bridge=br-int, if_exists=True) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76d45aaa-c228-4c67-9058-fa10faa05ea4) {{(pid=75083) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:45:55 user nova-compute[75083]: INFO os_vif [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:40:44,bridge_name='br-int',has_traffic_filtering=True,id=bde939d7-e915-4b75-a4d1-37646df5a309,network=Network(6ba16ec3-31b4-4a55-96f7-d9e66ccd426b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde939d7-e9')
Nov 29 06:45:55 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] calling os-brick to detach iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0d83b89d0>, {'target_iqn': 'iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrLobdpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 06:45:55 user nova-compute[75083]: WARNING os_brick.initiator.connectors.base [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 06:45:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-6428ba11-c84a-4e0f-b77a-86c7b086becc req-ddb53c9e-5b6e-4888-8658-f2a777473948 service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Received event network-vif-unplugged-bde939d7-e915-4b75-a4d1-37646df5a309 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6428ba11-c84a-4e0f-b77a-86c7b086becc req-ddb53c9e-5b6e-4888-8658-f2a777473948 service nova] Acquiring lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6428ba11-c84a-4e0f-b77a-86c7b086becc req-ddb53c9e-5b6e-4888-8658-f2a777473948 service nova] Lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-6428ba11-c84a-4e0f-b77a-86c7b086becc req-ddb53c9e-5b6e-4888-8658-f2a777473948 service nova] Lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-6428ba11-c84a-4e0f-b77a-86c7b086becc req-ddb53c9e-5b6e-4888-8658-f2a777473948 service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] No waiting events found dispatching network-vif-unplugged-bde939d7-e915-4b75-a4d1-37646df5a309 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG nova.compute.manager [req-6428ba11-c84a-4e0f-b77a-86c7b086becc req-ddb53c9e-5b6e-4888-8658-f2a777473948 service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Received event network-vif-unplugged-bde939d7-e915-4b75-a4d1-37646df5a309 for instance with task_state deleting. {{(pid=75083) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d2d5b2-2c6d-48b3-8d6d-37d848a7c012]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 06:45:55 user nova-compute[75083]: No targets found.
Nov 29 06:45:55 user nova-compute[75083]: iSNS:
Nov 29 06:45:55 user nova-compute[75083]: No targets found.
Nov 29 06:45:55 user nova-compute[75083]: STATIC:
Nov 29 06:45:55 user nova-compute[75083]: Target: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c
Nov 29 06:45:55 user nova-compute[75083]:         Portal: 172.16.0.220:3260,-1
Nov 29 06:45:55 user nova-compute[75083]:                 Iface Name: default
Nov 29 06:45:55 user nova-compute[75083]: FIRMWARE:
Nov 29 06:45:55 user nova-compute[75083]: No targets found.
Nov 29 06:45:55 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 06:45:55 user nova-compute[75083]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 06:45:55 user nova-compute[75083]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75083) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c', 0)] {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6903c90c-e979-41da-96d2-d53861ddb708]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6bcdd4-e333-40f9-9749-22fefb4d8b95]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)
Nov 29 06:45:55 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 06:45:55 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c (non-flash)
Nov 29 06:45:55 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b84b01f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c'): ({'sdb'}, set())}) {{(pid=75083) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Removing single pathed devices sdb {{(pid=75083) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[918ce741-9102-40ab-9b08-41965b806eef]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7860ef63-2e14-4af5-9158-dc42c004ac05]: (4, ('ok\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Flushing IO for device /dev/sdb {{(pid=75083) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a875d045-2907-4bc7-8273-6e8f32e37e65]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75083) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[229e82f1-135d-4230-8780-887bd2106d76]: (4, ('1', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG os_brick.initiator.linuxscsi [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] SCSI volumes sdb have been removed. {{(pid=75083) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c')] {{(pid=75083) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7381771-6d4b-44e5-9a5a-8325069674fb]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --logout {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea90223e-7751-4df0-b983-1b1a591126b2]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c, portal: 172.16.0.220,3260]
Nov 29 06:45:56 user nova-compute[75083]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c, portal: 172.16.0.220,3260] successful.
Nov 29 06:45:56 user nova-compute[75083]:  stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op delete {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f13b2e52-83cf-4a5f-86f3-9a54be08c50c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e483f7-20a6-4de6-9ce7-0c92c9703ac0]: (4, ('', '')) {{(pid=86165) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75083) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.base [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG os_brick.initiator.connectors.iscsi [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] <== disconnect_volume: return (311ms) None {{(pid=75083) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG nova.virt.libvirt.volume.iscsi [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Disconnected iSCSI Volume {{(pid=75083) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 06:45:56 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Deleting instance files /opt/stack/data/nova/instances/12a1a411-7fac-40bb-986c-9a8fab7d7cac_del
Nov 29 06:45:56 user nova-compute[75083]: INFO nova.virt.libvirt.driver [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Deletion of /opt/stack/data/nova/instances/12a1a411-7fac-40bb-986c-9a8fab7d7cac_del complete
Nov 29 06:45:56 user nova-compute[75083]: INFO nova.compute.manager [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 29 06:45:56 user nova-compute[75083]: DEBUG oslo.service.loopingcall [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75083) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG nova.compute.manager [-] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Deallocating network for instance {{(pid=75083) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] deallocate_for_instance() {{(pid=75083) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 06:45:56 user nova-compute[75083]: DEBUG nova.network.neutron [-] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Updating instance_info_cache with network_info: [] {{(pid=75083) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 06:45:56 user nova-compute[75083]: INFO nova.compute.manager [-] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Took 0.44 seconds to deallocate network for instance.
Nov 29 06:45:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-6a9d687f-462f-4612-9d84-7fab70c490e1 req-bcde5945-976a-4405-bfeb-ab96a47be67f service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Received event network-vif-deleted-bde939d7-e915-4b75-a4d1-37646df5a309 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:45:57 user nova-compute[75083]: INFO nova.compute.manager [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Took 0.74 seconds to detach 1 volumes for instance.
Nov 29 06:45:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:45:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:45:57 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:45:57 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:45:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:45:57 user nova-compute[75083]: INFO nova.scheduler.client.report [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Deleted allocations for instance 12a1a411-7fac-40bb-986c-9a8fab7d7cac
Nov 29 06:45:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-865944e0-ee5f-4d49-bfcc-c37c37e7b75a tempest-TestVolumeBootPattern-46466774 tempest-TestVolumeBootPattern-46466774-project-member] Lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.640s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:45:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-f55dd752-5b38-46a8-9e73-0fc9c996904f req-63cac6a3-8d7e-4b6f-a79d-1a55ddf026f5 service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Received event network-vif-plugged-bde939d7-e915-4b75-a4d1-37646df5a309 {{(pid=75083) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 06:45:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f55dd752-5b38-46a8-9e73-0fc9c996904f req-63cac6a3-8d7e-4b6f-a79d-1a55ddf026f5 service nova] Acquiring lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:45:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f55dd752-5b38-46a8-9e73-0fc9c996904f req-63cac6a3-8d7e-4b6f-a79d-1a55ddf026f5 service nova] Lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:45:57 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [req-f55dd752-5b38-46a8-9e73-0fc9c996904f req-63cac6a3-8d7e-4b6f-a79d-1a55ddf026f5 service nova] Lock "12a1a411-7fac-40bb-986c-9a8fab7d7cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:45:57 user nova-compute[75083]: DEBUG nova.compute.manager [req-f55dd752-5b38-46a8-9e73-0fc9c996904f req-63cac6a3-8d7e-4b6f-a79d-1a55ddf026f5 service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] No waiting events found dispatching network-vif-plugged-bde939d7-e915-4b75-a4d1-37646df5a309 {{(pid=75083) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 06:45:57 user nova-compute[75083]: WARNING nova.compute.manager [req-f55dd752-5b38-46a8-9e73-0fc9c996904f req-63cac6a3-8d7e-4b6f-a79d-1a55ddf026f5 service nova] [instance: 12a1a411-7fac-40bb-986c-9a8fab7d7cac] Received unexpected event network-vif-plugged-bde939d7-e915-4b75-a4d1-37646df5a309 for instance with vm_state deleted and task_state None.
Nov 29 06:45:59 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:45:59 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:45:59 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:45:59 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 06:46:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:46:02 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:46:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:46:09 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:46:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:46:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:46:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:46:09 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:46:09 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:46:09 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:46:09 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=9122MB free_disk=25.055606842041016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:46:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:46:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:46:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:46:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:46:10 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:46:10 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:46:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:46:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:46:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:46:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:46:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:46:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:46:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:46:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:46:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:46:44 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:46:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:46:46 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:46:47 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:46:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:46:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:46:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:46:51 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:46:52 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:46:54 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:46:55 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:46:55 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:46:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:46:59 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:47:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:47:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:47:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:47:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 06:47:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:47:02 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:47:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:47:09 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:47:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:47:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:47:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:47:09 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:47:09 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:47:09 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:47:09 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=9282MB free_disk=25.053264617919922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:47:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:47:09 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:47:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:47:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:47:10 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:47:10 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:47:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:47:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:47:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:47:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:47:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:47:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:47:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:47:35 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:47:40 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:47:45 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:47:46 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:47:48 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:47:49 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:47:49 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75083) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 06:47:50 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:47:51 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:47:55 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:47:55 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:47:57 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:48:00 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:48:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Starting heal instance info cache {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 06:48:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Rebuilding the list of instances to heal {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 06:48:00 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Didn't find any instances for network info cache update. {{(pid=75083) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 06:48:00 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 06:48:02 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:48:05 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:48:06 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:48:06 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 06:48:06 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] There are 0 instances to clean {{(pid=75083) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 06:48:10 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:48:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:48:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:48:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:48:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Auditing locally available compute resources for user (node: user) {{(pid=75083) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 06:48:10 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:48:10 user nova-compute[75083]: WARNING nova.virt.libvirt.driver [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 06:48:10 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Hypervisor/Node resource view: name=user free_ram=9287MB free_disk=25.046878814697266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75083) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 06:48:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 06:48:10 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 06:48:10 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:48:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 06:48:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75083) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 06:48:11 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing inventories for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 06:48:11 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Updating ProviderTree inventory for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 06:48:11 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Updating inventory in ProviderTree for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 06:48:11 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing aggregate associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, aggregates: None {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 06:48:11 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Refreshing trait associations for resource provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c, traits: HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=75083) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 06:48:11 user nova-compute[75083]: DEBUG nova.compute.provider_tree [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed in ProviderTree for provider: 8aaf783a-f9f1-4872-9f20-91f33ff1e95c {{(pid=75083) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 06:48:11 user nova-compute[75083]: DEBUG nova.scheduler.client.report [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Inventory has not changed for provider 8aaf783a-f9f1-4872-9f20-91f33ff1e95c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75083) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 06:48:11 user nova-compute[75083]: DEBUG nova.compute.resource_tracker [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Compute_service record updated for user:user {{(pid=75083) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 06:48:11 user nova-compute[75083]: DEBUG oslo_concurrency.lockutils [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=75083) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 06:48:13 user nova-compute[75083]: DEBUG oslo_service.periodic_task [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75083) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 06:48:13 user nova-compute[75083]: DEBUG nova.compute.manager [None req-9d935d40-7eb7-4f8d-8a66-c897056c759b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75083) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 06:48:15 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:48:20 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:48:25 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 06:48:30 user nova-compute[75083]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75083) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}